Otherwise it won't level. You have to know the material and thickness of the first layer before making any decisions. Like "housefriend" said, if the thickness of the first level is at least 3/4", you should be able to put the hardwood floor directly on the first layer. But it seems that is not the case from what you described.