Let's come up with an amphibian race!

If the underground sea is not connected to the surface, then the inconsistency is resolved. One can descend into the underground world through passages in the dungeon. Movement there will be facilitated by the skills acquired for underwater travel. So, everything seems to be fine here.