...is everything else secondary?

If the fish smells bad, it has likely gone bad. Generally, it has a normal smell, typical for food. After all, a dead cow also smells, its fur smells, and so on, but when it is butchered and washed, the smell disappears. Or rather, only the smell of meat remains.