Here's why:
* Vertebrates have a backbone, or spinal column, made of a series of bones called vertebrae.
* Invertebrates lack a backbone and often have a hard exoskeleton for support.
Goldfish, like all fish, have a clearly defined backbone, which makes them vertebrates.