Both Are Possible
Parasites can be either vertebrates or invertebrates. The lamprey is a vertebrate parasite that feeds on fish blood. Many invertebrates, including tapeworms, roundworms, fleas, and ticks, are also parasites.
Defining Characteristic
What defines a parasite is its relationship with a host, not whether it has a backbone.