It depends on what you mean by "most babies."
Most litters per year: Cats typically have more litters per year than dogs.
Most babies per litter: Dogs tend to have larger litters than cats. Some dog breeds can have 10-12 puppies in a litter, while cats usually have 4-6 kittens.
So, the answer is:
Cats have the potential to have more litters per year.
Dogs tend to have more babies per litter.
It's important to remember that these are just general trends.