While both ponies and deer are mammals, they are very different animals. Ponies are equines, meaning they are related to horses, donkeys, and zebras. Deer are ungulates, meaning they have hooves, but they are part of a different family entirely.
You might be thinking of a different word like "fawn", which is a young deer, or "roe deer", a type of small deer.