That's a cute question! Baby mice, like all baby mammals, are born with very soft skin and little pigmentation. This means their feet will likely be pinkish due to blood vessels showing through thin skin.
As they grow, their feet will gain more color, depending on the specific breed of mouse.