No, they cannot. Baby foxes are mammals and, like all mammals, need milk to survive in their first few weeks of life. Fox milk is especially rich in nutrients and provides everything the babies need to grow and develop properly. Without milk, baby foxes will quickly become malnourished and die.