Will the baby kitten know how to nurse?

Yes, most baby kittens will know how to nurse instinctively. They are usually born with the ability to find the mother's nipple and suckle.