A 4 months old baby should be on exclusive breastfeeding alone. Not water, not anything. If for health or any other reasons you can not breastfeed exclusively, kindly give age-appropriate milk/formula and hold till 6 months to introduce complementary feeding.