Children keep drinking sweet liquids like milk ... Avoid sweetened liquids in bottles Avoid letting your baby sleep with a bottle, especially if it contains milk, formula or juice.