The National Weather Service is predicting Ulster, Dutchess counties will see temperatures below zero Tuesday night.