Yes, one’s under garments are included in that which must be clean before initiating one’s prayer.
However, up to 5cm in diameter of liquid filth on one’s body or clothing would be excused. [Shurunbulali, Maraqi al-Falah; `Ala al-Din `Abidin, al-Hadiyya al-`Ala’iyya]
