At least two guesthouses accept foreigners in Thazi, but you should make a beeline for Moon Light -- it's great.
It's difficult to overstate just how friendly and sweet the people are who run this very long-running guesthouse are -- we found them thoroughly hospitable and very helpful regarding information for onwards transport. They can even offer free pickup from the station should you need it. The rooms are more variable than the hospitality. They're functional, but it's a good thing that most people... Read our full review of Moon Light Guesthouse & Red Star Restaurant.
The Travelfish newsletter is sent out every Monday and is jammed full of free advice for travel in Southeast Asia. You can see past issues here.