You'll need to stay at one of the community-run homestays surrounding the temple.
The Community Based Tourism programme organises homestays with local villagers. The hosts are given support setting up a bedroom comfortably and cooking for foreigners. We stayed with a family in the southeast part of the village, and loved it. They didn’t speak English, but the welcome was warm, and settling in and being able to observe ordinary Cambodian family life across three generations... Read our full review of Community Based Tourism Homestay.
The Travelfish newsletter is sent out every Monday and is jammed full of free advice for travel in Southeast Asia. You can see past issues here.