The museum is a work in progress; as of now only the names of each dessert are provided in English, but we were told full information boards in English are on the way.
If that holds true, it would be an interesting stop; you could learn about desserts then walk over to the market to try them out.
Admission is free.
The Travelfish newsletter is sent out every Monday and is jammed full of free advice for travel in Southeast Asia. You can see past issues here.