Penang is the only place I have been where the food alone would justify the flight, and I say that as someone who is suspicious of that sentence.

George Town is walkable in a way that most heritage cities are not, and the hawker centres run on a rhythm you pick up after about two days.

Go in the shoulder months. The heat in the middle of the year turns a walking city into a taxi city, and that is not the same trip.