Initially, it was a vacation house for a Zamindar of Jamalpur district, Sheikh Enayet Ullah. After his death, his son sold this property to the French traders in 1740. They dug a pond in front of the building where fresh water could be fetched. After having a great business in the subcontinent for almost a century, they surrendered under the full British power and sold all their properties. So, in 1830, Khwaja Alimullah – an established man in Dhaka bought the property. He added a mosque in this compound. After his death, his son Khwaja Abdul Gani took a progressive look at the property and named it “Ahsan Manzil” after his son Ahsan Ullah.
1985, the Dhaka National Museum obtained this property and made it a museum after a long restoration process.