The building was built on 1930 and was known as Madrasah Melayu Sarawak. This historical building is located at P.Ramlee Road and previously was used specifically to train more teachers in higher-level Malay education. On 22 May 1992, the building was announced as the Sarawak Islamic Heritage Museum and was officiated by Yang Amat Berhormat Datuk Patinggi Tan Sri (Dr.) Haji Abdul Taib Mahmud. This museum consists of seven galleries which are Islamic History in Sarawak Gallery, Islamic Architecture Gallery, Science and Technology, Economy, Education and Literature Gallery, Costumes, Music and Personal Belongings Gallery, Weaponry Gallery, Decorative Arts and Domestic Tools Gallery and Al-Quran Collection Gallery.

This Museum consists of seven galleries. Each of the galleries displays items that are related to a particular discipline as the following;

• First Gallery History of Islam in Sarawak
• Second Gallery Islamic Architecture
• Third Gallery Science, Technology, Economics, Education and Literature
• Fourth Gallery Music Costumes and Personal Ornaments
• Fifth Gallery Weaponry
• Sixth Gallery Decorative Arts and Domestic Utensils
• Seventh Gallery The Holy Quran Collection