By the mid-13th century a few one-storey buildings and a defensive tower were in place on a tall moraine overlooking the Ultar stream, from where its precious water supply could be controlled. The tower was probably similar to those still seen in villages neear the KKH in Indus Kohistan. Over the centuries more houses and towers were added, and the result was fortified.

Ghazanfar, son of the last mir, agreed to donate in 1985 the fort to a trust created by the Aga Khan with an eye to restoration. The restoration work has generated a corps of local people trained in conservation principles and techniques, plus related subjects like archeology, structural engineering and public administration.