Originally a fortified palace and home to the bishops-counts, according to tradition it was erected (or more likely expanded and strengthened) at the end of the 12th century by Bishop Gerardo de Taccoli, who died in 1196 fighting against the Trevisans.
The civic tower holds the bell whose sound, since 1403, summoned the Greater City Council; shortly thereafter, it placed the public bell that served the Belluno community to mark the rhythm of city life, such as the assemblies of the noble council, and to warn the population of fire dangers. A twin tower, on the corner facing the Cathedral, was demolished in 1516 to widen the square in front of the Cathedral, but there must have been a third, central tower, as clearly shown by the ancient episcopal seal that depicted this very building. Having been remodeled several times, the portal and some elements of the upper windows date back to the renovation carried out by Bishop Giulio Berlendis in the 17th century. Seriously damaged by the earthquake of 1873, it underwent a total internal remodeling overseen by engineer Giorgio Pagani-Cesa, along with facade interventions following the new earthquake of 1936.
Once the seat of the Court, it is now used as a municipal auditorium.