According to sources, the church was built by priest Antun Boglić in the late 17th century and dedicated to St. Joseph. At the end of the 19th century, the church was arbitrarily renamed Madonna del Porto (Our Lady of the port), and the current inscription above the door dates to the 1920s. The church today houses a statue of Our Lady of Comfort, originally from the Augustinian church on the site of today's town cemetery, which, according to legend, was seized during the Turkish siege and broken, then it was miraculously reassembled and floated into the port of Hvar. Presently, mass is celebrated here several times a year.