Paladini Palace, Lower 15th - 18th century