Built in 1325, the Casa do Infante is so named because Henry the Navigator was presumably born there.

The building, one of the oldest in the city, was probably also the largest in size, especially because of the two towers built in the 14th century, which have long since disappeared. The national monument has served different purposes over the years, such as a residence for official visits from the royal house, the city's old Customs House and the Mint, which had its offices there for several centuries.