The first mention of Jewish settlement in Jihlava dates back to the middle of the 13th century. The Jewish community was formed in 1345 by the decree of Charles IV that stated the Jews of Jihlava should be admitted to the town. The ghetto was located west of the main square. A synagogue and a Jewish school were located there.

During the Hussite wars, Jews expelled from Austria settled in Jihlava. But since they were accused of collaboration with the Hussites, they were expelled and had to leave all their property behind the city walls. Although a few families did make it back to Jihlava, they were expelled again. Jews appeared there only in some markets, a privilege for which they had to pay.

Jews were allowed to live and work in Jihlava towards the end of the 18th century, even though they were prevented from doing so by the prohibitions still in force. However, by the end of the 19th century there were nearly fifteen hundred Jewish inhabitants. After the First World War they numbered only one thousand. In 1939 the synagogue was burnt down and later completely demolished. The place where it stood is now the Gustav Mahler Park. Another aspect of the Jewish community in Jihlava were the historic Jewish houses, which were demolished in the 1960s and 1970s. The Jewish cemetery remains the only preserved monument of this village. A memorial commemorates the tragedy of thousands of Jews from Jihlava during the Second World War.