The original Jewish Museum Vienna was founded in 1896 and was the first museum of its kind in the world. The museum has existed with the support of the "Society for the collection and preservation of art and historical monuments of Jewry." He focused on the history and culture of Jews in the Austro-Hungarian Empire. His collection of objects and products from Palestine also reflected the political debate about Zionism. The museum was closed immediately after the occupation of Austria by the Nazis. In the last year of its existence, it had 6474 different items. In 1939 they were transferred to the Museum of Ethnology, and other institutions.

Most of the items were returned to the Jewish community in the early 1950s, but some managed to return only in 1990 year. Many of the exhibits were lost. When the New Jewish Museum has an inventory, it was found that half of the original items had disappeared. But the rest of the things are very rare exhibits that represent as objects of everyday life, and unique materials.

December 31, 1964 a small Jewish museum was opened in a newly constructed building on Tempelgasse, but received almost no public attention. After 3 years the museum has closed.

The first exhibition of the new Jewish Museum Vienna opened March 7, 1990 in temporary premises in the offices of the Jewish community. A significant part of the exhibition was made up of a collection of Max Berger. In 1992 the museum moved to its current home at the palace Eskeles Doroteegasse. The museum was opened a year later, in 1993. The library was opened to the public since 1994.

Since autumn 2011, the museum opened its doors after a complete renovation, like the building itself, and update the permanent exhibition. Renovated Jewish Museum welcomes visitors to the new lighting system, which was made in accordance with the original. The permanent exhibition in the museum are located in three zones.