1896–1924

The club was founded on 1 August 1896 by former members of the three local clubs (FC Turicum, FC Viktoria, and FC Excelsior). Zürich won its first title in the Swiss Super League in 1901–02, but did not win it again until 1923–24.

Until the 1930s, the club's sporting remit also included rowing, boxing, athletics, and handball, but later focused solely on football.

1925–1960

Between 1925 and 1960, Zürich were in the "wilderness years," devoid of success. The club struggled to keep in the top flight and were relegated from the Super League in 1933–34, playing in the Challenge League until 1941. In 1940–41, they returned to the Super League, where they stayed until their relegation in the 1945–46. They were back in the Super League in 1947–48 and stayed in the top flight until relegated once more in 1956–57. They were promoted from the Challenge League to contest the Swiss Super League 1958–59, finishing in third place.

1960–1981

This period was known as the "Golden Years" by the FCZ faithful. At this time, the club was run by the legendary President Edwin Nägeli and had players such as Köbi Kuhn, Fritz Künzli, Ilija Katić, René Botteron, and many more. Zürich won seven championships in they years 1963, 1966, 1968, 1974, 1975, 1976 and 1981. They also won the Swiss Cup five times in 1966, 1970, 1972, 1973, and in 1976. FCZ also had some success in Europe getting to the semi-finals of the European Cup 1963–64, before losing to Real Madrid and also reaching the semi-finals in the European Cup 1976–77, where they lost to Liverpool.

1981–2005

Following the club's league title in 1981, the club went into a decline and in 1988, the club was relegated to the Challenge League. Zürich returned to the top league in 1990. The club did make it to last 16 of the UEFA Cup 1998–99, but were beaten by Roma. The club won the Swiss Cup in 2000, beating Lausanne in the final and also in 2005 beating Luzern.

Recent years

On 13 May 2006, FCZ ended their 25 years wait for a league title with a dramatic final day victory against Basel to win the Super League. They won thanks to a goal scored in the 93rd minute by Iulian Filipescu. The goal gave FCZ a 2 – 1 victory and secured the title on goal difference over Basel. In 2006–07, they also won the league.

In the 2007–08 season, FCZ finished in third place. In the 2008–09 season, they won the league, edging out BSC Young Boys.