Toch was born in Vienna. He sought to introduce new ideas and approaches to music. He studied philosophy at the university of Vienna and medicine at Heidelberg. His main instrument was the piano, and he was a pianist of concert stature. Much of his creative output aimed toward the piano. He was a self-taught composer, and in America he came to instruct new generations of composers. His first compositions date from circa 1900 and were pastiche pieces in the style of Mozart (quartets, 1905 album verses for piano).
His first quartet was performed in Leipzig in 1908, and his sixth (Opus 12, 1905) in the year 1909. In 1909, his chamber symphony in F major (written 1906) won the Frankfurt/Main Mozart prize. From this time onwards Toch dedicated himself to being a full-time composer. He won the Mendelssohn prize for composition in 1910. In 1913 he was appointed lecturer of both piano and composition at the College of Music in Mannheim. After winning a further five major prizes for his works, Toch served 4 years in the army on the Italian Front. In 1916 he married Lilly Zwack, the daughter of a banker. After World War I had ended, he returned to Manheim to compose, devoping a new style of polyphony.
This period lasted from 1934 to 1958. His works often exhibit a humorous aspect (Bunte Suite (1929)). In 1930 he invented "Gesprochene Musik," the idiom of the "spoken chorus"; his most performed work is the Geographical Fugue or Fuge aus der Geographie, though he regarded it as an unimportant diversion. He wrote music for films, symphonies, chamber music, chamber operas. He also wrote books dealing with musical theory: Melodielehre (1923) and "The Shaping Forces in Music" (1948).
Toch was considered one of the great avant-garde composers in the pre-Nazi era, and, like many other artists and musicians, went into exile when Hitler came to power.
Toch won the Pulitzer Prize for Music in 1956 for his Third Symphony (premiered by the Pittsburgh Symphony Orchestra on December 2, 1955). He died in Los Angeles and was interred in the Westwood Village Memorial Park Cemetery in Los Angeles. He is the grandfather of author Lawrence Weschler.