Takahata was born in Ujiyamada (now Ise), Mie Prefecture, Japan, on October 29, 1935, as the youngest of seven siblings and third son in the family. His father, Asajiro Takahata (1888–1984), was a junior high school principal, who became the education chief of Okayama prefecture after the war.