Mort was born in McKeesport in Pennsylvania in 1935. He was nine years old when he received a metal clarinet from his uncle and began lessons. When he was ten, his family moved to Los Angeles. He continued his classical music studies at high school and Westlake School of Music for a year. Antonio Remondi (clarinetist, Los Angeles Philharmonic Orchestra) was one of his teachers. Mort was a soloist in many live TV performances in Los Angeles and New York during high school. He also played in community bands. Mort discovered jazz while in high school. It quickly became his main interest. He listened to Miles, Dexter and Buddy as he sat in back alleys near open kitchen doors, listening to all of them. He was influenced by “Senator”, Gene Wright, a well-known bassist. He visited jazz clubs and participated in jam sessions after hours whenever the opportunity presented itself. He practiced for 8-10 hours per day, and he enjoyed playing with other jazz musicians. Mort, who was 19 years old, was drafted in the Army. He played in the Army Band. He learned the tenor and baritone saxophones during his tour of service.