After The Phil Silvers Show ended in 1959, Nat Hiken went on to produce Car 54, Where Are You? and cast Joe E. Ross as Patrolman Gunther Toody of New York's 53rd Precinct. Fred Gwynne, another Bilko alumnus, played Toody's partner, Francis Muldoon. Toody could usually be counted on at some point to say "Ooh! Ooh!", or "Do you mind? Do—you—mind?". Ross became so identified with his policeman role that he recorded an album of songs entitled "Love Songs from a Cop". Roulette Records released the LP in 1964. Ross did the voice for Toody for the episode "Car 54" of Hanna-Barbera's Wait Till Your Father Gets Home, in which Toody and Muldoon moonlight running a day care center and one of the children turns up missing.
Ross also starred as Gronk in Sherwood Schwartz's ill-fated 1966 sitcom It's About Time, which featured two 1960s American astronauts who were thrown back in time to the prehistoric era. Following the breakup of Allen & Rossi in 1968, Steve Rossi teamed for less than three months with Ross in an act called "Rossi & Ross". Rossi & Ross played once on Ed Sullivan and disbanded in January 1969.
Ross also was a prominent cartoon voice into the 1970s, playing the stereotypical bumbling sergeant in many cartoons such as Hong Kong Phooey (as Sgt. Flint) and Help!... It's the Hair Bear Bunch! (as Botch). He also voiced Roll on CB Bears segment Shake, Rattle and Roll. His "Ooh! Ooh!" phrase was emulated by Frank Welker in the animated series Fangface. He was also one of the few white comedians with 1970s label Laff Records, which specialized in African-American comedians and released his album Should Lesbians Be Allowed to Play Pro-Football?.