When Irving Dorsey and his brothers were growing up, their dad, New Orleans soul-funk singer Lee Dorsey, filled the family garage with boxing equipment such as sand bags.

“Our father tried to make boxers out of us,” Irving Dorsey recalls with a mix of pride and bemusement.

Lee Dorsey rose to fame with classic songs including “Ya Ya,” “Ride Your Pony” and “Working...