As with so many vinyl enthusiasts, New York artist Ted Riederer found his groove at a young age. “When I was 16, my mother was hospitalized for a year and instead of being a troubled adolescent I joined a rock band,” he says, laughing, “and started going to record stores like an acolyte to a church.”

Cue up Never Records, Riederer’s evolving multimedia experiment in the community of sound. Since its “opening” in 2010, the n...