Thing to remember, he probably went out to listen to music, but likely spent more time playing it alone or with a few others. Diversion, conversation, meant socializing. He was very social and went out and about.
From one of the historical sites:
"A lifelong fan of song, Franklin played many instruments, including the guitar, harp, and viola da gamba, a cello-like stringed instrument. He even invented one—the glass armonica—after seeing performers make music with glasses of water."
We had written music at that time, but not recordings available to everyone. You had to go there.