Single-photon bus connecting spin-wave quantum memories