The whole explanation in.... Infinity War? about the stones states that they were created at the dawning of the universe. I'd take that to mean that the big bang ties the stones it shits out to that universe, be it the exact one it was created in or a parallel one (ie different time lines or...