Quora answer: What are limits to cognitive contextualization of our surroundings?
I don’t think your scenario is correct. We can tell a lot about the history of the context from our own experience. Suggest you look at Husserl’s Internal Time Consciousness edited by Heidegger to get a bigger picture of the issues you are talking about. Also consider Aron Gurwitsch’s book on The Field of Consciousness.