Knowledge

Knowledge is mental structure that is isomorphic to reality.

We can never know things as they truly are. We are fed light particles that reflect off surfaces and our brains use this to build an incredibly rich model of our experience. Isn't it incredible that we can have dreams that are practically indistinguishable from our waking lives? But these models are only models of our experience. The thing producing them is an approximation of reality, simulated inside our brain, optimised to be useful. Reality is far too complex to hold in a brain. So it is a simplification, an abstraction we interact with.

This mental structure is only useful insofar as it can predict future experience. It can do this because it shares structural properties with the structure of reality. Knowledge is structure that mirrors the structure of reality. This enables it to make predictions and understand the world mechanistically, without ever being able to directly interact with it.

If anyone claims that language models don't 'truly' understand the world because they are not embodied and therefore their concepts are not grounded in the world, I think the same equally applies to humans.