The Dashboard Analogy
Bernardo Kastrup compares the physical world to the dashboard of an airplane. The dashboard (reality) tells you your altitude and speed. You can ignore it and "dream" you are flying higher, but eventually, the ground (the ultimate Reality Principle) will intervene.
Current AI systems are flying without a dashboard. They generate text based on the statistical likelihood of words, not on the state of the world. They rely on the Human Pilot to look out the window.
Field Notes & Ephemera
Evolutionary Pressure: Truth is an evolutionary adaptation. Organisms that didn't care about truth (accurate representation of the environment) went extinct. AI has no such pressure; it only has the pressure to be plausible to humans.