Keep in mind all the agent "sees" is a sequence of tokens and unless the model is specifically trained to be able to interpret that specific kind of spatial reasoning -- to line those up in columns -- ...

I was in a meeting last week raging about the stupidity of nvidia's current valuation. They fell into this completely by accident, TWICE (crypto and now LLMs). There is no guarantee that GPUs will be ...