LLMs work best when tasks can be converted into vectors — when meaning and relationships can be embedded in continuous space. But there are important areas where this approach falls short:
LLMs lack sensory experience and embodied reasoning. They struggle with:
- Spatial logic ("Will this fit through the door?")
- Physical dynamics ("Will the stack fall over?")