Skip to content

Instantly share code, notes, and snippets.

@hugobowne
Created November 13, 2025 11:06
Show Gist options
  • Select an option

  • Save hugobowne/236c17db4ba1d380ed3443b91601c2a0 to your computer and use it in GitHub Desktop.

Select an option

Save hugobowne/236c17db4ba1d380ed3443b91601c2a0 to your computer and use it in GitHub Desktop.
Short research synthesis on "what comes after LLMs" — summary of themes across 5 sources (OpenAI, Google results, TechTarget, O'Reilly, Forbes).
# What Comes After LLMs — Research Notes
Short Description of Research Question
What are the leading ideas, research directions, and likely near-term and longer-term evolutions in AI that could follow, complement, or supplant large language models (LLMs)?
## Summary of Findings
Across the sources reviewed, there is broad agreement that LLMs will remain important but are likely to be complemented (not immediately replaced) by a range of approaches that address LLM weaknesses (hallucination, lack of continuous learning, heavy compute, limited reasoning, limited embodiment). Key themes:
- Hybrid/neuro-symbolic and reasoning systems: combining neural models with symbolic/logic layers to improve reasoning, verifiability, and reduce hallucinations.
- Real-time/continuous learning approaches: liquid learning networks, integrated neurosymbolic architectures, or models designed to update online so knowledge stays current.
- Smaller, specialized language models (SLMs): domain-tuned, compute-efficient models that hallucinate less and are cheaper for narrow tasks.
- Agentic / multi-agent systems and tool-using agents: systems of agents or single agent architectures that orchestrate tools, external retrieval, and actions — often called agentic AI, AutoGPT/MetaGPT-like approaches.
- Spatial, embodied, and multimodal foundation models: models that understand 3D space, sensor input, and are embodied in robots or virtual agents — enabling new forms of control and reasoning.
- Neuromorphic and hardware advances: neuromorphic computing for brain-like efficiency and novel memory/compute tradeoffs; quantum computing as a longer-term accelerator for specific tasks.
- Human-centered, institutional, and governance shifts: focus on social intelligence, human-AI collaboration, safety, infrastructure, and regulation as part of what "comes next".
- Ecosystem-level convergence: many authors expect the next era to be a blend of approaches (e.g., LLMs + reasoning + agents + specialized models) rather than a single replacement.
Near-term outlook: incremental stacks and integrations (retrieval augmentation, reasoning modules, agents, smaller domain models) will proliferate. Longer-term: potential paradigm shifts (neuromorphic, quantum, fully embodied AGI) but with high uncertainty and substantial research/hardware gaps.
## Sources
- [OpenAI News — OpenAI News page](https://openai.com/news/) - general state of the field and recent model releases (shows ongoing LLM development and productization).
- [Google Search results: what comes after LLMs](https://www.google.com/search?q=what+comes+after+LLMs) - aggregated search results pointing to community discussions (Reddit, HN, Quora), news, and commentary summarizing common community views about next directions.
- [TechTarget — "What comes after LLMs? The next wave in generative AI"](https://www.techtarget.com/searchenterpriseai/opinion/What-comes-after-LLMs-The-next-wave-in-generative-AI) - outlines LLM limitations and suggests alternatives: logical reasoning systems, real-time learning models, liquid learning networks, and small language models.
- [O'Reilly Radar — "What Comes After the LLM: Human-Centered AI, Spatial Intelligence..."](https://www.oreilly.com/radar/what-comes-after-the-llm-human-centered-ai-spatial-intelligence-and-the-future-of-practice/) - emphasizes human-centered AI, spatial intelligence (3D and embodied models), institutions and ecosystems shaping future work.
- [Forbes — "The Six AI Pathways..."](https://www.forbes.com/sites/lanceeliot/2025/10/20/the-six-ai-pathways-that-will-overcome-todays-dead-end-llms-and-finally-get-us-to-agi/) - summarizes a CCC report and six candidate paradigms: neuro-symbolic, neuromorphic, embodied, multi-agent, human-centered, and quantum AI.
(Visited 5 sources total.)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment