This directory contains tools for handling LLM operations—most notably for document summarization—using asynchronous (async) techniques. Async Tools allow SmolAgents to process large inputs efficiently by splitting work into smaller chunks and running parallel API calls, all while keeping integration with the agent framework simple.
Large text documents can exceed the fixed context window of LLMs (e.g. GPT-4), which may result in: