Thomas Ashish Cherian PandaWhoCodes

Slashing LLM Token Costs for Insurance PDF Extraction

Context: A pipeline that fetches emails, triages them via LLM, downloads PDF attachments, extracts insurance policy details via LLM, and saves results. Currently spending ~$0.038/run on Groq Llama 4 Scout.

Current State — Where the Money Goes

Per Run (1 user):

Offloading Processing to On-Demand Workers — Complete Guide

Context: A FastAPI app running a sequential email→triage→PDF→LLM→save pipeline (30-60s per run). Goal: cut always-on compute costs and scale individual bottlenecks independently.

Current Architecture — What We're Working With

User Request → FastAPI (always-on server)

	<!DOCTYPE html>
	<html lang="en">
	<head>
	<meta charset="UTF-8">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">
	<title>FaithTech Global Impact & Research Report (2024-2026)</title>
	<style>
	:root {
	--primary: #1A365D;
	--secondary: #2B6CB0;

	<!DOCTYPE html>
	<html lang en>
	<head>
	<meta charset utf-8>
	<meta name=viewport content=width=device-width, initial-scale=1>
	<title>FaithTech — Global Impact Report</title>
	<script src=https://cdn.tailwindcss.com></script>
	<link rel=preconnect href=https://fonts.googleapis.com>
	<link href=https://fonts.googleapis.com/css2?family=Inter:wght@300;400;500;600;700;800;900&display=swap rel=stylesheet>
	<script>

	<!DOCTYPE html>
	<html lang="en">
	<head>
	<meta charset="UTF-8">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">
	<title>FaithTech Impact Report</title>
	<style>
	body {
	font-family: Arial, sans-serif;
	line-height: 1.6;

	<!DOCTYPE html>
	<html lang="en">
	<head>
	<meta charset="UTF-8">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">
	<title>Mac M4 Game Controller Comparison — Amazon India</title>
	<style>
	* { margin: 0; padding: 0; box-sizing: border-box; }
	body { font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; background: #0f0f0f; color: #e0e0e0; padding: 20px; }
	h1 { text-align: center; font-size: 1.8rem; margin-bottom: 8px; color: #fff; }

	<!DOCTYPE html>
	<html lang="en">
	<head>
	<meta charset="UTF-8">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">
	<title>The Cross — Sermon Notes</title>
	<link href="https://fonts.googleapis.com/css2?family=Crimson+Pro:ital,wght@0,300;0,400;0,500;0,600;1,300;1,400&family=Overpass+Mono:wght@300;400;500&family=Nunito+Sans:wght@300;400;600&display=swap" rel="stylesheet">
	<style>
	* { margin: 0; padding: 0; box-sizing: border-box; }
	:root {