Rodrigo Alves Vieira rodrigoalvesvieira

Extracting financial disclosure reports and police blotter narratives using OpenAI's Structured Output

tl;dr this demo shows how to call OpenAI's gpt-4o-mini model, provide it with URL of a screenshot of a document, and extract data that follows a schema you define. The results are pretty solid even with little effort in defining the data — and no effort doing data prep. OpenAI's API could be a cost-efficient tool for large scale data gathering projects involving public documents.

OpenAI announced Structured Outputs for its API, a feature that allows users to specify the fields and schema of extracted data, and guarantees that the JSON output will follow that specification.

For example, given a Congressional financial disclosure report, with assets defined in a table like this:

	#!/usr/bin/env ruby

	=begin

	Rodrigo Alves
	Februrary 26, 2013
	A program to concatenate multiple images into one

	Call it from the command line and pass it n parameters, the first n-1 parameters
	are the names of the images from which you wanna create another image and the n-th

	// a jquery script to fetch all acronyms from political parties in Brazil from the following url
	// http://pt.wikipedia.org/wiki/Anexo:Lista_de_partidos_pol%C3%ADticos_no_Brasil
	// July 1, 2013

	var base = 1;
	var count = 29;
	var total = "";

	while (count > 0) {
	total += $(".wikitable.sortable.jquery-tablesorter tbody tr td").eq(base).text();

	// BFS - Breadth First Search
	// author: Rodrigo Alves
	// As explained on Wikipedia https://en.wikipedia.org/wiki/Breadth-first_search
	#include <cstdio>
	#define Mark(A, pos) (A[pos] = 1)

	class Node {
	public:
	int value;
	Node* next;

	#include <iostream>
	#include <stdexcept>
	using namespace std;

	int divide(int A, int B);

	int main()
	{
	int A, B;
	cout << "Welcome do the marvelous divider!\n" << endl << endl;

	res = ""
	("a".."z").to_a.each do \|l\|
	res << "'#{l}'" << ", "
	end

	puts res

	import java.util.Scanner;

	/**
	* The contents of this file are not directly bound to a normal Algorithms class
	* Here I plan to store some known Algorithms that represent proven Mathematical formulas
	* for computing calculations that may appear in my programming assignments
	*
	* @author Rodrigo Alves
	*
	*/

	#include <stdio.h>

	int recursion(int n)
	{
	if (n == 1) return 7;
	return recursion(n-1) + 5;
	}

	int main()
	{

	#include <stdio.h>

	/*
	Rodrigo Alves @ CIn - rav2
	cin.ufpe.br/~rav2

	Assuming you have downloaded both the C++ and the input file,
	to run this software open your computer's console and run:

	g++ -o chinese.out chinese.cpp && ./chinese.out

	# THIS LINUX SETUP SCRIPT HAS MORPHED INTO A WHOLE PROJECT: HTTPS://OMAKUB.ORG
	# PLEASE CHECKOUT THAT PROJECT INSTEAD OF THIS OUTDATED SETUP SCRIPT.
	#
	#

	# Libraries and infrastructure
	sudo apt update -y
	sudo apt install -y \
	docker.io docker-buildx \
	build-essential pkg-config autoconf bison rustc cargo clang \