rodrigoalvesvieira

Extracting financial disclosure reports and police blotter narratives using OpenAI's Structured Output

tl;dr this demo shows how to call OpenAI's gpt-4o-mini model, provide it with URL of a screenshot of a document, and extract data that follows a schema you define. The results are pretty solid even with little effort in defining the data — and no effort doing data prep. OpenAI's API could be a cost-efficient tool for large scale data gathering projects involving public documents.

OpenAI announced Structured Outputs for its API, a feature that allows users to specify the fields and schema of extracted data, and guarantees that the JSON output will follow that specification.

For example, given a Congressional financial disclosure report, with assets defined in a table like this:

rodrigoalvesvieira

# THIS LINUX SETUP SCRIPT HAS MORPHED INTO A WHOLE PROJECT: HTTPS://OMAKUB.ORG
# PLEASE CHECKOUT THAT PROJECT INSTEAD OF THIS OUTDATED SETUP SCRIPT.
#
#

# Libraries and infrastructure
sudo apt update -y
sudo apt install -y \
	docker.io docker-buildx \
	build-essential pkg-config autoconf bison rustc cargo clang \

rodrigoalvesvieira

#include <stdio.h>

/*
    Rodrigo Alves @ CIn - rav2
    cin.ufpe.br/~rav2

    Assuming you have downloaded both the C++ and the input file,
    to run this software open your computer's console and run:

    g++ -o chinese.out chinese.cpp && ./chinese.out

rodrigoalvesvieira

#include <stdio.h>

int recursion(int n)
{
    if (n == 1) return 7;
    return recursion(n-1) + 5;
}

int main()
{

rodrigoalvesvieira

import java.util.Scanner;

/**
 * The contents of this file are not directly bound to a normal Algorithms class
 * Here I plan to store some known Algorithms that represent proven Mathematical formulas
 * for computing calculations that may appear in my programming assignments
 *
 * @author Rodrigo Alves
 *
 */

rodrigoalvesvieira

res = ""
("a".."z").to_a.each do |l|
  res << "'#{l}'" << ", "
end

puts res

rodrigoalvesvieira

#include <iostream>
#include <stdexcept>
using namespace std;

int divide(int A, int B);

int main()
{
    int A, B;
    cout << "Welcome do the marvelous divider!\n" << endl << endl;

rodrigoalvesvieira

// BFS - Breadth First Search
// author: Rodrigo Alves
// As explained on Wikipedia https://en.wikipedia.org/wiki/Breadth-first_search
#include <cstdio>
#define Mark(A, pos) (A[pos] = 1)

class Node {
public:
    int value;
    Node* next;

rodrigoalvesvieira

// a jquery script to fetch all acronyms from political parties in Brazil from the following url
// http://pt.wikipedia.org/wiki/Anexo:Lista_de_partidos_pol%C3%ADticos_no_Brasil
// July 1, 2013

var base = 1;
var count = 29;
var total = "";

while (count > 0) {
  total += $(".wikitable.sortable.jquery-tablesorter tbody tr td").eq(base).text();

rodrigoalvesvieira

#!/usr/bin/env ruby

=begin

Rodrigo Alves
Februrary 26, 2013
A program to concatenate multiple images into one

Call it from the command line and pass it n parameters, the first n-1 parameters
are the names of the images from which you wanna create another image and the n-th