kyleavery

import os
import base64

from concurrent.futures import ThreadPoolExecutor, as_completed

import openai

from pdf2image import convert_from_path
from PIL import Image

kyleavery

import requests
import re
import json
import time


INFILE = "url_list.txt"
OUTFILE = "html_content.jsonl"
LOGFILE = "failed_urls.txt"
DELAY = 5

kyleavery

Keybase proof

I hereby claim:

• I am kyleavery on github.
• I am kyleavery (https://keybase.io/kyleavery) on keybase.
• I have a public key ASBCemRfWsmURNQxCq7h3bwpduOcmF-oZmtsHU3RfljxFgo

To claim this, I am signing this object: