Skip to content

Instantly share code, notes, and snippets.

View jnhmcknight's full-sized avatar

Jared McKnight jnhmcknight

4 followers · 0 following
View GitHub Profile
@jnhmcknight
jnhmcknight / flask-route-enum-converter.py
Last active May 19, 2023 15:23
from enum import Enum, EnumMeta
from flask import Flask, current_app
from werkzeug.routing import BaseConverter, ValidationError
def setup_enum_converter(enum_to_convert):
if not isinstance(enum_to_convert, (Enum, EnumMeta,)):
@jnhmcknight
jnhmcknight / download_large_file.py
Created October 25, 2023 16:43 — forked from wasi0013/download_large_file.py
how to download large file using python, requests without exhausting device ram.
import requests
chunk_size = 4096
filename = "logo.png"
document_url = "https://wasi0013.files.wordpress.com/2018/11/my_website_logo_half_circle_green-e1546027650125.png"
with requests.get(document_url, stream=True) as r:
with open(filename, 'wb') as f:
for chunk in r.iter_content(chunk_size):
if chunk:
f.write(chunk)
@jnhmcknight
jnhmcknight / click_regex_option.py
Last active September 26, 2024 21:11
Regex Parameter handler for Click
import re
import sys
import typing as t
import click
from click._compat import _get_argv_encoding
class RegexOption(click.ParamType):
@jnhmcknight
jnhmcknight / wrapped_boto3.py
Last active October 29, 2024 17:00
Flask Wrapped Boto3
"""
Include this file in your project, and then import it instead of the real `boto3`,
wherever you need to create a `boto3.client` or `boto3.resource`
i.e.:
import wrapped_boto3
s3 = wrapped_boto3.client('s3')
@jnhmcknight
jnhmcknight / cli.py
Created January 24, 2025 18:17
Show all help for a whole Click command tree
import copy
import os
import click
@click.group()
def cli():
"""A grouping of commands"""
@jnhmcknight
jnhmcknight / crawler-user-agent-strings-with-descriptions.txt
Created December 3, 2025 18:44 — forked from JoeyBurzynski/crawler-user-agent-strings-with-descriptions.txt
Bot & Crawler User Agents Strings with Descriptions
Googlebot/2.1 (+http://www.google.com/bot.html) # Pattern: Googlebot\/ / URL: http://www.google.com/bot.html
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) # Pattern: Googlebot\/ / URL: http://www.google.com/bot.html
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) # Pattern: Googlebot\/ / URL: http://www.google.com/bot.html
Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/8.0 Mobile/12F70 Safari/600.1.4 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) # Pattern: Googlebot\/ / URL: http://www.google.com/bot.html
Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F70 Safari/600.1.4 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) # Pattern: Googlebot\/ / URL: http://www.google.com/bot.html
Mozilla