Mr0grog

http://www3.epa.gov/climatechange/Downloads/Region1-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region10-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region2-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region3-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region4-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region5-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region6-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region7-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region8-climate-change-adaptation-plan.pdf
http://www3.epa.gov/climatechange/Downloads/Region9-climate-change-adaptation-plan.pdf

Mr0grog

(Version 2.0, hard-wrapping removed)

Contributor Covenant Code of Conduct

Our Pledge

We as members, contributors, and leaders pledge to make participation in our community a harassment-free experience for everyone, regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, level of experience, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.

We pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community.

Mr0grog

/**
 * Test how async hooks works in various scenarios.
 * 
 * Call `hook.enable()` to start tracking async resources and `hook.disable()`
 * to stop or pause tracking. Then use `logAndResetHooks()` to print a log of
 * all the creation and destruction of async hooks.
 */

const asyncHooks = require("async_hooks");
const http = require("http");

Mr0grog

# This script requires `requests`, so install it if you don't already have it.
pip install requests

# See a description of all options
python arcgis-download.py --help

# Download COVID-19 case demographics from Napa County, CA
python arcgis-download.py https://services1.arcgis.com/Ko5rxt00spOfjMqj CaseDataDemographics --sr 4326

Mr0grog

"""
This is an experiment in aborting requests when using Python's `requests`
or `urllib3` packages.

My primary use case is a long running script that makes a lot of requests, but
needs to be gracefully cancelable (I use threads and signals to handle SIGINT
and SIGTERM, which is not shown here). When the first signal is sent, the
script should finish any in-progress work and gracefully shut down/clean up.
If there are HTTP requests in flight that are stuck for a long time (e.g.
many minutes), they should be aborted so the rest of the cleanup logic has a

Mr0grog

#######
# EXAMPLE OF USING THE QLIK CLIENT
#
# Reading some data from Contra Costa’s COVID-19 dashboard.
#######

from datetime import date, timedelta
from qlik import QlikClient

# First, create the client and open a connection.

Mr0grog

from datetime import timedelta
import dateutil.parser
from pathlib import Path
import re

START_LINE = re.compile(r'^\[([^\]]+)\] Starting Internet Archive Import')
END_LINE = re.compile(r'^\s*Internet Archive import completed at (.+)')
SUMMARY_START = re.compile(r'^\s*Loaded (\d+) CDX records:')
SUMMARY_ITEM = re.compile(r'^\s*(\d+)\s([\s\w\-]+)\s\(')
IMPORT_ERRORS = re.compile(r'^\s*Total:\s*(\d+)\serrors')

Mr0grog

Mr0grog

export WEB_MONITORING_DB_URL='https://api.monitoring.envirodatagov.org'
export WEB_MONITORING_DB_EMAIL='YOUR EMAIL HERE'
export WEB_MONITORING_DB_PASSWORD='YOUR PASSWORD HERE'

Mr0grog

# Experiments in capturing combined output streams from subprocesses.
# 
# It turns out it's kind of hard to get the interleaved results of stdout and
# stderr in Python. However, in a lot of situations where Python is calling
# out to other processes, you probably want to swallow the child process's
# stderr when things to right and print it when things go wrong. Since some
# programs may be outputting results on stdout and warnings and errors on
# stderr, it makes sense that you'd want it all, and all in the order it was
# printed when things go wrong.
#