Skip to content

Instantly share code, notes, and snippets.

@a-chumagin
a-chumagin / validate_checks.py
Created December 19, 2024 20:25
Validations for Soda CL checks
from soda.scan import Scan
import os
import yaml
import argparse
def parse_arguments():
parser = argparse.ArgumentParser()
parser.add_argument('--path', help='Specify the tests to run')
return parser.parse_args()
@a-chumagin
a-chumagin / my_suite.json
Last active June 26, 2023 07:15
Params in test
{
"data_asset_type": null,
"expectation_suite_name": "my_suite",
"expectations": [
{
"expectation_type": "expect_column_values_to_be_between",
"kwargs": {
"column": {
"$PARAMETER": "column_name"
},
@a-chumagin
a-chumagin / test-taxi-datasource.py
Created April 4, 2023 20:29
GX: checkpoint in parallel
import great_expectations as gx
from great_expectations.data_context.types.base import DataContextConfig, FilesystemStoreBackendDefaults
import os
from great_expectations.core.batch import RuntimeBatchRequest
import pytest
@pytest.fixture
def create_context():
context_dir = os.path.abspath("./tripdata")
import great_expectations as gx
from great_expectations.data_context.types.base import DataContextConfig, FilesystemStoreBackendDefaults
import os
import logging
logging.basicConfig()
logging.getLogger('sqlalchemy.engine').setLevel(logging.INFO)
context_dir = os.path.abspath("./mysql-context")
@a-chumagin
a-chumagin / Dockerfile
Last active October 13, 2022 13:46
GX quick check result
FROM python:3.7-slim-bullseye
RUN pip install great-expectations==0.15.26
COPY ./*.py /
ENTRYPOINT ["/usr/local/bin/python", "check.py"]
POLYGON((33.59601218050673 -96.19406055623665,33.59714961149158 -96.19402300531044,33.59716301634673 -96.19508813624537,33.59602111719493 -96.19512032275355,33.59601218050673 -96.19406055623665))
@a-chumagin
a-chumagin / google-maps-polygon-coordinates-tool.markdown
Created February 11, 2020 12:17
Google Maps Polygon Coordinates Tool

Google Maps Polygon Coordinates Tool

Outputs the coordinates (longitude, latitude) for Google Maps whenever the Polygon is moved or re-shaped. Recently added a 'Copy to Clipboard' button and had data output into a textarea for easier copying & pasting

I originally built this to build map outlines for neighborhoods, villages, districts and counties - specifically for real estate purposes.

A Pen by Jeremy Hawes on CodePen.

License.

@a-chumagin
a-chumagin / Link
Created December 17, 2019 05:37
DeepTraffic is a deep reinforcement learning competition
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@a-chumagin
a-chumagin / Dockerfile
Last active June 21, 2019 20:47
simple_flask_server
FROM alpine:latest
RUN apk update && apk add python3
RUN python3 -m ensurepip
COPY ./requirements.txt /opt/flask_auth/requirements.txt
WORKDIR /opt/flask_auth
RUN pip3 install -r requirements.txt