I hereby claim:
- I am yinleon on github.
- I am leonleon (https://keybase.io/leonleon) on keybase.
- I have a public key ASD5y56XsVBxKct1HzreWZgFR0TuM59fIbcWfreau0am_Ao
To claim this, I am signing this object:
Leon Yin yinleon
This file has been truncated, but you can view the full file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [ | |
| { | |
| "index": "0", | |
| "lon": "31.4", | |
| "lat": "81.27", | |
| "month": "7", | |
| "year": "1987", | |
| "depth": "3.0", | |
| "temp": "-1.66", | |
| "sal": "34.09", |
This file has been truncated, but you can view the full file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [ | |
| { | |
| "lat": -89, | |
| "lon": -180, | |
| "d18o": -1.0000000150474662e+30 | |
| }, | |
| { | |
| "lat": -89, | |
| "lon": -179, | |
| "d18o": -1.0000000150474662e+30 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!DOCTYPE html> | |
| <meta charset="utf-8"> | |
| <style> | |
| .links line { | |
| stroke: #999; | |
| stroke-opacity: 0.6; | |
| } | |
| .nodes circle { |
yinleon
/ twitter_streaming_api_retweet.json
Last active
May 8, 2018 20:53
The syntax of a json body for a retweet from the streaming API.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| {"contributors": null, | |
| "coordinates": null, | |
| "created_at": "Thu Jan 19 16:14:30 +0000 2017", | |
| "entities": {"hashtags": [{"indices": [66, 66], "text": "<OBFUSCATED>"}, | |
| {"indices": [66, 66], "text": "<OBFUSCATED>"}], | |
| "symbols": [], | |
| "urls": [], | |
| "user_mentions": [{"id": 666, | |
| "id_str": "<OBFUSCATED>", | |
| "indices": [66, 66], |
yinleon
/ twitter_streaming_api_tweet.json
Created
April 14, 2017 19:42
A regular tweet from the streaming api. Strings obfuscated with <OBFUSCATE>, and numbers obfuscated with 666
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "entities": { | |
| "symbols": [], | |
| "hashtags": [ | |
| { | |
| "indices": [ | |
| 66, | |
| 66 | |
| ], | |
| "text": "<OBFUSCATED>" |
yinleon
/ twitter_streaming_api_quoted_retweet
Created
April 14, 2017 19:52
A tweet that was a retweeted quoted status. Strings obfuscated with <OBFUSCATED>, numbers obfuscated with 666.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "favorite_count": 666, | |
| "lang": "en", | |
| "coordinates": null, | |
| "quoted_status": { | |
| "favorite_count": 666, | |
| "lang": "en", | |
| "coordinates": null, | |
| "extended_tweet": { | |
| "display_text_range": [ |
yinleon
/ keybase.md
Created
January 15, 2018 15:29
yinleon
/ get_all_keys.py
Created
March 12, 2018 21:45
A function to traverse and list all keys in a JSON or Dictionary
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| def get_all_keys(d, key=[]): | |
| ''' | |
| A recursive function that traverses json keys in a dict `d`, | |
| and prints the path to all keys | |
| ''' | |
| if not isinstance(d, dict): | |
| print(''.join(['["' + k + '"]' for k in key])) | |
| return | |
| for k, v in d.items(): |
yinleon
/ muiltiprocessing_files.py
Last active
February 25, 2021 00:14
This is a Python routine to help read many files using multiprocessing. `files` can be a list of file paths and `file_parser_func` can be any function that reads a file and returns a list.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from multiprocessing import Pool | |
| from tqdm import tqdm | |
| import pandas as pd | |
| # def file_parser_func(fn : str): | |
| # return pd.read_csv(fn).to_dict('records') | |
| # files = ['a.csv', 'b.csv'] | |
| data = [] | |
| with Pool(processes=8) as pool: |
yinleon
/ image_grid.py
Created
September 2, 2020 21:03
A helpful function to display grids of images in Jupyter Notebooks.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from PIL import Image | |
| import matplotlib.pyplot as plt | |
| import numpy as np | |
| img_width, img_height = 400, 300 | |
| def resize_img_to_array(img, img_shape=(244, 244)): | |
| img_array = np.array( | |
| img.resize( | |
| img_shape, |
OlderNewer