Phillip Cloud cpcloud
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| tconst | titleType | primaryTitle | originalTitle | isAdult | startYear | endYear | runtimeMinutes | genres | |
|---|---|---|---|---|---|---|---|---|---|
| tt0030540 | movie | Outside of Paradise | Outside of Paradise | 0 | 1938 | \N | 68 | Comedy,Musical,Romance | |
| tt0030541 | movie | The Strange Case of Dr. Meade | The Strange Case of Dr. Meade | 0 | 1938 | \N | 60 | Adventure,Drama,Romance | |
| tt0030542 | movie | Over She Goes | Over She Goes | 0 | 1937 | \N | 78 | Musical | |
| tt0030543 | movie | Over the Wall | Over the Wall | 0 | 1938 | \N | 67 | Drama,Romance | |
| tt0030544 | movie | The Overland Express | The Overland Express | 0 | 1938 | \N | 55 | Western | |
| tt0030545 | movie | Overland Stage Raiders | Overland Stage Raiders | 0 | 1938 | \N | 55 | Western | |
| tt0030546 | movie | To the Victor | Owd Bob | 0 | 1938 | \N | 78 | Comedy,Drama,Family | |
| tt0030547 | movie | Father of More Than Four | Padre de más de cuatro | 0 | 1938 | \N | 110 | Comedy | |
| tt0030548 | movie | Painted Desert | Painted Desert | 0 | 1938 | \N | 58 | Western |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Given a URL pointing to a Parquet file, how do I get the schema from that file | |
| as cheaply as possible? | |
| Example URL (75 MB): | |
| https://storage.googleapis.com/ibis-tutorial-data/wowah_data/wowah_data_raw.parquet | |
| """ | |
| PARQUET_MAGIC = b"PAR1" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "nodes": { | |
| "flake-utils": { | |
| "locked": { | |
| "lastModified": 1667395993, | |
| "narHash": "sha256-nuEHfE/LcWyuSWnS8t12N1wc105Qtau+/OdUAjtQ0rA=", | |
| "owner": "numtide", | |
| "repo": "flake-utils", | |
| "rev": "5aed5285a952e0b949eb3ba02c12fa4fcfef535f", | |
| "type": "github" |
cpcloud
/ flake.lock
Created
December 18, 2022 18:07
torch wheel build with poetry2nix; nixos compat and hacks around broken nvidia install behavior
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "nodes": { | |
| "flake-utils": { | |
| "locked": { | |
| "lastModified": 1667395993, | |
| "narHash": "sha256-nuEHfE/LcWyuSWnS8t12N1wc105Qtau+/OdUAjtQ0rA=", | |
| "owner": "numtide", | |
| "repo": "flake-utils", | |
| "rev": "5aed5285a952e0b949eb3ba02c12fa4fcfef535f", | |
| "type": "github" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| def foo(): | |
| try: | |
| pass | |
| except: | |
| print() |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| DEBUG - Loading configuration file: /home/cloud/src/ibis/mkdocs.yml | |
| DEBUG - Loaded theme configuration for 'material' from '/nix/store/cwsg2cw6yk8yrybyyj0ybg99x6ldd9sl-python3-3.10.9-env/lib/python3.10/site-packages/material/mkdocs_theme.yml': {'language': 'en', 'direction': None, 'features': [], 'palette': {'primary': None, 'accent': None}, 'font': {'text': 'Roboto', 'code': 'Roboto Mono'}, 'icon': None, 'favicon': 'assets/images/favicon.png', 'include_search_page': False, 'search_index_only': True, 'static_templates': ['404.html']} | |
| DEBUG - Config value 'config_file_path' = '/home/cloud/src/ibis/mkdocs.yml' | |
| DEBUG - Config value 'site_name' = 'Ibis Project' | |
| DEBUG - Config value 'nav' = None | |
| DEBUG - Config value 'pages' = None | |
| DEBUG - Config value 'site_url' = 'https://ibis-project.org/' | |
| DEBUG - Config value 'site_description' = None | |
| DEBUG - Config value 'site_author' = None | |
| DEBUG - Config value 'theme' = Theme(name='material', dirs=['/home/cloud/src/ibis/docs/overrides' |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| DEBUG - Loading configuration file: /home/cloud/src/ibis/mkdocs.yml | |
| DEBUG - Loaded theme configuration for 'material' from '/nix/store/cwsg2cw6yk8yrybyyj0ybg99x6ldd9sl-python3-3.10.9-env/lib/python3.10/site-packages/material/mkdocs_theme.yml': {'language': 'en', 'direction': None, 'features': [], 'palette': {'primary': None, 'accent': None}, 'font': {'text': 'Roboto', 'code': 'Roboto Mono'}, 'icon': None, 'favicon': 'assets/images/favicon.png', 'include_search_page': False, 'search_index_only': True, 'static_templates': ['404.html']} | |
| DEBUG - Config value 'config_file_path' = '/home/cloud/src/ibis/mkdocs.yml' | |
| DEBUG - Config value 'site_name' = 'Ibis Project' | |
| DEBUG - Config value 'nav' = None | |
| DEBUG - Config value 'pages' = None | |
| DEBUG - Config value 'site_url' = 'https://ibis-project.org/' | |
| DEBUG - Config value 'site_description' = None | |
| DEBUG - Config value 'site_author' = None | |
| DEBUG - Config value 'theme' = Theme(name='material', dirs=['/home/cloud/src/ibis/docs/overrides' |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # velox/flake.nix | |
| # following https://www.breakds.org/post/nix-based-c++-workflow/ | |
| { | |
| description = "A flake for building velox"; | |
| inputs = { | |
| nixpkgs.url = "github:NixOS/nixpkgs/nixos-unstable"; | |
| utils.url = "github:numtide/flake-utils"; | |
| utils.inputs.nixpkgs.follows = "nixpkgs"; |
cpcloud
/ genslowdata.py
Last active
May 30, 2023 19:07
Generate ClickHouse data and run a simple benchmark
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| def gen_data(*, n_ids: int, n_minutes: int): | |
| import numpy as np | |
| import tqdm | |
| start_date = np.datetime64("2013-01-01") | |
| end_date = np.datetime64("2023-05-20") | |
| start_time = np.timedelta64(9, "h") | |
| dates = np.arange(start_date, end_date) | |
| dates = dates[np.is_busday(dates)] |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import ibis.expr.datatypes as dt | |
| import torch | |
| import torch.nn as nn | |
| import tqdm | |
| import pyarrow as pa | |
| class LinearRegression(nn.Module): | |
| def __init__(self, input_dim, output_dim): |