Priyansh Agrawal Priyansh121096
♟️
Priyansh121096
/ local_iceberg_table_using_trino.txt
Last active
October 10, 2023 01:24
How to setup a local Iceberg table using Trino?
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Requirements: Linux, Trino | |
| Topics: | |
| - Apache Iceberg (https://iceberg.apache.org/) | |
| - Trino (https://trino.io/) | |
| - MySQL (https://www.mysql.com/) | |
| - Hive metastore (https://hive.apache.org/) | |
| # Install and configure mysql | |
| # https://www.digitalocean.com/community/tutorials/how-to-install-mysql-on-ubuntu-20-04 |
Priyansh121096
/ ipython_memory_profile.py
Created
October 5, 2024 13:19
How to profile memory usage with ipython / jupyter
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| In [1]: import ipython_memory_usage.ipython_memory_usage as imu | |
| In [2]: imu.start_watching_memory() | |
| In [2] used 0.0000 MiB RAM in 5.31s, peaked 0.00 MiB above current, total RAM usage 15.57 MiB | |
| In [3]: %cat slots.py | |
| class MyClass(object): | |
| __slots__ = ['name', 'identifier'] | |
| def __init__(self, name, identifier): | |
| self.name = name |