Test used in the video
=====four freebies of constructive arithmetic=====
Ref:
https://www.amazon.com/Constructivism-Mathematics-Studies-Logic-Foundations/dp/0444702660
Nikolaj-K
/ manual_sampling.py
Created
March 12, 2024 22:44
Manually sampling from any given 1D histogram
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Script discussed in the video: | |
| https://youtu.be/ndAmT8CYGDM | |
| Links: | |
| * https://en.wikipedia.org/wiki/Energy-based_model | |
| * https://en.wikipedia.org/wiki/Brownian_motion | |
| * https://www.extropic.ai/future | |
| """ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Script discussed in the video | |
| https://youtu.be/RltoGfNhex4 | |
| asyncio Enables (interleaved) sequences of functions execution within one thread. | |
| Makes e.g. sense if you want less intensive computation results earlier (for IO) or | |
| If some awaited computation is done in some external thread (e.g. info from a server). | |
| """ | |
| import asyncio |
Nikolaj-K
/ ReLU_square.py
Last active
January 16, 2024 05:00
Computing all polynomials via just ReLU activations (no learning needed)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Script discussed in this videos: | |
| * Video 1: | |
| https://youtu.be/PApGm1TKFHQ | |
| * Video 2: | |
| https://youtu.be/1z2GRcaKSrA | |
| ==== Text for video 1 ==== |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Below is the sketch of my script for the video at: | |
| https://youtu.be/ZSmORp3Bm2c | |
| Paper discussed: | |
| - https://arxiv.org/pdf/2307.03223.pdf | |
| Large width network theory: | |
| - https://en.wikipedia.org/wiki/Universal_approximation_theorem | |
| - https://en.wikipedia.org/wiki/Gaussian_process |
Nikolaj-K
/ scalargrad.py
Last active
October 23, 2023 21:31
A simple implementation of reverse accumulation (back-propagation)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Impelmentation of reverse accumulation (backpropagation), discussed in | |
| https://youtu.be/BcCk8I6YAqw | |
| Most of this script is exposition code. The reverse accumulation code still runs if you delete everything except the following 5 classes | |
| * ValAndDVal, ExprBaseRevAcc, VarExprRevAcc, PlusExprRevAcc, MultExprRevAcc | |
| validated using the following 2 functions: | |
| * p, run_VarExprRevAcc_gradient_decent_demo |
Nikolaj-K
/ bandit_strategies.py
Last active
October 10, 2023 15:59
A small pytorch routine approaching the n-armed bandit problem
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Casino strategies and some pytorch. The code is explained in the video | |
| https://youtu.be/VUVVVi9CgbI | |
| I think you can install pytorch via `pip` or `pip3` through | |
| `pip3 install torch torchvision` | |
| Some mathy reading material: | |
| * http://yuanz.web.illinois.edu/teaching/IE498fa19/ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Code discussed in the video: | |
| https://youtu.be/0A3mAUGFUow | |
| * Motivation: | |
| - Relation between Legendre symbol and quadratic equations on ZxZ | |
| + See https://en.wikipedia.org/wiki/Legendre_symbol#Table_of_values | |
| * For any fixed number, validate |
Nikolaj-K
/ copious_secret_santa.py
Last active
August 19, 2023 18:01
Copious Secret Santa / Voting assignment
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Script used in the video | |
| https://youtu.be/2b9fOpX0zKY | |
| Formal structure: balanced simple digraph | |
| (Important special properties out-degrees equals the in-degrees, no self-loops, no parallel arrows) | |
| 1. Proof task: Count them, given any assginment of out-degrees. | |
| How does it compare to just random disgraphs with that those out-degrees? | |
| 1. Coding task: Generate one given the out-degrees, fast. (I have a bad, probabilistic solution) |
Nikolaj-K
/ make_voting_assignment.py
Last active
October 28, 2023 10:40
Create a HV-MT voting assignment based on a list of capacities
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Scirpt discussed in video here: | |
| https://youtu.be/2b9fOpX0zKY?si=hjztP-RAwIgq_Yed | |
| HV-MTL Voting assignment based on users with different voting capactities per day. | |
| More formally: Generation of a balanced simple digraph* (and corresponding plot) | |
| based on a vertex set and their number of outgoing edges, | |
| with a high number of opposing edges (reciprocated votes percentage is a config). |
Nikolaj-K
/ constructive_arithmetic_freebies.md
Last active
September 23, 2023 12:14
Four freebies of constructive arithmetic