SomajitDey/ANN_DL_deep_dive.md

Last active September 12, 2024 13:16

Star (1) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/SomajitDey/0f9b6f47b2a7de81af5c2695e59f3b96.js"></script>
Save SomajitDey/0f9b6f47b2a7de81af5c2695e59f3b96 to your computer and use it in GitHub Desktop.

Download ZIP

Transformers and Artificial Neural Networks/Deep Learning in AI/ML

Raw

ANN_DL_deep_dive.md

Following are a few resources to help understand Artifical Neural Nets / Deep Learning.

Brilliant intro to ANN. Noteworthy: Universal Approximation Theorem
Brilliant intro to Backpropagation
Russel and Norvig's Artificial Intelligence, A Modern Approach, 4th Global Edition
Lectures by Florian Marquardt: Machine learning for physicists
CS231n.stanford.edu
Layer and Batch normalization
Batch vs Online learning
Types of learning
- Zero-Shot
- Self-supervised
Reflections on scaling
- Prediction: Human-equivalent neural networks by 2030
- The Scale of the Brain vs Machine Learning
End-to-end learning, the (almost) every purpose ML method

Raw

transformers_deep_dive.md

Following are a few resources to help understand transformers.

Papers

Blogs / Articles

"Transformers Explained Visually" series
- Part 1
- Part 2
- Part 3
- Part 4
The Illustrated Transformer

Videos / Lectures

Youtube course by 3Blue1Brown Specifically, the chapters 5 and 6
Andre Karpathy tutorial

Books

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment