Over time I come across lots of useful resources but then quickly forget about them. What a shame. So I have decided to put it all together in this page. Hopefully this page will come in handy one day. Will populate this page from time to time.
- ExplainShell.com - copy and paste a Linux command here and find out what it means!
- Bash Color Tips: wonder how to change terminal text color and styles? Use this guide plus this stackoverflow
- Tensorflow - an open source software library for Machine Intelligence by Google
- Keras.io - a Python Deep Learning framework
- Deep Learning with Python
- Data Sources:
- Stanford - Machine Learning (by Andrew Ng on Coursra)
- Stanford CS229 Machine Learning Handout
- Stanford CS131 - Computer Vision: Foundations and Applications
- Stanford CS231a - Computer Vision, From 3D Reconstruction to Recognition
- Stanford CS231n - Convolutional Neural Networks for Visual Recognition
- 2016 Winter Syllabus: find slides and links to course notes here.
- GitHub Site
- GitHub Repos
- Supplementary video on Youtube and Archive.org.
- YouTube - Deep Learning School - Deep Learning for Computer Vision (Andrej Karpathy, OpenAI). “don’t be a hero”: Instead of rolling your own architecture for a problem, you should look at whatever architecture currently works best on ImageNet, download a pretrained model and finetune it on your data. You should rarely ever have to train a ConvNet from scratch or design one from scratch.
- ConvNetJS - ConvNetJS is a Javascript library for training Deep Learning models (Neural Networks) entirely in your browser. Open a tab and you're training. No software requirements, no compilers, no installations, no GPUs, no sweat.
- Demo: JavaScript Interactive Linear Classifier Demo
- Demo: ConvnetJS demo: toy 2d classification with 2-layer neural network
- Demo: ConvNetJS Demo - training on CIFAR-10
- Andrej Karpathy Blog - lots of great resources and useful contents there!
- What Every Computer Scientist Should Know About Floating-Point Arithmetic
- Neural Network Manifolds Topology.
- Regularization of Neural Networks using DropConnect
- Google Brain - Large Scale Distributed Deep Networks
- Hyperopt - Distributed Asynchronous Hyperparameter Optimization in Python.
- Hyperparameter search Bayesian - article for ref.
- Dark Knowledge - Youtube: TTIC Distinguished Lecture Series - Geoffrey Hinton.
- Object Regconition:
- RCNN by Microsfot Research
- Fast RCNN - by Microsfot Research
- Faster RCNN - by Microsfot Research
- YOLO - You Only Look Once Detection as Regression - Real Time Object Regconition.
- t-SNE Visualization - Visualize the fully connected (FC) layer in the convolution neural network in a 2D plan. by Van der Maaten & Hinton. Think of this as clustering for images - all similar images are clustered together.
- numpy tricks - some numpy tricks that may be useful for the assignments.
- Stanford Deep Learning Tutorial - on GitHub Repository. This tutorial will teach you the main ideas of Unsupervised Feature Learning and Deep Learning.
- Stanford CS224d - Deep Learning for Natural Language Processing
- DeepMind - Publications
- Quora - I have completed Andrew Ng's Coursera class on Machine Learning. What should I do next? What can I do next?
- CovNet.js - Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser
- Amazon Mechanical Turk
- Vision - a computer vision book by David Marr
- PASCAL VIsual Object Challenge
- CFAR-10 - The CIFAR-10 and CIFAR-100 are labeled subsets of the 80 million tiny images dataset. They were collected by Alex Krizhevsky, Vinod Nair, and Geoffrey Hinton. The CIFAR-10 dataset consists of 60000 32x32 colour images in 10 classes, with 6000 images per class. There are 50000 training images and 10000 test images.
- Neural Networks and Deep Learning Tutorials - Tutorials by by Michael Nielsen
- DeepLearningBook.org - a free online book written by Ian Goodfellow, Yoshua Bengio, and Aaron Courville. Published by MIT Press. Can also be ordered as a hardcopy on Amazon.
- Google Brain Team - Make machines intelligent. Improve people’s lives.
- Geoff E Hinton - Neural Networks Expert. Engineering Fellow at Google Brain Team.
- Brain Games Show - a mind blogging series created by National - Geographic that may inspire you thing may not what your brain sees it. For extra insights.
- Tensorflow Playground - interactive web based neural network training tool. Have a play!
- Google Brain Big Picture - We explore how information visualization can make complex data accessible, useful, and even fun. Our focus is on ways to illuminate the data and algorithms used in machine intelligence.
- A Beginner's Guide To Understanding Convolutional Neural Networks - helps understanding how CNN works.
- Image Kernels - visualization created by Setosa.
- An Interactive Node-Link Visualization of Convolutional Neural Networks (ISVC 2015) - by Adam Harley. Pretty cool.
- Open AI - OpenAI is a non-profit AI research company, discovering and enacting the path to safe artificial general intelligence.
- MyCroft.AI - Open Source Voice Assistant.
- Amazon Alexa - Alex voice assistant.
- Google Assistant - Google Assistant.
- fast.ai - fast.ai is dedicated to making the power of deep learning accessible to all. Includes a 7-week free course on pragmatic deep learning.
- Facebook eyescrem project Generating Natural Images using Neural Networks - and corresponding GitHub
- Deepvis - a tool for ease of visualising a convolutional neural network. Especially understandng which (trained) nerons are particularly excited to which part / features of the images.
- Stanford cs224n - Natural Language Processing with Deep Learning and supplementary lecture youtube videos
- Oxford Deep Learning 2017 Lecture Materials, and youtube videos. With Deepmind.
- Connecting jupyter notebook on compute node
- How to start with python on Colfax Cluster: covers how to start and access jupyter notebook from Colfax cluster via SSH tunnelling.
- NOTES ON STARTING WITH DEEP LEARNING WITH PYTHON ON HPC CLUSTER: covers environment setup and jupyter notebook running on Colfax cluster.
- Connecting jupyter notebook on compute node
- ARXIV - Cornell University Library - Open access to 1,259,592+ e-prints in Physics, Mathematics, Computer Science, Quantitative Biology, Quantitative Finance and Statistics
- ARXIV Sanity - Built in spare time by @karpathy to accelerate research.
- Science Direct- Explore scientific, technical, and medical research on ScienceDirect.
- Intel Software Insider
- Intel Developer Mesh
- ParrotSonJava by Martin Fortsch
- GumStix: Rapid prototyping tools to accelerate your time to market.
- Edison vs Joule
- DFRobot, Maker Collider, Seeed, Tektyte, Gumstix
- Intel Deep Learning SDK
- Intel RealSense Camera SDK V1.1
- Intel RealSense Technology YouTube Channel
- Intel Developer Zone - AI
- Game Development with Unity and Intel® RealSense™ Camera
- Ohms Law LED Resistor Calculator - very handy for quickly finding out the appropriate current limiting resistor value.
- Resistor Color Code - life saver!
- Science Buddies - Multimeter
- John Philip Jones - Gimp tutorials - very clear speaker with great intros to gimp interface.
- Karey Helms Portforlio - Human Interaction Design: Met Karey from an Intel Edison Workshop. She's got a portforlio with some pretty interesting projects!
- Robo Kitty by Kathryn White: Kathryn is one of the most tech-savy, artistic, adventurous person I've come across in my professional career. She is a web developer, a 3D-printer maker/hacker, and an artist.
- Connecting Nerons: My friends from FabLabLondon (Suzie, Heman, Nealesh) are launching their Kickstarter campaign on this new and exciting boardgame in Feburary 2016. I'm keeping an eye.
- Shane Gryzko Blog: I met Shane via the FinTech Hackathon at Startup Bootcamp during a Halloween weekend at Startup Bootcamp London (by the Tower Bridge / Tower of London). A good friend who is always up for new challenges. Specialises in C++ and love exploring new technologies.
- Adam Waxman technical blog: a fantastic technical blog on Ruby, web development, and more.
- Paul A. Jungwirth: an awesome guy who has helped me out on a Rails query in a day on [this Stackoverflow forum[(http://stackoverflow.com/questions/35951585/what-does-the-in-rails-query-mean)
- Petar Kormushev: an awesome Imperial College professional in Robotics and Machine Learning.
- James K Nelson: awesome blog posts on JavaScripts / ES6 / React, etc. The MemAMug Project sounds cool - using Rails as Server-side API, and React for front-end client.
- Full-Stack Redux Tutorial: a Comprehensive Guide to Test-First Development with Redux, React, and Immutableby Tero Parviainen (@teropa)
- Michele's music - from my musician friend Michele Quaglio.
How I write Scientific Blog Posts That Contains Codes and Mathematical Expressions - a Quick Reference - with Wordpress, Gist and Mathjax: I've written this post to summarize all that is needed to know about writing Scientific Blog Posts in Markdown Syntax, in which the blog posts are used to document codes and mathematical expressions. This is my own little "how to" bible article. In case things go wrong in future (which I hope not!), this article might just hopefully will save myself!
Gist: I tend to write blog posts with Sublime Text Editor, save as a markdown (.md) file, and store the .md file on Gist. This is a nice way of writing blog posts with tons of code blogs. I then embed the Gist Embed URL in my WordPress blog content (check out the oEmbed Gist WordPress plugin). When the person view my blog post, he/she is essentially viewing the markdown file that I store inside Gist.
WordPress.org: the Content Management System (CMS) that I use for the overall website design and on-going operations. I use the Wordpress TwentyFourteen theme as a base theme, then tweaked it (via a child theme for safety) as I go along. Google-ing and Youtube-ing helped me a LOT.
oEmbedGist Plugin: Install this oEmbedGist plugin in wordpress to embed Gist items in blog posts. I tend to write the entire blog post in Gist, then simply embed the Gist embed URL (a oneliner) in the blog post.
MathJax Script: If the Gist Markdown post contains Tex Mathematical symbols / equations (inline and/or display), make sure to include the two scripts suggested by Patrick Oscity (i.e. the accepted answer), prior embedding the Gist URL. This is to ensure Mathematical symbols and equations to render correctly when viewed via wordpress. i.e. The Wordpress post should contain three scripts. Patrick's Script 1 and 2, followed by the Gist embed URL script.
MathJax Cheatsheet: for quick references of inserting mathematical symbols and equations into a Markdown blog post. Latex Syntax - Cheatsheet might also come in handy.
MathJax Guide by Martin Keefe: another very good MathJax cheatsheet.
StackEdit: This free online tool might come in handy for quickly testing out Tex maths equations.
SciWeaver: Another free online tool for quickly testing out Tex maths equations. It renders the maths a graphic file which can be saved away. This can be handy sometime.
Sublime Text - my new favourite text editor. I write blog with it all the time now!
Notepad++ - another very cool editor.
GeoGeBra - looks like a good potential good software to accurately draw geometry diagrams.
Udacity: my current favourite. A site full of education around data analysis, app development, and other cool stuff! Courses are taught by instructors from the like of Google and Facebook.
Udemy: did some tutorials on Java and Python. Taught by instructors from all over the world. It's like YouTube tutorials but more organized.
Coursera: the Standard Machine Learning course by Andrew Ng can be found here. I hope to go through the course one day!
MIT Open Courseware: Spent a week going through all the video lectures on Artificial Intelligence taught by Prof Patrick Henry Winston. I even bought his book on ebay afterwards!
MyCodeSchool an excellent YouTube channel containing tons of very good playlists on C/C++, Data Structures, Algorithms, etc. The videos are very well made (quite Udacity like and if not, better :). Also see their official site mycodeschool.com/.
HackerRank: offers free coding practices and challenges. Definitely need checking out this site.
CodeAcademy: where I learn JavaScript!
CodeSchool: a pretty cool interactive platform where you get to leran new programming languages via very intersting exercises.
Code4Startup: learn to code by cloning startups / websites!
Katacoda: Docker, Kebernetes, and more! (free courses)
shodor.org - Interactivate Activities: tons of statistical web applications. The Histogram is very cool.
Wolfram Alpha - copy and paste a list of numbers to the box (separated by comma). This cool applet will work out relationships for you. e.g. histograms, statistics, etc.
Sampling Distribution - by onlinestatbook.com. This is a very cool tool to simulate sampling distribution. I first learnt about this from This Udacity Intro to Descriptive Statistics Tutorial.
The Klout Score - The Klout Score is a number between 1-100 that represents your influence. The more influential you are, the higher your Klout Score. I first learnt about this from This Udacity Intro to Descriptive Statistics Tutorial.
random.org - virtual shufflers: a virtual Shufflers, such as dice, playing cards, etc. This may be used to complete the final project for the Udacity Intro to Descriptive Statistics Course.
Graph Pad: An online software to quickly compute statistics (e.g. distributions, P values, random numbers, etc.).
z Table: Use z-table when the population distribution parameters are given. Use this to find proportion of population below a given a Z-Score. Or vice versa, given the probability of a population being picked that is below an unknown Z-Score, find the Z-Score.
t Table: Use t-table when the population parameters are not given. Use it similar to a similar fashion as the z-table. df
is the degree-of-freedom. Given a sample size of n
, the df is n - 1
.
F Table: Use the F Table to find the critical F statistic when performing ANOVA analysis. e.g. say we are comparing the means and variations of more than 2 samples, are at least two samples significantly different to each other?
q Table: If the F Hypothesis Test is significant, perform Multiple Comparison Test. This requires the Tukey's HSD (Honest Significant Difference), which requires the q-value - from this q-table.
Chi-Square Table: Use this to perform Chi-Square Test for Independence. (Udacity Intro to Inferential Statistics - Lesson 16.)
- Math Is Fun - easy to understand tutorials on mathematics. From basics to advanced level.
- BetterExplained - a blog created by Kalid Azad that helps you better understands complex mathematical concepts with simple intuitions. See also this handy cheatsheet
- Basic Math Symbols - handy guide for understanding equations.
- CS231 - Python Numpy Tutorial
- PyFormat: shows a list of old vs new style Python string formatting syntax, with examples.
- Jupyter - get documentations on Jupyter Notebook, console, etc.
- Advanced Jupyter Notebook Tricks - very handy for tips on user Jupyter notebook more effectively.
- Scipy lectures - the bit on NumPy might be handy.
- numpy tricks - some numpy tricks that may be useful for the assignments.
Accelerated C++ by Andrew Koening and Babara Moo, 2000: this is the book I used when first learnt to program in C++. I love the way the author starts by a problem, then introduces you to the tools to solve that problem. After solving a few problems with the techniques used in the book, my C++ skills had gone up a knotch.The godsend knowledge is the asymmetric range [m, n)
- meaning from m
(inclusive) to n
(exclusive).
- MDN - Mozilla.org: the web development bible. Do not underestimae this resource!!!
- Github pages: you get to create a free website if you have a Github account!
- http://thenodeway.io/
- Node.js Handbook - Understanding Error-First Callbacks
- Eloquent JavaScript: A Modern Introduction to Programming
- Flex's NodeJS Beginner Guide
- FreeCodeCamp: Thoudsands hours of JavaScript / NodeJS practices!!! Looks awesome!
- NodeJS API Doc
- Gitter - FreeCodeCamp: chat with fellow student / community.
- MDN - JavaScript Guide: the JavaScript Bible.
- NodeJS Tutorial: a very good starter guide covering the entire MEAN Stack (MongoDB, ExpressJS, AngularJS, NodeJS).
- JavaScriptIsSexy.com: contains a great post on Callback - what it is and how to use it. This tutorial is very good.
- Async Function
- ToDoMVC - a GitHub project to teach MVC framework using the MEAN stack
- HackHands - How to get started on the MEAN Stack: also see part 2 - express, part 3 - MongoDB, part 4 - deploy to PROD.
- YouTube - Philip Roberts: What the heck is the event loop anyway? | JSConf EU 2014: this youtube video has saved me. I now have a better understanding of what a JavaScript event loop is.
- LatenFlip - Loupe - Awesome visualization of the event loop: this really helps understanding how the whole event-loop works, in conjunction with the stack, web API, and callback queue.
- on Publishing website
- HTTP Methods and return codes meaning
- HTTP Get: understand requests, responses, and headers via this post, and the Postman Chrome Plugin. Also take a look at this Postman doc to learn adding headers to the request.
- Edit This Cookie Chrome Plugin: introduced in the Udacity Web Development course (CS253).
- SenchaLabs.org: some cool JavaScripts tools here!
- Popuar NodeJS IDE: that helps NodeJS development.
- YouTube Functional Programming Tutorials: an awesome series of functional programming by @mpjme. This guys is AWESOME!!!
- Cloud9 - update NodeJS Version: will be using this frequently to ensure our NodeJS is up-to-date.
- SurviveJS: React, Webpack.
- Full Stack Redux Tutorial: A Comprehensive Guide to Test-First Development with Redux, React, and Immutable.
- HTML Color Codes: a color picker.
- CSS Reference: will be needing this alot.
- Ruby On Rails Guides : a recommended website by a strong Ruby/Rails friend of mine who uses it on a daily basis. The get-started tutorial is pretty good.
- rbenv: for ease of controlling ruby and rails versions.
- Go Rails - provides some good guides on.
- Setup RubyOnRails on Mac / other OS: very important. Also include great tips on setting up Git.
- Youtube video series on setting up Ruby and Rails.
- Building and documenting API in Rails
- MackenzieChild Rails Tutorial: awesome Rails tutorials!!!
- Building microservices with docker and the rails API
- postgres.app - handy postgres for MacOS.
- PG-Admin - a very nice GUI to compliment the postgres.app.
- How to remove PostgreSQL completely on MacOS - very handy when previously installed postgres via brew or DB Entreprise Installer.
- Stackoverflow - psql: FATAL: role “Stephen” does not exist - very important!!!
- Stackoverflow - psql: FATAL: database “” does not exist - very important!
- reset postgres.app: note the reset postgres.app part - it has solved a local development database problem.
- The Odin Project - some interesting course materials to get your hands dirty.
# Other
- Invoice Generator: handy tool to generate invoice and download as PDF.