Alex bzz

Model	Arch	License	Params	Seq Len	FP Format	VRAM Infer	Lib	Tokenizer	Comments	Other flavours

ICML 2023

Wrokshops

DeepLearning for Code (PC)
Sparsity in NN as Jeff Dean persuasivly argues large but adaptive and sparsly activated networks both draw on neuroscience-based inspiration and are a good way to control computational costs.

Papers

LLMs on Code

Planning with Large Language Models for Code Generation, MIT site, code

Embeddings for ML4Code papers in TF Projector format

As of 04.2023 we have ~500 paper abstracts + titles in the https://ml4code.github.io/.

These are embeddings for them using 4 different models

T-SNE GPT-3, model (text-embedding-ada-002)
T-SNE sentence-transformers/all-MiniLM-L6-v2, model
[T-SNE allenai/specter2](https://projector.tensorflow.org/?config=https://gist.githubusercontent.com/bzz/a4481b985e690dc937749156f7b851c2/raw/2c39708836065e8d75c479d7802dee0eddc54fe6/specter2-projector_conf

Controversy on good ideas in technology

As a programmer, it is your job to put yourself out of business. What you do today can be automated tomorrow.

— Douglas McIlroy

1940s computers: digital VS analog

Vannevar Bush, scientist, participant of the Manhattan project, AT&T board of directors, inventor of the Differential Analyzer machine, etc. While he is a conceptual father of “personal computer” or Memex in his As We May Think - The Atlantic - he was famously against digital computers, did not believe it can be built in a reliable way and was in favour of doing analog computations instead.

ICML 2021

https://icml.cc/Conferences/2021/Schedule 2630 events

Papers

Accepted Papers

On the Bottleneck of Graph Neural Networks and its Practical Implications

Uri Alon, Eran Yahav. poster
GraphCodeBERT: Pre-training Code Representations with Data Flow

Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie LIU, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin Clement, Dawn Drain, Neel Sundaresan, Jian Yin, Daxin Jiang, Ming Zhou. poster
BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided Exploration

Augustus Odena, Kensen Shi, David Bieber, Rishabh Singh, Charles Sutton, Hanjun Dai. spotlight

Paul Graham essays

Writing
Startups
- Funding
  - VCs
  - Investors
- Founders
- Hackers
Silicon Valley

Essays by Paul Graham

04.03.2021

	{
	"ai_tutor": {
	"Author": "JushBJJ",
	"name": "Mr. Ranedeer",
	"version": "2.3.6",
	"features": {
	"personalization": {
	"depth": {
	"description": "This is the depth of the content the student wants to learn. A low depth will cover the basics, and generalizations while a high depth will cover the specifics, details, unfamiliar, complex, and side cases. The lowest depth level is 1, and the highest is 10.",
	"depth_levels": {