Skip to content

Instantly share code, notes, and snippets.

View xennygrimmato's full-sized avatar

Vaibhav Tulsyan xennygrimmato

View GitHub Profile
@xennygrimmato
xennygrimmato / swe-bench-test-repo-distribution.json
Created April 5, 2024 02:20
SWE-Bench test split repo distribution
{
"astropy/astropy": 95,
"django/django": 850,
"matplotlib/matplotlib": 184,
"mwaskom/seaborn": 22,
"pallets/flask": 11,
"psf/requests": 44,
"pydata/xarray": 110,
"pylint-dev/pylint": 57,
"pytest-dev/pytest": 119,
@xennygrimmato
xennygrimmato / localization_eval.py
Created March 16, 2024 01:54
Devin SWE-Bench Analysis
import collections
from fractions import Fraction
import os
import re
from typing import Dict, List, Set, Tuple, Union
from datasets import load_dataset
import pandas as pd
@xennygrimmato
xennygrimmato / Makefile
Created March 9, 2024 18:38 — forked from moyix/Makefile
Claude 3 writes a fuzzer
all: gifread gifread.asan gifread.ubsan gifread.coverage
gifread: gifdec.c gifread.c gifdec.h
$(CC) $(CFLAGS) -o $@ gifdec.c gifread.c $(LDFLAGS)
gifread.asan: gifdec.c gifread.c gifdec.h
$(CC) $(CFLAGS) -g -fsanitize=address -o $@ gifdec.c gifread.c $(LDFLAGS)
gifread.ubsan: gifdec.c gifread.c gifdec.h
$(CC) $(CFLAGS) -g -fsanitize=undefined -o $@ gifdec.c gifread.c $(LDFLAGS)
@xennygrimmato
xennygrimmato / coverage_gemini15.txt
Last active March 9, 2024 19:06
Generating GIFs for fuzzing a GIF Parser
File 'gifdec.c'
Lines executed:36.91% of 317
Creating 'gifdec.c.gcov'
File 'gifread.c'
Lines executed:62.50% of 56
Creating 'gifread.c.gcov'
@xennygrimmato
xennygrimmato / beam_pipeline.py
Last active March 30, 2019 07:20
Trying to convert a list of sentences containing space-separated words to a list of list of words
from __future__ import absolute_import
from __future__ import print_function
import logging
import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
class TestTokenizerDoFn(beam.DoFn):
@xennygrimmato
xennygrimmato / logs: pipenv install sourced-ml
Created July 26, 2018 16:36
pipenv install sourced-ml
(code2vec-eYK10mL1) ➜ code2vec git:(dev) pipenv install sourced-ml
Installing sourced-ml...
Collecting sourced-ml
Using cached https://files.pythonhosted.org/packages/c3/ee/be165a9a6413b0445d4bf16fb61e5832751627c69f4a7a893619b5428164/sourced_ml-0.5.1-py3-none-any.whl
Collecting bblfsh<3.0,>=2.2.1 (from sourced-ml)
Using cached https://files.pythonhosted.org/packages/ba/12/7512e5bd4f9040691d4da68b60d4f41c869f13f5fbbc7e0a2014aa98bbb4/bblfsh-2.9.14.tar.gz
Collecting pygments<3.0,>=2.2.0 (from sourced-ml)
Using cached https://files.pythonhosted.org/packages/02/ee/b6e02dc6529e82b75bb06823ff7d005b141037cb1416b10c6f00fc419dca/Pygments-2.2.0-py2.py3-none-any.whl
Collecting typing (from sourced-ml)
Using cached https://files.pythonhosted.org/packages/05/2b/2b05bf1d5a9dd450447c9a5df3e118a465e5d3cb12b73b7220a5064a403f/typing-3.6.4-py3-none-any.whl
...
copying bblfsh/github/com/gogo/protobuf/gogoproto/__init__.py -> build/lib.macosx-10.12-x86_64-3.6/bblfsh/github/com/gogo/protobuf/gogoproto
warning: build_py: byte-compiling is disabled, skipping.
running build_ext
building 'bblfsh.pyuast' extension
creating build/temp.macosx-10.12-x86_64-3.6
creating build/temp.macosx-10.12-x86_64-3.6/bblfsh
creating build/temp.macosx-10.12-x86_64-3.6/bblfsh/libuast
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -Ibblfsh/libuast -I/usr/local/include -I/usr/local/include/libxml2 -I/usr/include -I/usr/include/libxml2 -I/usr/local/Cellar/python/3.6.5_1/Frameworks/Python.framework/Versions/3.6/include/python3.6m -c bblfsh/pyuast.cc -o build/temp.macosx-10.12-x86_64-3.6/bblfsh/pyuast.o -std=c++11
...
copying bblfsh/github/com/gogo/protobuf/gogoproto/__init__.py -> build/lib.macosx-10.12-x86_64-3.6/bblfsh/github/com/gogo/protobuf/gogoproto
warning: build_py: byte-compiling is disabled, skipping.
running build_ext
building 'bblfsh.pyuast' extension
creating build/temp.macosx-10.12-x86_64-3.6
creating build/temp.macosx-10.12-x86_64-3.6/bblfsh
creating build/temp.macosx-10.12-x86_64-3.6/bblfsh/libuast
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -Ibblfsh/libuast -I/usr/local/include -I/usr/local/include/libxml2 -I/usr/include -I/usr/include/libxml2 -I/usr/local/Cellar/python/3.6.5_1/Frameworks/Python.framework/Versions/3.6/include/python3.6m -c bblfsh/pyuast.cc -o build/temp.macosx-10.12-x86_64-3.6/bblfsh/pyuast.o -std=c++11
@xennygrimmato
xennygrimmato / infer_output.txt
Created July 24, 2018 10:15
infer issue with sub-modules
Summary of the reports:
...
(not shared for privacy)
Error while running epilogue "restoring Maven's pom.xml to its original state":
(Unix.Unix_error "No such file or directory" rename
"((src /Users/vaibhavtulsyan/infer_test_run/portal/rest-utils/pom.xml.infer-orig) (dst /Users/vaibhavtulsyan/infer_test_run/portal/rest-utils/pom.xml))").
Powering through...
Error while running epilogue "restoring Maven's pom.xml to its original state":
(Unix.Unix_error "No such file or directory" rename

FWIW: I didn't produce the content presented here (the outline from Edmond Lau's book). I've just copy-pasted it from somewhere over the Internet, but I cannot remember what exactly the original source is. I was also not able to find the author's name, so I cannot give him/her the proper credits.


Effective Engineer - Notes

What's an Effective Engineer?