Skip to content

Instantly share code, notes, and snippets.

View rasmusab's full-sized avatar

Rasmus Bååth rasmusab

411 followers · 2 following
View GitHub Profile
@rasmusab
rasmusab / org.apache.arrow.vector.util.OversizedAllocationException_spark_error.txt
Created October 7, 2019 12:16
A long spark error: org.apache.arrow.vector.util.OversizedAllocationException
---------------------------------------------------------------------------
Py4JJavaError Traceback (most recent call last)
in
----> 1 device_attack_result.count()
2
3
4
/usr/lib/spark/python/pyspark/sql/dataframe.py in count(self)
520 2
@rasmusab
rasmusab / groggbloggen_2015-2019.csv
Created June 29, 2019 14:50
Daily page views from groggbloggen.se 2015 to mid 2019
date pageviews
2015-01-01 13
2015-01-02 27
2015-01-03 56
2015-01-04 18
2015-01-05 18
2015-01-06 8
2015-01-07 19
2015-01-08 32
2015-01-09 45
@rasmusab
rasmusab / get_up_to_speed_with_bayes_test_script.R
Last active July 8, 2019 21:56
UseR 2019 tutorial - Get up to speed with Bayes test script
# Prior to the tutorial make sure that the script below runs without error on your R installation.
# You first need to install the follwoing packages:
# install.packages(c("rstanarm", "prophet", "CausalImpact"))
library(rstanarm)
library(prophet)
library(CausalImpact)
# This will test that rstanarm works
# Don't be alarmed if you get a warning about "divergent transitions "
@rasmusab
rasmusab / analyze_gnubg.R
Created July 4, 2018 13:09
A barely tested R script that takes a backgammon match in any format gnubg can read, analyzes the match and returns a data frame with the analysis
# A barely tested R script that takes a backgammon match in any format
# gnubg can read, analyzes the match and returns a data frame with the analysis
# It requires that gnubg is readily available on the command line.
library(tidyverse)
library(jsonlite)
library(glue)
analyze_bg_match <- function(match_fname, match_format = "auto") {
gnubg_analysis_fname = tempfile()
@rasmusab
rasmusab / ab_test.csv
Created June 7, 2018 13:43
Example ab-test data
date group n_purchases
2017-05-01 0 124
2017-05-02 0 95
2017-05-03 0 147
2017-05-04 0 116
2017-05-05 0 219
2017-05-06 0 248
2017-05-07 0 132
2017-05-08 0 110
2017-05-09 0 114
@rasmusab
rasmusab / monthly_deaths.csv
Created November 10, 2017 13:21
Data from Dr. Semmelweis famous discovery of handwashing, scraped from here: https://en.wikipedia.org/wiki/Historical_mortality_rates_of_puerperal_fever#Monthly_mortality_rates_for_birthgiving_women_1841–1849
date births deaths
1841-01-01 254 37
1841-02-01 239 18
1841-03-01 277 12
1841-04-01 255 4
1841-05-01 255 2
1841-06-01 200 10
1841-07-01 190 16
1841-08-01 222 3
1841-09-01 213 4
@rasmusab
rasmusab / yearly_deaths_by_clinic.csv
Created November 10, 2017 13:19
Data from Dr. Semmelweis famous discovery of handwashing, scraped from here: https://en.wikipedia.org/wiki/Historical_mortality_rates_of_puerperal_fever#Yearly_mortality_rates_for_birthgiving_women_1833–1858_for_first_and_second_clinics
year births deaths clinic
1841 3036 237 clinic 1
1842 3287 518 clinic 1
1843 3060 274 clinic 1
1844 3157 260 clinic 1
1845 3492 241 clinic 1
1846 4010 459 clinic 1
1841 2442 86 clinic 2
1842 2659 202 clinic 2
1843 2739 164 clinic 2
@rasmusab
rasmusab / the-probability-my-son-will-be-stung-by-a-bumblebee.R
Created August 14, 2017 12:17
R and Stan script calculating the probability that my son will be stung by a bumblebee.
library(tidyverse)
library(purrr)
library(rstan)
### Defining the data ###
#########################
bumblebees <- c(1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1,
0, 0, 1, 0, 0, 0, 0, 0, 0)
toddler_steps <- c(26, 16, 37, 101, 12, 122, 90, 55, 56, 39, 55, 15, 45, 8)
@rasmusab
rasmusab / fuzzycolor.R
Created June 18, 2016 10:11
A function that takes a vector of color names and matches it against the xkcdcolors list of color names using edit distance.
# fuzzycolor() takes a vector of color names and matches it against the
# xkcdcolors list of color names using edit distance. fuzzycolor() always
# returns a vector of hex color strings, perhaps the ones you wanted...
fuzzycolor <- function(color_names) {
library(xkcdcolors)
names_distance <- adist(color_names, xcolors(), ignore.case = TRUE, partial = TRUE)
xkcd_colors <- xcolors()[ apply(names_distance, 1, which.min) ]
hex_colors <- name2color(xkcd_colors)
names(hex_colors) <- xkcd_colors
hex_colors
@rasmusab
rasmusab / pystan_test_script.R
Created January 18, 2016 21:10
A short script you can use to test if pystan is installed and working correctly.
# Prior to the tutorial make sure that the script below runs without error on your python installation.
# What you need is a working installation of Stan: http://mc-stan.org/ .
# For installation instructions, see here:
# http://mc-stan.org/interfaces/pystan.html
# After installation you should be able to run this script which should output
# some summary statistics and some pretty plots, :)
# Fitting a simple binomial model using Stan