Skip to content

Instantly share code, notes, and snippets.

@dwerbam

dwerbam/rstudo-sparkr.R

Forked from shivaram/rstudo-sparkr.R
Last active September 8, 2015 14:09
Show Gist options
  • Save dwerbam/ca1ec677f06b6fb66b8a to your computer and use it in GitHub Desktop.
Save dwerbam/ca1ec677f06b6fb66b8a to your computer and use it in GitHub Desktop.
Download ZIP
Rstudio local setup
Raw
rstudo-sparkr.R
Sys.setenv(SPARK_HOME="/Users/shivaram/spark-1.4.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths()))
library(SparkR)
sc <- sparkR.init(master="local")
sqlContext <- sparkRSQL.init(sc)
df <- createDataFrame(sqlContext, faithful)
# Select one column
head(select(df, df$eruptions))
# Filter out rows
head(filter(df, df$waiting < 50))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment