Ben Epstein Ben-Epstein

Tech Lead LLM @EvolutionIQ | Founding Engineer @rungalileo | OSS @arcee-ai

Ben-Epstein / MLFlow start experiment and run.py

Last active November 5, 2020 15:28

MLFlow start experiment and run

	mlflow.set_experiment('Iris_classification')
	mlflow.start_run(run_name='Spark Decision Tree')
	get_mlflow_ui(mlflow.current_exp_id())

Ben-Epstein / Setup for MLFlow and NSDS.py

Last active November 5, 2020 15:28

Setup for MLFlow and NSDS

	from splicemachine.spark import PySpliceContext
	from splicemachine.mlflow_support import *

	splice = PySpliceContext(spark)
	mlflow.register_splice_context(splice)

Ben-Epstein / Get Spark UI.py

Last active November 5, 2020 15:28

View Spark UI

	from splicemachine.notebook import get_spark_ui, get_mlflow_ui
	get_spark_ui()

Ben-Epstein / Create Spark.py

Last active November 5, 2020 15:27

Create Spark Session

	from pyspark.sql import SparkSession
	spark = SparkSession.builder.getOrCreate()

Ben-Epstein / Database Deployment.ipynb

Created September 11, 2020 14:54

Sorry, something went wrong. Reload?