Tested with Apache Spark 2.1.0, Python 2.7.13 and Java 1.8.0_112
For older versions of Spark and ipython, please, see also previous version of text.
Nikolaos Vergos nvergos
brentp
/ linear_model.py
Created
April 10, 2013 15:57
calculate t statistics and p-values for coefficients in Linear Model in python, using scikit-learn framework.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from sklearn import linear_model | |
| from scipy import stats | |
| import numpy as np | |
| class LinearRegression(linear_model.LinearRegression): | |
| """ | |
| LinearRegression class after sklearn's, but calculate t-statistics | |
| and p-values for model coefficients (betas). | |
| Additional attributes available after .fit() |
ololobus
/ Spark+ipython_on_MacOS.md
Last active
September 26, 2024 08:50
Apache Spark installation + ipython/jupyter notebook integration guide for macOS