Related Setup: https://gist.github.com/hofmannsven/6814278
Related Pro Tips: https://ochronus.com/git-tips-from-the-trenches/
Mageswaran Mageswaran1989
Mageswaran1989
/ ANNet.scala
Created
November 24, 2015 12:22
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.aja.tej.examples.ml | |
| import org.aja.tej.utils.TejUtils | |
| import org.apache.spark.ml.classification.MultilayerPerceptronClassifier | |
| import org.apache.spark.ml.evaluation.MulticlassClassificationEvaluator | |
| import org.apache.spark.mllib.util.MLUtils | |
| import org.apache.spark.sql.SQLContext | |
| /** | |
| * Created by mageswaran on 25/9/15. |
Mageswaran1989
/ HelloWorldSpark.scala
Created
November 24, 2015 12:17
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.aja.tej.examples | |
| import java.io.File | |
| import org.aja.tej.utils.TejUtils | |
| import org.apache.spark.{SparkConf, SparkContext} | |
| /** |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.aja.tej.tej.test.spark | |
| /** | |
| * Created by mageswaran on 9/8/15. | |
| */ | |
| import java.util.Random | |
| import org.apache.spark.{SparkConf, SparkContext} |
Mageswaran1989
/ StackExchange_ReadMe.txt
Created
June 25, 2015 18:02
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| - Format: 7zipped | |
| - Files: | |
| - **badges**.xml | |
| - UserId, e.g.: "420" | |
| - Name, e.g.: "Teacher" | |
| - Date, e.g.: "2008-09-15T08:55:03.923" | |
| - **comments**.xml | |
| - Id | |
| - PostId | |
| - Score |
Mageswaran1989
/ stackexchange_demo.scala
Last active
August 29, 2015 14:23
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /** | |
| * Get the stackexchange data from https://archive.org/details/stackexchange | |
| * Data set used here : math.stackexchange.com | |
| **/ | |
| //Open the file. The text file is an RDD (Resilient Distributed Dataset) | |
| //of Strings, which are the lines of the file. | |
| val postXML = sc.textFile("Posts.xml") | |
| //Count the lines. Note: Run twice and see the difference ;) |
Mageswaran1989
/ README.md
Last active
August 29, 2015 14:09
— forked from hofmannsven/README.md
NewerOlder