Sachin Thirumala stdatalabs
helena
/ JSONSparkSQLCassandra.scala
Last active
November 8, 2023 15:53
JSON Integration with Spark SQL and Cassandra
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import com.datastax.spark.connector.cql.CassandraConnector | |
| import org.apache.spark.{SparkContext, SparkConf} | |
| import org.apache.spark.sql.{Row, SQLContext} | |
| /** Spark SQL: Txt, Parquet, JSON Support with the Spark Cassandra Connector */ | |
| object SampleJson extends App { | |
| import com.datastax.spark.connector._ | |
| import GitHubEvents._ | |
| val conf = new SparkConf(true) |