This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
if (typeSet != immutable.Nil) | |
{ | |
typeColTables.foreach { table => | |
val statement = session.prepare(s"INSERT INTO $table (pkey, data1) VALUES (?,?)") | |
val javaSet = seqAsJavaList(typeSet) | |
typeData.foreach { value => | |
val normstatement = new SimpleStatement(s"INSERT INTO $table (pkey, data1) VALUES (?,?)", value, javaSet) | |
//val bs = statement.bind(value, javaSet) | |
//println(seqAsJavaList(typeSet).getClass.toString) | |
//println(statement) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
min,max = 0,0 | |
while min is min * 1 or max is max * 1: | |
if min is min * 1: | |
min = min - 1 | |
if max is max * 1: | |
max = max + 1 | |
print min+1,max-1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package test; | |
/** | |
* Created by russellspitzer on 12/4/14. | |
*/ | |
import java.io.Serializable; | |
import java.util.List; | |
import org.apache.spark.SparkConf; | |
import org.apache.spark.api.java.JavaSparkContext; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package com.datastax.spark.connector | |
import java.net.InetAddress | |
import com.datastax.spark.connector.cql.{CassandraConnector, Schema} | |
import com.datastax.spark.connector.rdd.{ReadConf, CassandraRDD, ValidRDDType, SpannedRDD} | |
import com.datastax.spark.connector.writer._ | |
import com.datastax.spark.connector.writer.ReplicaMapper | |
import org.apache.spark.SparkContext | |
import org.apache.spark.SparkContext._ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package com.datastax.spark.connector.rdd | |
import java.net.InetAddress | |
import com.datastax.driver.core.BatchStatement.Type | |
import com.datastax.driver.core.ConsistencyLevel | |
import com.datastax.spark.connector.{SomeColumns, NamedColumnRef, AllColumns, ColumnSelector} | |
import com.datastax.spark.connector.cql.CassandraConnector | |
import com.datastax.spark.connector.rdd.partitioner.CassandraPartition | |
import com.datastax.spark.connector.rdd.reader.RowReaderFactory |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package com.datastax.spark.connector | |
import org.apache.spark.SparkContext | |
import org.apache.spark.rdd.RDD | |
import com.datastax.spark.connector.cql._ | |
import com.datastax.spark.connector.rdd.{CassandraPartitionKeyRDD, CassandraRDD, ValidRDDType, SpannedRDD} | |
import com.datastax.spark.connector.writer._ | |
import com.datastax.spark.connector.rdd.reader._ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package com.datastax.spark.connector | |
import org.apache.spark.SparkContext | |
import org.apache.spark.rdd.RDD | |
import com.datastax.spark.connector.cql._ | |
import com.datastax.spark.connector.rdd.{CassandraPartitionKeyRDD, CassandraRDD, ValidRDDType, SpannedRDD} | |
import com.datastax.spark.connector.writer._ | |
import com.datastax.spark.connector.rdd.reader._ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
package com.datastax.spark.connector.rdd | |
import java.net.InetAddress | |
import org.apache.spark.{Partitioner, TaskContext, Partition} | |
import org.apache.spark.rdd.RDD | |
import org.apache.spark.SparkContext._ | |
import scala.reflect.ClassTag |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
protected lazy val rowTransformer = { | |
logDebug("Row Transformer time") | |
logDebug(s"Table def null? ${tableDef == null}") | |
logDebug(s"Implictly[RowReaderFactory[R] null? ${implicitly[RowReaderFactory[R]] == null}") | |
logDebug(s"What is R? ${ct.toString()}") | |
implicitly[RowReaderFactory[R]].rowReader(tableDef) | |
} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
<project name="JavaSparkSqlExample" default="jar" > | |
<description>JavaSparkSqlExample</description> | |
<property name="src.java" location="src" /> | |
<property name="build" location="build" /> | |
<property name="build.classes" location="${build}/classes" /> | |
<property name="dse.base" location="/Users/russellspitzer/dse-4.6.1" /> |
OlderNewer