Skip to content

Instantly share code, notes, and snippets.

@izeigerman

izeigerman/DataSource_V2.scala

Created January 29, 2021 19:04
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save izeigerman/89d053d5288036f6539a48cd9b5b0b14 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save izeigerman/89d053d5288036f6539a48cd9b5b0b14 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
DataSource_V2.scala
import org.apache.spark.sql.SparkSession
import shapeless.HNil
trait DataSource[D, P] {
def read(parameters: P)(implicit spark: SparkSession): AnnotatedDataFrame[D, HNil]
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment