Dmytro Mitin DmytroMitin
😎
DmytroMitin
/ App.scala
Last active
March 13, 2023 08:57
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // core/src/main/scala/App.scala | |
| import org.apache.spark.sql.SparkSession | |
| object App { | |
| trait Base | |
| class A extends Base { | |
| def impl(x: Int): String = "ab" + x.toString | |
| } |
DmytroMitin
/ App.scala
Last active
March 12, 2023 18:05
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.catalyst.ScalaReflection | |
| import ScalaReflection.universe._ | |
| import org.apache.spark.sql.SparkSession | |
| import org.reflections.Reflections | |
| import scala.jdk.CollectionConverters._ | |
| import scala.reflect.api | |
| object App { |
DmytroMitin
/ App.scala
Last active
March 12, 2023 17:35
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.catalyst.ScalaReflection | |
| import ScalaReflection.universe._ | |
| import org.apache.spark.sql.SparkSession | |
| import org.apache.spark.sql.catalyst.ScalaReflection.universe | |
| import org.reflections.Reflections | |
| import scala.jdk.CollectionConverters._ | |
| import scala.reflect.api | |
| import scala.tools.reflect.ToolBox |
DmytroMitin
/ App.scala
Last active
March 11, 2023 06:08
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.catalyst.ScalaReflection | |
| import ScalaReflection.universe._ | |
| import org.apache.spark.sql.SparkSession | |
| import org.apache.spark.sql.catalyst.ScalaReflection.universe | |
| import org.reflections.Reflections | |
| import scala.jdk.CollectionConverters._ | |
| import scala.reflect.api | |
| import scala.tools.reflect.ToolBox |
DmytroMitin
/ App.scala
Last active
March 11, 2023 05:18
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.catalyst.ScalaReflection | |
| import ScalaReflection.universe._ | |
| import org.apache.spark.sql.SparkSession | |
| import org.reflections.Reflections | |
| import scala.jdk.CollectionConverters._ | |
| import scala.tools.reflect.ToolBox | |
| object App { | |
| def getType[T: TypeTag](obj: T) = typeOf[T] |
DmytroMitin
/ App.scala
Last active
March 11, 2023 05:29
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.catalyst.ScalaReflection | |
| import ScalaReflection.universe._ | |
| import org.apache.spark.sql.SparkSession | |
| import org.reflections.Reflections | |
| import scala.jdk.CollectionConverters._ | |
| import scala.reflect.api | |
| object App { | |
| def getType[T: TypeTag](obj: T) = typeOf[T] |
DmytroMitin
/ App.scala
Last active
March 11, 2023 04:12
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.SparkSession | |
| import org.apache.spark.sql.catalyst.ScalaReflection | |
| import ScalaReflection.universe._ | |
| import scala.tools.reflect.ToolBox | |
| object App { | |
| val spark = SparkSession.builder | |
| .master("local") | |
| .appName("Spark app") | |
| .getOrCreate() |
DmytroMitin
/ App.scala
Last active
March 11, 2023 04:10
https://stackoverflow.com/questions/75680274/determine-the-function-signature-of-an-anonymous-function-in-scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.SparkSession | |
| import org.apache.spark.sql.catalyst.ScalaReflection.universe._ | |
| object App { | |
| val spark = SparkSession.builder | |
| .master("local") | |
| .appName("Spark app") | |
| .getOrCreate() | |
| def impl(): Any = (x: Int) => "ab" + x.toString |
DmytroMitin
/ gist:4931d890b80251774c7bfa0fe3caec5f
Last active
March 6, 2023 15:43
https://stackoverflow.com/questions/75648798/how-can-i-serialize-a-scala-singleton-object
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ scalac potato.scala | |
| $ ls | |
| potato.class potato$.class potato.scala | |
| $ javap -p potato.class | |
| Compiled from "potato.scala" | |
| public final class potato { | |
| public static void dirt_$eq(int); | |
| public static int dirt(); | |
| } | |
| $ javap -p potato\$.class |
DmytroMitin
/ App13.scala
Created
February 23, 2023 15:35
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.apache.spark.sql.SparkSession | |
| import org.apache.spark.sql.functions.typedLit | |
| object App13 { | |
| val spark: SparkSession = SparkSession.builder.master("local[*]").appName("Example").getOrCreate | |
| import spark.implicits._ | |
| val columns = Seq("language", "users_count") |