mimiyan
mimiyan
/ ManagedMemoryLeak.scala
Created
August 3, 2018 14:03
This piece of test code will lead to Spark WARN "Managed memory leak detected"
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package test | |
| import com.holdenkarau.spark.testing.{ DataFrameSuiteBase } | |
| import org.apache.spark.sql.{ DataFrame } | |
| import org.apache.spark.sql.SparkSession | |
| import org.apache.spark.sql.functions.{ array, col, collect_set, udf } | |
| import org.graphframes.GraphFrame | |
| import org.graphframes.lib.AggregateMessages | |
| import org.scalatest.FunSuite |