Skip to content

Instantly share code, notes, and snippets.

@M2shad0w

M2shad0w/spark_package$TreeNodeException: execute

Created February 2, 2016 06:55
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save M2shad0w/9823834270a80eeeb743 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save M2shad0w/9823834270a80eeeb743 to your computer and use it in GitHub Desktop.
Download ZIP
spark sql error
Raw
spark_package$TreeNodeException: execute
Caused by: org.apache.spark.sql.catalyst.errors.package$TreeNodeException: execute, tree:
TungstenExchange hashpartitioning(additional#3,200), None
+- TungstenAggregate(key=[additional#3], functions=[(count(additional#3),mode=Partial,isDistinct=false)], output=[additional#3,count#81L])
+- Project [additional#3]
+- Filter (((created_at#0 >= 2016-01-25) && (created_at#0 < 2016-01-26)) && (action#2 = search))
+- InMemoryColumnarTableScan [additional#3,created_at#0,action#2], [(created_at#0 >= 2016-01-25),(created_at#0 < 2016-01-26),(action#2 = search)], InMemoryRelation [created_at#0,eventable_type#1,action#2,additional#3,track_id#4,device#5,city_code#6], true, 10000, StorageLevel(true, true, false, true, 1), ConvertToUnsafe, Some(tracklogs)
at org.apache.spark.sql.catalyst.errors.package$.attachTree(package.scala:49)
@M2shad0w

M2shad0w commented Feb 3, 2016

Copy link
Copy Markdown
Author

because the sc.textFile is null

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment