Skip to content

Instantly share code, notes, and snippets.

View bigdatasunil's full-sized avatar
💭
I may be slow to respond.

Sunilkumar bigdatasunil

💭
I may be slow to respond.
  • Scania
  • Sweden
  • 16:59 (UTC -12:00)
View GitHub Profile
@airawat
airawat / 00-MapSideJoinLargeDatasets
Last active December 23, 2017 07:11
MapsideJoinOfTwoLargeDatasets(Old API) - Joining (inner join) two large datasets on the map side
**********************
**Gist
**********************
This gist details how to inner join two large datasets on the map-side, leveraging the join capability
in mapreduce. Such a join makes sense if both input datasets are too large to qualify for distribution
through distributedcache, and can be implemented if both input datasets can be joined by the join key
and both input datasets are sorted in the same order, by the join key.
There are two critical pieces to engaging the join behavior: