Skip to content

Instantly share code, notes, and snippets.

@mannharleen

mannharleen/node data pipelie .md

Last active June 20, 2019 05:42
Show Gist options
  • Save mannharleen/47c8a68e9d708690528bcad04caa79e7 to your computer and use it in GitHub Desktop.
Save mannharleen/47c8a68e9d708690528bcad04caa79e7 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
node data pipelie .md

No longer maintained. See README.md of the project on github

level 0

  • job.js
  • logger.js

level 1/external dependencies

  • through

level 2 (functionalProgrammingForStream.js)

  • map
  • filter
  • flatMap ?
  • sample
  • reduce(zeroValue, redOp)
  • aggregate(zeroValue, seqOp, combOp) ? only relevant to distributed/partitioned data?
  • collect

level 3 (typeConvertorsForStream.js)

  • stringify
  • object2json
  • object2csv
  • json2object
  • csv2object
  • object2xml
  • xml2object

level 3 (source/target)

  • print
  • readFile
  • writeFile
  • readSFTP
  • writeSFTP
  • readDB
  • writeDB
  • restClient
  • restServer
  • soapClient
  • soapServer

level 4

  • readCsv
  • writeCsv
  • readJson
  • writeJson
  • readXml
  • writeXml
  • sql
  • set
  • get
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment