Skip to content

Instantly share code, notes, and snippets.

@alopresto
Created September 28, 2016 00:27
Show Gist options
  • Save alopresto/9c93a5b3daed983219f43c7766450e90 to your computer and use it in GitHub Desktop.
Save alopresto/9c93a5b3daed983219f43c7766450e90 to your computer and use it in GitHub Desktop.
Excerpt from `logs/nifi-app.log` showing the flowfile attributes and content including bash `echo` output
2016-09-27 17:23:13,970 INFO [StandardProcessScheduler Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled ExecuteProcess[id=6e0d4685-0157-1000-1616-34e3ea888ad6] to run with 1 threads
2016-09-27 17:23:13,974 INFO [StandardProcessScheduler Thread-7] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled LogAttribute[id=6e22ae1c-0157-1000-96e3-9be4680eb151] to run with 1 threads
2016-09-27 17:23:14,340 INFO [Timer-Driven Process Thread-1] o.a.n.processors.standard.LogAttribute LogAttribute[id=6e22ae1c-0157-1000-96e3-9be4680eb151] logging for flow file StandardFlowFileRecord[uuid=9442ca93-3f3c-40c9-a23f-6b2e6707eba6,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1475019971713-1, container=default, section=1], offset=1751, length=149],offset=0,name=70522280527566,size=149]
--------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
Value: 'Tue Sep 27 17:23:14 PDT 2016'
Key: 'lineageStartDate'
Value: 'Tue Sep 27 17:23:14 PDT 2016'
Key: 'fileSize'
Value: '149'
FlowFile Attribute Map Content
Key: 'filename'
Value: '70522280527566'
Key: 'path'
Value: './'
Key: 'uuid'
Value: '9442ca93-3f3c-40c9-a23f-6b2e6707eba6'
--------------------------------------------------
Bash before Java invocation '1 2 3'
[System out] Provided arguments: 1 2 3
[System err] Provided arguments: 1 2 3
Bash after Java invocation '1 2 3'
2016-09-27 17:23:14,346 INFO [Flow Service Tasks Thread-1] o.a.nifi.controller.StandardFlowService Saved flow controller org.apache.nifi.controller.FlowController@7b388b46 // Another save pending = false
2016-09-27 17:23:17,605 INFO [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository Created new Provenance Event Writers for events starting with ID 260
2016-09-27 17:23:17,637 INFO [Provenance Repository Rollover Thread-1] o.a.n.p.PersistentProvenanceRepository Successfully merged 16 journal files (2 records) into single Provenance Log File ./provenance_repository/258.prov in 37 milliseconds
2016-09-27 17:23:17,638 INFO [Provenance Repository Rollover Thread-1] o.a.n.p.PersistentProvenanceRepository Successfully Rolled over Provenance Event file containing 3 records
2016-09-27 17:23:19,647 INFO [Timer-Driven Process Thread-10] o.a.n.processors.standard.LogAttribute LogAttribute[id=6e22ae1c-0157-1000-96e3-9be4680eb151] logging for flow file StandardFlowFileRecord[uuid=08372f74-ed03-4b3e-a73b-f921bc9e47e2,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1475019971713-1, container=default, section=1], offset=1900, length=149],offset=0,name=70527616417130,size=149]
--------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
Value: 'Tue Sep 27 17:23:19 PDT 2016'
Key: 'lineageStartDate'
Value: 'Tue Sep 27 17:23:19 PDT 2016'
Key: 'fileSize'
Value: '149'
FlowFile Attribute Map Content
Key: 'filename'
Value: '70527616417130'
Key: 'path'
Value: './'
Key: 'uuid'
Value: '08372f74-ed03-4b3e-a73b-f921bc9e47e2'
--------------------------------------------------
Bash before Java invocation '1 2 3'
[System out] Provided arguments: 1 2 3
[System err] Provided arguments: 1 2 3
Bash after Java invocation '1 2 3'
2016-09-27 17:23:24,980 INFO [Timer-Driven Process Thread-1] o.a.n.processors.standard.LogAttribute LogAttribute[id=6e22ae1c-0157-1000-96e3-9be4680eb151] logging for flow file StandardFlowFileRecord[uuid=cd1d0681-7904-417d-863a-41213d0ace84,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1475019971713-1, container=default, section=1], offset=2049, length=149],offset=0,name=70532936693553,size=149]
--------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
Value: 'Tue Sep 27 17:23:24 PDT 2016'
Key: 'lineageStartDate'
Value: 'Tue Sep 27 17:23:24 PDT 2016'
Key: 'fileSize'
Value: '149'
FlowFile Attribute Map Content
Key: 'filename'
Value: '70532936693553'
Key: 'path'
Value: './'
Key: 'uuid'
Value: 'cd1d0681-7904-417d-863a-41213d0ace84'
--------------------------------------------------
Bash before Java invocation '1 2 3'
[System out] Provided arguments: 1 2 3
[System err] Provided arguments: 1 2 3
Bash after Java invocation '1 2 3'
2016-09-27 17:23:30,315 INFO [Timer-Driven Process Thread-2] o.a.n.processors.standard.LogAttribute LogAttribute[id=6e22ae1c-0157-1000-96e3-9be4680eb151] logging for flow file StandardFlowFileRecord[uuid=48629c31-de26-4472-998e-0af78b2fbb9e,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1475019971713-1, container=default, section=1], offset=2198, length=149],offset=0,name=70538258105026,size=149]
--------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
Value: 'Tue Sep 27 17:23:30 PDT 2016'
Key: 'lineageStartDate'
Value: 'Tue Sep 27 17:23:30 PDT 2016'
Key: 'fileSize'
Value: '149'
FlowFile Attribute Map Content
Key: 'filename'
Value: '70538258105026'
Key: 'path'
Value: './'
Key: 'uuid'
Value: '48629c31-de26-4472-998e-0af78b2fbb9e'
--------------------------------------------------
Bash before Java invocation '1 2 3'
[System out] Provided arguments: 1 2 3
[System err] Provided arguments: 1 2 3
Bash after Java invocation '1 2 3'
2016-09-27 17:23:33,751 INFO [NiFi Web Server-276] o.a.n.controller.StandardProcessorNode Stopping processor: class org.apache.nifi.processors.standard.ExecuteProcess
2016-09-27 17:23:33,752 INFO [StandardProcessScheduler Thread-2] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling ExecuteProcess[id=6e0d4685-0157-1000-1616-34e3ea888ad6] to run
2016-09-27 17:23:33,753 INFO [NiFi Web Server-280] o.a.n.controller.StandardProcessorNode Stopping processor: class org.apache.nifi.processors.standard.LogAttribute
2016-09-27 17:23:33,754 INFO [StandardProcessScheduler Thread-8] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling LogAttribute[id=6e22ae1c-0157-1000-96e3-9be4680eb151] to run
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment