Skip to content

Instantly share code, notes, and snippets.

@iameli

iameli/gist:c2821e31215de37f5e687bda52206810

Created July 8, 2021 19:34
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save iameli/c2821e31215de37f5e687bda52206810 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save iameli/c2821e31215de37f5e687bda52206810 to your computer and use it in GitHub Desktop.
Download ZIP
very slow segment transcoding
Raw
gistfile1.txt
I0708 19:30:28.104708 1 mediaserver.go:766] Got push request at url=http://lax.livepeer.monster/live/REDACTED/5.ts ua=curl/7.64.1 addr=10.42.2.11:57448 bytes=4338100 dur=8333 resolution=
I0708 19:30:28.567497 1 mediaserver.go:361] Stream authentication for url=http://lax.livepeer.monster/live/REDACTED/5.ts dur=462.536095ms
I0708 19:30:28.567782 1 broadcast.go:200] Starting session refresh manifestID=REDACTED
I0708 19:30:28.567879 1 rpc.go:234] Connecting RPC to https://sin-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.567911 1 rpc.go:234] Connecting RPC to https://tpa-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.567953 1 rpc.go:234] Connecting RPC to https://rkv-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.568002 1 rpc.go:234] Connecting RPC to https://fra-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.568049 1 rpc.go:234] Connecting RPC to https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443
I0708 19:30:28.568152 1 rpc.go:234] Connecting RPC to https://mdw-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.568235 1 rpc.go:234] Connecting RPC to https://lon-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.568279 1 rpc.go:234] Connecting RPC to https://ewr-staging-livepeer-orchestrator-2.livepeer.monster:443
I0708 19:30:28.568308 1 rpc.go:234] Connecting RPC to https://ewr-staging-livepeer-orchestrator-1.livepeer.monster:443
I0708 19:30:28.568372 1 rpc.go:234] Connecting RPC to https://nyc-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.568404 1 rpc.go:234] Connecting RPC to https://sandbox-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.568467 1 rpc.go:234] Connecting RPC to https://ord-staging-livepeer-orchestrator-0.livepeer.monster:443
I0708 19:30:28.568525 1 rpc.go:234] Connecting RPC to https://rkv-staging-livepeer-orchestrator-2.livepeer.monster:443
I0708 19:30:28.568478 1 rpc.go:234] Connecting RPC to https://rkv-staging-livepeer-orchestrator-1.livepeer.monster:443
I0708 19:30:28.567901 1 rpc.go:234] Connecting RPC to https://ewr-staging-livepeer-orchestrator-0.livepeer.monster:443
E0708 19:30:28.808608 1 discovery.go:90] Could not get orchestrator orch=https://tpa-staging-livepeer-orchestrator-0.livepeer.monster:443: rpc error: code = Unimplemented desc = Not Found: HTTP status code 404; transport: received the unexpected content-type "text/plain; charset=utf-8"
E0708 19:30:28.814640 1 discovery.go:90] Could not get orchestrator orch=https://ord-staging-livepeer-orchestrator-0.livepeer.monster:443: rpc error: code = Unimplemented desc = Not Found: HTTP status code 404; transport: received the unexpected content-type "text/plain; charset=utf-8"
E0708 19:30:28.849010 1 discovery.go:90] Could not get orchestrator orch=https://nyc-staging-livepeer-orchestrator-0.livepeer.monster:443: rpc error: code = Unimplemented desc = Not Found: HTTP status code 404; transport: received the unexpected content-type "text/plain; charset=utf-8"
E0708 19:30:29.126935 1 discovery.go:90] Could not get orchestrator orch=https://lon-staging-livepeer-orchestrator-0.livepeer.monster:443: rpc error: code = Unimplemented desc = Not Found: HTTP status code 404; transport: received the unexpected content-type "text/plain; charset=utf-8"
E0708 19:30:29.183320 1 discovery.go:90] Could not get orchestrator orch=https://fra-staging-livepeer-orchestrator-0.livepeer.monster:443: rpc error: code = Unimplemented desc = Not Found: HTTP status code 404; transport: received the unexpected content-type "text/plain; charset=utf-8"
I0708 19:30:29.310685 1 discovery.go:137] Done fetching orch info numOrch=8 responses=13/15 timeout=false
I0708 19:30:29.310808 1 broadcast.go:246] Ending session refresh manifestID=REDACTED dur=35.295µs
I0708 19:30:29.310873 1 broadcast.go:378] Processing segment nonce=4248943909422663 manifestID=REDACTED seqNo=5 dur=8.333 bytes=4338100
I0708 19:30:29.310896 1 census.go:993] Logging SegmentEmerged... nonce=4248943909422663 seqNo=5 duration=8.333
E0708 19:30:31.568561 1 discovery.go:90] Did not connect to orch=https://mdw-staging-livepeer-orchestrator-0.livepeer.monster:443: context deadline exceeded
E0708 19:30:31.568659 1 discovery.go:90] Did not connect to orch=https://sandbox-staging-livepeer-orchestrator-0.livepeer.monster:443: context deadline exceeded
E0708 19:30:40.797322 1 census.go:914] LostSegment nonce=4248943909422663 seqNo=5 emerged=11.486376843ss ago
I0708 19:30:54.278530 1 block_watcher.go:227] missing logs for blockNumber=8902309 - fetching on next polling interval
I0708 19:31:15.160454 1 block_watcher.go:227] missing logs for blockNumber=8902298 - fetching on next polling interval
I0708 19:31:16.242673 1 block_watcher.go:273] missing logs for blockNumber=8902299 - fetching on next polling interval
I0708 19:31:17.311610 1 block_watcher.go:273] missing logs for blockNumber=8902300 - fetching on next polling interval
I0708 19:31:18.382729 1 block_watcher.go:273] missing logs for blockNumber=8902301 - fetching on next polling interval
I0708 19:31:19.454669 1 block_watcher.go:273] missing logs for blockNumber=8902302 - fetching on next polling interval
I0708 19:31:20.532962 1 block_watcher.go:273] missing logs for blockNumber=8902303 - fetching on next polling interval
I0708 19:31:21.605302 1 block_watcher.go:273] missing logs for blockNumber=8902304 - fetching on next polling interval
I0708 19:31:22.682300 1 block_watcher.go:273] missing logs for blockNumber=8902305 - fetching on next polling interval
I0708 19:31:23.311168 1 mediaserver.go:906] watchdog reset manifestID=REDACTED seq=5 dur=8333 started=2021-07-08 19:30:28.104779269 +0000 UTC m=+1967.392174778
I0708 19:31:23.751119 1 block_watcher.go:273] missing logs for blockNumber=8902306 - fetching on next polling interval
I0708 19:31:25.892416 1 block_watcher.go:273] missing logs for blockNumber=8902308 - fetching on next polling interval
I0708 19:31:26.964740 1 block_watcher.go:273] missing logs for blockNumber=8902309 - fetching on next polling interval
I0708 19:31:28.038296 1 block_watcher.go:273] missing logs for blockNumber=8902310 - fetching on next polling interval
E0708 19:31:54.150928 1 ffmpeg.go:112] Error sending data to lpms_is_bypass_needed function err=write |1: broken pipe
I0708 19:31:54.151128 1 census.go:1014] Logging SourceSegmentAppeared... nonce=4248943909422663 manifestID=REDACTED seqNo=5 profile=source
I0708 19:31:54.151826 1 broadcast.go:521] Trying to transcode segment manifestID=REDACTED nonce=4248943909422663 seqNo=5
I0708 19:31:54.180970 1 segment_rpc.go:449] Submitting segment nonce=4248943909422663 manifestID=REDACTED sessionID=c25e2cc9 seqNo=5 bytes=4338100 orch=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443 timeout=33.332s
I0708 19:31:54.816871 1 segment_rpc.go:484] Uploaded segment nonce=4248943909422663 manifestID=REDACTED sessionID=c25e2cc9 seqNo=5 orch=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443 dur=635.837776ms
I0708 19:31:54.816943 1 census.go:1040] Logging SegmentUploaded... nonce=4248943909422663 seqNo=5 dur=635.837776ms
I0708 19:31:55.442705 1 census.go:1132] Logging SegmentTranscode nonce=4248943909422663 seqNo=5 dur=625.796207ms
I0708 19:31:55.442788 1 segment_rpc.go:565] Successfully transcoded segment nonce=4248943909422663 manifestID=REDACTED sessionID=c25e2cc9 segName= seqNo=5 orch=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443 dur=625.796207ms
I0708 19:31:55.442871 1 drivers.go:209] Downloading uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/720p0/5.ts
I0708 19:31:55.442893 1 drivers.go:209] Downloading uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/360p0/5.ts
I0708 19:31:55.442903 1 drivers.go:209] Downloading uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/240p0/5.ts
I0708 19:31:55.442996 1 drivers.go:209] Downloading uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/480p0/5.ts
I0708 19:31:55.852101 1 drivers.go:227] Downloaded uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/360p0/5.ts dur=409.153191ms
I0708 19:31:55.852179 1 census.go:1231] Logging LogTranscodedSegmentAppeared... nonce=4248943909422663 seqNo=5 profile=360p0
I0708 19:31:55.863789 1 drivers.go:227] Downloaded uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/240p0/5.ts dur=420.832536ms
I0708 19:31:55.863826 1 census.go:1231] Logging LogTranscodedSegmentAppeared... nonce=4248943909422663 seqNo=5 profile=240p0
I0708 19:31:55.919224 1 drivers.go:227] Downloaded uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/720p0/5.ts dur=476.317276ms
I0708 19:31:55.919309 1 census.go:1231] Logging LogTranscodedSegmentAppeared... nonce=4248943909422663 seqNo=5 profile=720p0
I0708 19:31:56.036147 1 drivers.go:227] Downloaded uri=https://ord-staging-livepeer-orchestrator-1.livepeer.monster:443/stream/c25e2cc9/480p0/5.ts dur=593.088856ms
I0708 19:31:56.036215 1 census.go:1231] Logging LogTranscodedSegmentAppeared... nonce=4248943909422663 seqNo=5 profile=480p0
I0708 19:31:56.036292 1 census.go:1049] Logging SegmentDownloaded... nonce=4248943909422663 seqNo=5 dur=593.461142ms
I0708 19:31:56.036362 1 broadcast.go:802] Successfully validated segment nonce=4248943909422663 seqNo=5
I0708 19:31:56.036416 1 mediaserver.go:953] Finished transcoding push request at url=http://lax.livepeer.monster/live/REDACTED/5.ts manifestID=REDACTED seqNo=5 took=1m27.931612156s
I0708 19:31:56.679800 1 mediaserver.go:872] Finished push request at url=http://lax.livepeer.monster/live/REDACTED/5.ts ua=curl/7.64.1 addr=10.42.2.11:57448 len=4338100 dur=8333 resolution= took=1m28.575001194s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment