Skip to content

Instantly share code, notes, and snippets.

# Sample Line
2018-01-04T19:40:03.524Z 47bca216-f17d-11e7-b2cc-9d951c38274e Executing (default): SELECT count(*) AS `count` FROM `stream_target` AS `stream_target` WHERE `stream_target`.`stream_id` IS NULL AND `stream_target`.`hls_playback_url` LIKE '%/event/%'; { logging: [Function: prettyConsoleLog], plain: true, raw: true, showWarnings: false, where: '`stream_target`.`stream_id` IS NULL AND `stream_target`.`hls_playback_url` LIKE \'%/event/%\'', hooks: true, dataType: INTEGER { options: { length: undefined }, _length: undefined, _zerofill: undefined, _decimals: undefined, _precision: undefined, _scale: undefined, _unsigned: undefined }, includeIgnoreAttributes: false, limit: null, offset: null, order: null, attributes: [ [ [Object], 'count' ] ], type: 'SELECT' }
# Rule
testGreedy %{_greedy_to_json:garbage}
# Helper
_greedy_to_json %{regex(".*(?=\\{ logging\\: )")}
# cat /etc/datadog-agent/conf.d/php_fpm.d/conf.yaml
init_config:
instances:
- status_url: http://localhost/status
ping_url: http://localhost/ping
ping_reply: pong
########################################
@mago0
mago0 / policy.json
Last active December 1, 2017 18:30
{
"Version": "2008-10-17",
"Id": "Policy1425281770533",
"Statement": [
{
"Sid": "Stmt1425281765688",
"Effect": "Allow",
"Principal": {
"AWS": "arn:aws:iam::107630771604:user/s3-copy"
},
==> dogstatsd.log <==
2017-09-11 18:34:42 UTC | DEBUG | dd.dogstatsd | dogstatsd(dogstatsd.py:319) | Payload accepted
2017-09-11 18:34:42 UTC | DEBUG | dd.dogstatsd | dogstatsd(dogstatsd.py:323) | 200 POST http://localhost:17123/api/v1/series?api_key=a27dca29a8eda91a66e4a58b3b251e7c (5.986ms)
2017-09-11 18:34:42 UTC | DEBUG | dd.dogstatsd | aggregator(aggregator.py:703) | Received 0 events since last flush
2017-09-11 18:34:42 UTC | DEBUG | dd.dogstatsd | aggregator(aggregator.py:714) | Received 0 service check runs since last flush
2017-09-11 18:34:42 UTC | DEBUG | dd.dogstatsd | dogstatsd(dogstatsd.py:261) | Flush #15: flushed 9 metrics, 0 events, and 0 service check runs
2017-09-11 18:34:42 UTC | DEBUG | dd.dogstatsd | checks.check_status(check_status.py:162) | Persisting status to /opt/datadog-agent/run/DogstatsdStatus.pickle
2017-09-11 18:34:42 UTC | DEBUG | dd.dogstatsd | utils.watchdog(watchdog.py:136) | Resetting watchdog for 120
==> forwarder.log <==
variable "asg_tags" {
type = "map"
default = {
project = "ReplaceMe"
env = "ReplaceMe"
envid = "ReplaceMe"
datadog = ""
}
}
'matt.williams':
uid: 546
groups:
- wheel
ssh_public_keys:
main:
type: 'ssh-rsa'
key: 'AAAAB3NzaC1yc2EAAAADAQABAAABAQC+oebBdFiGA+bAfSsy4CypRsyqB7gTHuCMIH9adpIl8Nqg/bDnl957PR0GeYiJOTJ3dTNniPOOdNHLw0XO3htkIid1x4xdBp3do43e7uiJ8hRcr8XQEK7dytUKfHVmKwX68AweT869qQJ+WwgVFFe3rZywq1HnMkl2O90RDRpjgoOfgOdToGYEK6qL4LsUD9Psd0GXL6Qfic1sokHXD9tgCKVSzj3QaYvJ74vKxIbE0uOgRpaZUJAxewcxjtc9V3ViabpsuadXgEOl9ctOK3siCSfSjioeo2ZAka5cNtsLtJaP/dDU+yDyJ5kxua8bxQgIRzPm6FC5KFEULeubQwg7'
We can make this file beautiful and searchable if this error is corrected: Unclosed quoted field in line 3.
timeStamp,elapsed,label,responseCode,responseMessage,threadName,success,failureMessage,bytes,grpThreads,allThreads,URL,Latency,IdleTime,Connect,ulp_buffer_fill,ulp_lag_time,ulp_play_time,ulp_lag_ratio,ulp_dwn_time
1496849944881,12889,: Stream HLS Segment,200,"Max play time 8 seconds reached, ,Downloaded fileName=chunklist_w1761974121_b2096000.m3u8, bytes=5441189 bytes, videoDurationSeconds=36.337 s, timeToPlay (including lags)=8000 ms, playedTimeSeconds (video duration played)=8.0 s, downloadTime=12399 ms, connectTime=216 ms, lagTime=4884 ms, bufferFillTime=4884 ms, lagRatio=61.05 %, No play pauses",| 73.137.203.30 1-2,true,“”,5441189,10,10,http://NA-US-SE60.secdn.net/flocasts-em1/play/gpp2692_mat_1.smil/playlist.m3u8,533,0,0,4884,4884,8000,61.05,12399
1496849957771,13064,: Stream HLS Segment,200,"Max play time 8 seconds reached, ,Downloaded fileName=chunklist_w576094394_b2096000.m3u8, bytes=4921358 bytes, videoDurationSeconds=36.7 s, timeToPlay (including lags)=8000 ms, playedTimeSeconds (video duration play
Process: Flocaster [32067]
Path: /Applications/Flocaster 4.2.3.app/Contents/MacOS/Flocaster
Identifier: com.flocasts.Flocaster
Version: 4.2.3 (1)
Code Type: X86-64 (Native)
Parent Process: ??? [1]
Responsible: Flocaster [32067]
User ID: 501
Date/Time: 2017-06-06 15:17:34.157 -0400
Process: Flocaster [16115]
Path: /Applications/Flocaster 4.2.3.app/Contents/MacOS/Flocaster
Identifier: com.flocasts.Flocaster
Version: 4.2.3 (1)
Code Type: X86-64 (Native)
Parent Process: ??? [1]
Responsible: Flocaster [16115]
User ID: 501
Date/Time: 2017-06-05 15:56:40.636 -0400
./eval_stream.sh 'http://flocasts-hls.videocdn.scaleengine.net/flocasts-em3/play/elf1064s_sre_test_test.smil/playlist.m3u8?REDACTED'
Stream Info:
ffprobe version 3.3 Copyright (c) 2007-2017 the FFmpeg developers
built with Apple LLVM version 8.1.0 (clang-802.0.42)
configuration: --prefix=/usr/local/Cellar/ffmpeg/3.3 --enable-shared --enable-pthreads --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-ffplay --enable-libmp3lame --enable-libx264 --enable-libxvid --enable-opencl --disable-lzma --enable-vda
libavutil 55. 58.100 / 55. 58.100
libavcodec 57. 89.100 / 57. 89.100
libavformat 57. 71.100 / 57. 71.100
libavdevice 57. 6.100 / 57. 6.100
libavfilter 6. 82.100 / 6. 82.100