Ewere Diagboya nimboya
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "cloudwatch.emitMetrics": true, | |
| "firehose.endpoint": "firehose.eu-west-1.amazonaws.com", | |
| "flows": [ | |
| { | |
| "filePattern": "/media/dump.log*", | |
| "deliveryStream": "sales", | |
| "initialPosition" : "START_OF_FILE" | |
| } | |
| ] |
nimboya
/ lambdakinesis.py
Last active
August 31, 2018 18:32
Transform Records from Kinesis using Lambda Function for JSON data
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import math | |
| print('Loading function') | |
| def lambda_handler(event, context): | |
| output = [] | |
| for record in event['records']: | |
| payload = base64.b64decode(record['data']) | |
| entry = json.loads(payload) | |
| result = { |
nimboya
/ logstash-awses.conf
Created
September 25, 2018 13:01
Logstash Writing to AWS ElasticSearch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| input { | |
| file{ | |
| path=>["/media/data/output.json"] | |
| codec=>"json" | |
| type=>"log" | |
| start_position=>"beginning" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| input { | |
| file{ | |
| path=>["/media/access*"] | |
| start_position=>"beginning" | |
| } | |
| } | |
| filter { | |
| grok { | |
| match => { "message" => ["%{IPORHOST:[remote_ip]} - %{DATA:[user_name]} \[%{HTTPDATE:[time]}\] \"%{WORD:[method]} %{DATA:[url]} HTTP/%{NUMBER:[http_version]}\" %{NUMBER:[response_code]} %{NUMBER:[body_sent_bytes]} \"%{DATA:[referrer]}\" \"%{DATA:[agent]}\""] } | |
| remove_field => "message" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "stages": { | |
| "dev": { | |
| "api_gateway_stage": "api", | |
| "environment_variables": { "APP_TABLE_NAME": "itsshort" } | |
| } | |
| }, | |
| "version": "2.0", | |
| "app_name": "itsshort" | |
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| service: kannel_sms_sender | |
| app: kannel_sms_sender_service | |
| provider: | |
| name: aws | |
| runtime: nodejs8.10 | |
| environment: ${file(env.yml):${self:provider.stage}} | |
| region: eu-west-1 | |
| functions: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env groovy | |
| import java.util.Date | |
| import groovy.json.JsonOutput | |
| import groovy.json.JsonSlurper | |
| def displayName = env.JOB_NAME | |
| def bucketName = env.JOB_NAME | |
| def isMaster = env.BRANCH_NAME == "master" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import boto3 | |
| ddb = boto3.client('dynamodb', endpoint_url='http://localhost:8000/') | |
| response = ddb.list_tables() | |
| print(response) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 20.5.1.167 10.71.83.44 : PSK "phlTXL0BKXcBn6WgEX_p6wsi1_d5W1FE" | |
| 20.5.1.167 41.190.1.25 : PSK "phlTXL0BKXcBn6WgEX_p6wsi1_d5W1FE" | |
| 34.251.232.201 41.190.1.25 : PSK "phlTXL0BKXcBn6WgEX_p6wsi1_d5W1FE" | |
| 34.251.232.201 10.71.83.44 : PSK "phlTXL0BKXcBn6WgEX_p6wsi1_d5W1FE" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "ipcMode": null, | |
| "executionRoleArn": "arn:aws:iam::123456789876:role/ecsTaskExecutionRole", | |
| "containerDefinitions": [ | |
| { | |
| "dnsSearchDomains": null, | |
| "logConfiguration": { | |
| "logDriver": "awslogs", | |
| "secretOptions": null, | |
| "options": { |