Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save itochu0523/f6f958b162afef664b82 to your computer and use it in GitHub Desktop.
Save itochu0523/f6f958b162afef664b82 to your computer and use it in GitHub Desktop.
in:
type: s3
bucket: td-test-data
path_prefix: test/example.log
access_key_id: TTTTTTTTTTTTTTTTTT
secret_access_key: XXXXXXXXXXXXXXXXXXXXXXXXXXXX
parser:
type: fluent-s3-log
columns:
- {name: uid, type: string}
- {name: os, type: string}
- {name: conversion, type: string}
- {name: price_ssp, type: string}
- {name: id, type: string}
- {name: win, type: string}
- {name: display_size_id, type: string}
- {name: price, type: string}
- {name: group_id, type: string}
- {name: device_type, type: string}
- {name: click, type: string}
- {name: ser_id, type: string}
- {name: p_id, type: string}
- {name: req_id, type: string}
- {name: price, type: string}
- {name: qp_id, type: string}
- {name: url, type: string}
- {name: gn_id, type: string}
- {name: os_type, type: string}
- {name: site_id, type: string}
- {name: sender, type: string}
out: {type: td, apikey: XXXXXXXXXXXXX, endpoint: api.treasuredata.com,
database: embulk, table: test, time_column: time}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment