Skip to content

Instantly share code, notes, and snippets.

View badmetacoder's full-sized avatar

Jacek Artymiak badmetacoder

View GitHub Profile
@badmetacoder
badmetacoder / curl-connector-splunkstorm.sh
Last active December 5, 2016 20:15
curl-connector-splunkstorm
curl -X POST 'https://api.datasift.com/v1/push/create' \
-d 'name=connectorsplunkstorm' \
-d 'hash=42d388f8b1db997faaf7dab487f11290' \
-d 'output_type=splunkstorm' \
-d 'output_params.host=splunkstorm.example.com' \
-d 'output_params.port=20036' \
-H 'Authorization: datasift-user:your-datasift-api-key'
@badmetacoder
badmetacoder / connector-http.sh
Last active December 5, 2016 20:15
connector-http
curl -X POST 'https://api.datasift.com/v1/push/create' \
-d 'name=connectorhttp' \
-d 'hash=42d388f8b1db997faaf7dab487f11290' \
-d 'output_type=http' \
-d 'output_params.method=post' \
-d 'output_params.url=http.example.com:8888' \
-d 'output_params.use_gzip' \
-d 'output_params.delivery_frequency=60' \
-d 'output_params.max_size=10485760' \
-d 'output_params.verify_ssl=false' \
@badmetacoder
badmetacoder / curl-connector-mongodb.sh
Last active December 5, 2016 20:15
curl-connector-mongodb
curl -X POST 'https://api.datasift.com/push/create' \
-d 'name=connectormongodb' \
-d 'hash=42d388f8b1db997faaf7dab487f11290' \
-d 'output_type=mongodb' \
-d 'output_params.host=mongodb.example.com' \
-d 'output_params.port=27017' \
-d 'output_params.db_name=datasiftmongodb' \
-d 'output_params.auth.username=dsreceiver' \
-d 'output_params.auth.password=dsrpassword' \
-H 'Authorization: datasift-user:your-datasift-api-key'
@badmetacoder
badmetacoder / curl-connector-s3.sh
Last active December 10, 2018 04:55
curl-connector-s3
curl -X POST 'https://api.datasift.com/push/create' \
-d 'name=connectors3' \
-d 'hash=SourceStreamHash' \
-d 'output_type=s3' \
-d 'output_params.bucket=datasift-s3' \
-d 'output_params.directory=interactions' \
-d 'output_params.acl=private' \
-d 'output_params.auth.access_key=YourAmazonAWSAccessKey' \
-d 'output_params.auth.secret_key=YourAmazonAWSSecretKey' \
-d 'output_params.delivery_frequency=60' \
@badmetacoder
badmetacoder / connector-google-bigquery.sh
Last active December 5, 2016 20:15
connector-google-bigquery
curl -X POST 'https://api.datasift.com/v1/push/create' \
-d 'name=connectorgooglebigquery' \
-d 'hash=42d388f8b1db497faaf7dab487f11290' \
-d 'output_type=bigquery' \
-d 'output_params.project_id=000000000000' \
-d 'output_params.dataset_id=interactions' \
-d 'output_params.table_id=pushedinteractions' \
-d 'output_params.auth.client_id=000000000000.apps.googleusercontent.com' \
-d 'output_params.auth.service_account=000000000000@developer.gserviceaccount.com' \
-d "output_params.auth.key_file=`python ./p12tobigquery.py -f 3a46aede3a0a2d375b7bdb72743e7da7605fef5c-privatekey.p12`"
curl -X POST 'https://api.datasift.com/v1/push/create' \
-d 'name=connectorcouchdb' \
-d 'hash=42d388f8b1db997faaf7dab487f11290' \
-d 'output_type=couchdb' \
-d 'output_params.host=couchdb.example.com' \
-d 'output_params.port=5984' \
-d 'output_params.use_ssl=no' \
-d 'output_params.verify_ssl=no' \
-d 'output_params.db_name=datasift_couchdb' \
-d 'output_params.auth.username=dsreceiver' \
<div id="jcsdl"></div>
<textarea id="jcsdl-code" style="width: 900px; height: 200px;" disabled="true">// JCSDL_MASTER b04591342ee71a2baa468d9d2a340ec8 AND
// JCSDL_VERSION 1.0
// JCSDL_START 0980a5f2ef935c4ed153bf975879eac0 twitter.text,contains_any,27-52
twitter.text contains_any "obama, santorum, gingrich, romney, ronpaul, ron paul"
// JCSDL_END
AND
// JCSDL_START f7c18a6fedd90c6b4d77acc14a3a8e5c interaction.type,in,21-29
<script type="text/javascript">
$(function() {
JCSDL.onLoad(function() {
$('#jcsdl-edit').jcsdlGui({
...
animate : 2000,
hideTargets : ['interaction', 'facebook', 'myspace', '2channel', 'video', 'youtube', 'reddit', 'imdb', 'flickr', 'amazon', 'blog', 'board', 'dailymotion', 'newscred', 'topix', 'augmentation',
'twitter.domains', 'twitter.in_reply_to_screen_name', 'twitter.links', 'twitter.mentions', 'twitter.source', 'twitter.text', 'twitter.place', 'twitter.retweet', 'twitter.retweeted',
'twitter.user.description', 'twitter.user.followers_count', 'twitter.user.follower_ratio', 'twitter.user.friends_count', 'twitter.user.id', 'twitter.user.listed_count', 'twitter.user.location', 'twitter.user.name', 'twitter.user.screen_name', 'twitter.user.statuses_count', 'twitter.user.time_zone', 'twitter.user.url'],
<head>
...
<script type="text/javascript">
$(function() {
JCSDL.onLoad(function() {
$('#jcsdl-edit').jcsdlGui({
...
hideTargets : ['interaction', 'twitter', 'facebook', '2channel', 'myspace', 'amazon', 'blog', 'board', 'dailymotion', 'flickr', 'newscred', 'reddit', 'topix', 'video', 'youtube', 'augmentation', 'imdb.author', 'imdb.type', 'imdb.contenttype', 'imdb.thread', 'bitly', 'wikipedia']
});
...
curl -X POST 'https://api.datasift.com/v1/push/create' \
-d 'name=connectorredis' \
-d 'hash=abd30c0341ad030bb739be9fb4fde6f4' \
-d 'output_type=redis' \
-d 'output_params.host=redis.example.com' \
-d 'output_params.port=6379' \
-d 'output_params.database=1' \
-d 'output_params.list=DataSift' \
-d 'output_params.format=json_interaction' \
-d 'output_params.auth.password=YourRedisServerPassword' \