John Hammink Jammink2
Jammink2
/ gist:172b5ffa320ee4a050e22b4ab92f2b9a
Last active
April 12, 2016 23:18
Guess the format of the incoming Salesforce data:
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| td connector:guess accounts.yml -o account_output.yml |
Jammink2
/ gist:9c7a33acb19510360bb0873c63b9e1ed
Last active
April 12, 2016 23:19
Load your (SF) data into Treasure Data
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| td connector:issue account_output.yml --database sfdc --table account --time-column createddate |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| select billingcity, description from account limit 100 |
Jammink2
/ gist:a2b789503f332d0495f3a754d202eb21
Last active
April 12, 2016 23:16
Count Number of Records Elasticsearch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| curl --ipv4 -XGET <external_IP_Address_for Elasticsearch_EC2_instance>:9200/_count |
Jammink2
/ gist:c091c6584bf399e89d8b03eddc132726
Created
April 8, 2016 22:29
Query all your records Elasticsearch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| curl --ipv4 -XGET <external_EC2_IP>:9200/_search -d '{ | |
| "query": { | |
| "match_all": {} | |
| } | |
| } | |
| ' |
Jammink2
/ gist:895029536e2f6fe9eb652542ba6d5d9d
Created
April 8, 2016 22:31
Query within a single index Elasticsearch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| curl -X GET 'http://<external_EC2_IP>:9200/descriptions_by_city' |
Jammink2
/ Create DB and Table (generic)
Last active
April 15, 2016 22:55
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| td db:create <database_name> | |
| td table:create <database_name> <table_name> |
Jammink2
/ webhook post
Last active
April 18, 2016 22:37
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| URL: http://in.treasuredata.com/postback/v3/event/<database_name>/<table_name> | |
| Payload Type: Json | |
| Wrap Request in Array: No | |
| Unflatten: yes | |
| Headers: | |
| Content-Type: application/json | |
| X-TD-Write-Key: <your_Treasure_Data_Write_API_Key> |
Jammink2
/ query_googledocs
Created
April 18, 2016 20:22
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| td query -d googledocs "select gsx_userid, gsx_lastname, gsx_streetname, gsx_city, gsx_zip from sheet" |
Jammink2
/ check_query_results_by_job_ID
Created
April 18, 2016 20:40
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| td job:show <JOB_ID_NUMBER> |