thing.md

Sparrow Intro

In this session we went over an intro to Sparrow, other tools the data tech team are working on, and how they can be useful to Autopilot and Aviator.

materials

presentation slides

Sparrow documentation

• Sparrow wiki
• Sparrow event structure

Sample code

• autopilot-vendor-interfaces sparrow code
• brand-level code calling autopilot-vendor-interfaces code
• sparrow-node code
• brand-level code calling sparrow-node code

Presto

• presto how-to

Druid

• Druid docs

• Druid query production endpoint: http://data.conde.io/analytics

• Druid query CI endpoint: http://ci-druid-broker.conde.io:8082/druid/v2/?pretty

• Required header: Content-Type: application/json

• Sample query request body JSON:

  {
    "queryType": "topN",
    "dataSource": "sparrow-firehose-web",
    "dimension": "_t",
    "threshold": 10,
    "metric": "count",
    "granularity": "all",
    "filter": {
        "type": "and",
        "fields": [
            {"type": "selector", "dimension": "_t", "value": "app-mounted" },
            {"type": "selector", "dimension": "_o", "value": "architectural-digest"}
         ]
    },
    "aggregations": [
      {
        "type": "longSum",
        "name": "count",
        "fieldName": "count"
      }
    ],
    "intervals": [
      "2016-05-05T00:00:00.000/2016-05-06T00:00:00.000"
    ]
  }