Reference: snowplow/snowplow#113
Idea from: https://github.com/kingo55
See also:
fd9f13d4-e7f9-46b1-9f03-b39121de1aa2 2013-10-15 21:12:35.261 30 budweiser 17 10 300 250 f 0 0 0 f f f f f f f f http://delivery.sblk.io/tests... https://www.google.com/search?q=business news https://www.google.com/search?q=business news f https www.google.com /search q=business news 0 f f t t 32 80 t t t t t t t t Mozilla/5.0 (unknown-x86_64-linux-gnu) Siege/3.0.4 172.31.25.17 f f 1366 376 | |
46e2cd90-392c-4da0-88e1-5f916d68a109 2013-10-15 21:17:07.635 30 budweiser 17 10 300 250 f 0 0 0 f f f f f f f f http://delivery.sblk.io/tests... | |
https://www.google.com/search?q=business news https://www.google.com/search?q=business news f https www.google.com /search q=business news 0 f f t t 32 80 t t t t t t t t Mozilla/5.0 (unknown-x86_64-linux-gnu) Siege/3.0.4 172.31.25.17 f f 1366 376 | |
949e886d-352c-452f-a92d-762931d23f65 2013-10-15 21:17:07.649 30 budweiser 17 10 300 250 f 0 0 0 f f f f f f f f http://delivery.sb |
# status = execute_queries(target, [ "VACUUM FULL ANALYZE #{target[:table]};" ] ) | |
# unless status == [] | |
# raise DatabaseLoadError, "#{status[1]} error executing #{status[0]}: #{status[2]}" | |
# end |
-- Quick workaround script because Redshift view definitions are tied to | |
-- table IDs, not table names. Means if a table is swapped out for a new | |
-- one, the views will all point to the old table. | |
-- To use this: | |
-- 1. Change your viewowner to whoever created your views | |
-- 2. Change your table names (if necessary) | |
-- 3. Run the script against your database | |
-- 4. Paste the output into your SQL client and execute |
#!/usr/bin/env ruby | |
# == Simple Daemon | |
# | |
# A simple ruby daemon that you copy and change as needed. | |
# | |
# === How does it work? | |
# | |
# All this program does is fork the current process (creates a copy of | |
# itself) then exits, the fork (child process) then goes on to run your | |
# daemon code. In this example we are just running a while loop with a |
<snip> | |
[info] IdentityTest | |
[info] | |
[info] + The identity function should work for any pair of Strings | |
[info] | |
[info] Total for specification IdentityTest | |
[info] Finished in 0 ms | |
[info] 1 example, 100 expectations, 0 failure, 0 error | |
[info] | |
13/03/26 11:37:19 INFO flow.Flow: [com.snowplowanalytics....] starting |
╭─alex@nasqueron ~/Development/SnowPlow/snowplow/3-etl/hadoop-etl ‹feature/scalding-etl› | |
╰─$ sbt | |
Detected sbt version 0.12.1 | |
Starting sbt: invoke with -help for other options | |
[info] Loading global plugins from /home/alex/.sbt/plugins | |
[info] Loading project definition from /home/alex/Development/SnowPlow/snowplow/3-etl/hadoop-etl/project | |
[info] Set current project to snowplow-hadoop-etl (in build file:/home/alex/Development/SnowPlow/snowplow/3-etl/hadoop-etl/) | |
snowplow-hadoop-etl > test-only com.snowplowanalytics.snowplow.hadoop.etl.jobs.CorruptedCfLinesTest | |
13/02/27 08:40:20 INFO property.AppProps: using app.id: 83265FFB1D12AEF2BE02B7B711912163 | |
13/02/27 08:40:20 INFO util.Version: Concurrent, Inc - Cascading 2.0.7 |
// Alias. Worth keeping in because it's so verbose. | |
var encodeWrapper = window.encodeURIComponent; | |
// IMPORTANT!! | |
// ------------------------------------------ | |
// This is how simple it is to build the final URL: | |
image.src = configCollectorUrl + '?' + request; | |
// See below for how each piece (configCollectorUrl and request) are built... | |
/** |
var encodeWrapper: windowAlias.encodeURIComponent; | |
/** | |
* A helper to build a SnowPlow request string from an | |
* an optional initial value plus a set of individual | |
* key-value pairs, provided using the add method. | |
* | |
* @param string initialValue The initial querystring, ready to have additional key-value pairs added | |
* | |
* @return object The request string builder, with add and build methods |
/* | |
* Copyright (c) 2012 SnowPlow Analytics Ltd. All rights reserved. | |
* | |
* This program is licensed to you under the Apache License Version 2.0, | |
* and you may not use this file except in compliance with the Apache License Version 2.0. | |
* You may obtain a copy of the Apache License Version 2.0 at http://www.apache.org/licenses/LICENSE-2.0. | |
* | |
* Unless required by applicable law or agreed to in writing, | |
* software distributed under the Apache License Version 2.0 is distributed on an | |
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
Reference: snowplow/snowplow#113
Idea from: https://github.com/kingo55
See also: