Reference: snowplow/snowplow#113
Idea from: https://github.com/kingo55
See also:
| fd9f13d4-e7f9-46b1-9f03-b39121de1aa2 2013-10-15 21:12:35.261 30 budweiser 17 10 300 250 f 0 0 0 f f f f f f f f http://delivery.sblk.io/tests... https://www.google.com/search?q=business news https://www.google.com/search?q=business news f https www.google.com /search q=business news 0 f f t t 32 80 t t t t t t t t Mozilla/5.0 (unknown-x86_64-linux-gnu) Siege/3.0.4 172.31.25.17 f f 1366 376 | |
| 46e2cd90-392c-4da0-88e1-5f916d68a109 2013-10-15 21:17:07.635 30 budweiser 17 10 300 250 f 0 0 0 f f f f f f f f http://delivery.sblk.io/tests... | |
| https://www.google.com/search?q=business news https://www.google.com/search?q=business news f https www.google.com /search q=business news 0 f f t t 32 80 t t t t t t t t Mozilla/5.0 (unknown-x86_64-linux-gnu) Siege/3.0.4 172.31.25.17 f f 1366 376 | |
| 949e886d-352c-452f-a92d-762931d23f65 2013-10-15 21:17:07.649 30 budweiser 17 10 300 250 f 0 0 0 f f f f f f f f http://delivery.sb |
| # status = execute_queries(target, [ "VACUUM FULL ANALYZE #{target[:table]};" ] ) | |
| # unless status == [] | |
| # raise DatabaseLoadError, "#{status[1]} error executing #{status[0]}: #{status[2]}" | |
| # end |
| -- Quick workaround script because Redshift view definitions are tied to | |
| -- table IDs, not table names. Means if a table is swapped out for a new | |
| -- one, the views will all point to the old table. | |
| -- To use this: | |
| -- 1. Change your viewowner to whoever created your views | |
| -- 2. Change your table names (if necessary) | |
| -- 3. Run the script against your database | |
| -- 4. Paste the output into your SQL client and execute |
| #!/usr/bin/env ruby | |
| # == Simple Daemon | |
| # | |
| # A simple ruby daemon that you copy and change as needed. | |
| # | |
| # === How does it work? | |
| # | |
| # All this program does is fork the current process (creates a copy of | |
| # itself) then exits, the fork (child process) then goes on to run your | |
| # daemon code. In this example we are just running a while loop with a |
| <snip> | |
| [info] IdentityTest | |
| [info] | |
| [info] + The identity function should work for any pair of Strings | |
| [info] | |
| [info] Total for specification IdentityTest | |
| [info] Finished in 0 ms | |
| [info] 1 example, 100 expectations, 0 failure, 0 error | |
| [info] | |
| 13/03/26 11:37:19 INFO flow.Flow: [com.snowplowanalytics....] starting |
| ╭─alex@nasqueron ~/Development/SnowPlow/snowplow/3-etl/hadoop-etl ‹feature/scalding-etl› | |
| ╰─$ sbt | |
| Detected sbt version 0.12.1 | |
| Starting sbt: invoke with -help for other options | |
| [info] Loading global plugins from /home/alex/.sbt/plugins | |
| [info] Loading project definition from /home/alex/Development/SnowPlow/snowplow/3-etl/hadoop-etl/project | |
| [info] Set current project to snowplow-hadoop-etl (in build file:/home/alex/Development/SnowPlow/snowplow/3-etl/hadoop-etl/) | |
| snowplow-hadoop-etl > test-only com.snowplowanalytics.snowplow.hadoop.etl.jobs.CorruptedCfLinesTest | |
| 13/02/27 08:40:20 INFO property.AppProps: using app.id: 83265FFB1D12AEF2BE02B7B711912163 | |
| 13/02/27 08:40:20 INFO util.Version: Concurrent, Inc - Cascading 2.0.7 |
| // Alias. Worth keeping in because it's so verbose. | |
| var encodeWrapper = window.encodeURIComponent; | |
| // IMPORTANT!! | |
| // ------------------------------------------ | |
| // This is how simple it is to build the final URL: | |
| image.src = configCollectorUrl + '?' + request; | |
| // See below for how each piece (configCollectorUrl and request) are built... | |
| /** |
| var encodeWrapper: windowAlias.encodeURIComponent; | |
| /** | |
| * A helper to build a SnowPlow request string from an | |
| * an optional initial value plus a set of individual | |
| * key-value pairs, provided using the add method. | |
| * | |
| * @param string initialValue The initial querystring, ready to have additional key-value pairs added | |
| * | |
| * @return object The request string builder, with add and build methods |
| /* | |
| * Copyright (c) 2012 SnowPlow Analytics Ltd. All rights reserved. | |
| * | |
| * This program is licensed to you under the Apache License Version 2.0, | |
| * and you may not use this file except in compliance with the Apache License Version 2.0. | |
| * You may obtain a copy of the Apache License Version 2.0 at http://www.apache.org/licenses/LICENSE-2.0. | |
| * | |
| * Unless required by applicable law or agreed to in writing, | |
| * software distributed under the Apache License Version 2.0 is distributed on an | |
| * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
Reference: snowplow/snowplow#113
Idea from: https://github.com/kingo55
See also: