Skip to content

Instantly share code, notes, and snippets.

View goz's full-sized avatar
🐌
I may be slow to respond.

goz goz

🐌
I may be slow to respond.
135 followers · 73 following
View GitHub Profile
@goz
goz / mysql_to_big_query.sh
Created March 14, 2018 08:35 — forked from shantanuo/mysql_to_big_query.sh
Copy MySQL table to big query. If you need to copy all tables, use the loop given at the end. Exit with error code 3 if blob or text columns are found. The csv files are first copied to google cloud before being imported to big query.
#!/bin/sh
TABLE_SCHEMA=$1
TABLE_NAME=$2
mytime=`date '+%y%m%d%H%M'`
hostname=`hostname | tr 'A-Z' 'a-z'`
file_prefix="trimax$TABLE_NAME$mytime$TABLE_SCHEMA"
bucket_name=$file_prefix
splitat="4000000000"
bulkfiles=200
@goz
goz / docker_parallel_rake_test_advanced.rb
Created December 4, 2013 12:42 — forked from palexander/docker_parallel_rake_test_advanced.rb
namespace :docker do
desc "Run tasks in parallel using docker"
task :test do
forks = 4
begin
# Start docker containers (serially, docker seems to have problems with concurrency)
ports = {}
forks.times do |i|
# Start redis and get the mapped port
`docker run -d -p 6379 -name redis#{i} yourdockeruser/redis`
@goz
goz / express.js
Created July 27, 2013 17:28 — forked from azat-co/express.js
var express = require('express')
, mongoskin = require('mongoskin')
var app = express()
app.use(express.bodyParser())
var db = mongoskin.db('localhost:27017/test', {safe:true});
app.param('collectionName', function(req, res, next, collectionName){
req.collection = db.collection(collectionName)