Damon P. Cortesi dacort

Keybase proof

I hereby claim:

I am dacort on github.
I am dacort (https://keybase.io/dacort) on keybase.
I have a public key whose fingerprint is 0931 E57B 9A91 8338 5B93 201B F594 2FCD 9F8D 1C6D

To claim this, I am signing this object:

Athena CTAS Update

An approach for updating partitions in an existing table using CTAS queries.

Overview

With the release of CTAS functionality for Athena, you're now able to create derivative tables in Athena with different data formats or S3 locations.

Sometimes, though, you want to be able to add data to a partition of an existing table. As long as that partition doesn't already exist, you can do this with Athena by using CTAS with a temporary table.

	client = Grackle::Client.new(:auth => {
	:type => :oauth,
	:consumer_key => CONSUMER_KEY, :consumer_secret => CONSUMER_SECRET,
	:token => TOKEN, :token_secret => TOKEN_SECRET
	})

	users = []
	(client.friends.ids?).each_slice(100) do \|uids\|
	users \|= (client.users.lookup? :user_id => uids.join(','))
	end

	package main

	import (
	"encoding/json"
	"fmt"
	)

	var jsonStr = []byte(`
	{
	"things": [

	package main

	import (
	"code.google.com/p/go.crypto/pbkdf2"
	"crypto/aes"
	"crypto/cipher"
	"crypto/sha1"
	"database/sql"
	"fmt"
	"log"

	#!/bin/sh
	#
	#
	# Poor man's version. Good 'ol bash and shell commands.

	# Initialize stat counters
	COPIES=0
	FROM_APPS=()
	TO_APPS=()

	import sys
	import boto3
	from slacker import Slacker
	import ConfigParser

	import csv
	from datetime import datetime

	reload(sys)
	sys.setdefaultencoding('utf8')

	Twas the night before #BSidesSF, when all through the tubes
	Not a hacker was stirring, not even the newbs;

	FROM 895885662937.dkr.ecr.us-west-2.amazonaws.com/spark/emr-6.3.0:latest

	### Switch to root for installation
	USER root

	### setup for conda
	RUN yum install -y wget

	### Install Conda into shared location
	RUN wget https://repo.anaconda.com/miniconda/Miniconda3-py39_4.10.3-Linux-x86_64.sh \