Skip to content

Instantly share code, notes, and snippets.

View ps0uth's full-sized avatar
🚀
I will be slow to respond.

Philip S ps0uth

🚀
I will be slow to respond.
View GitHub Profile
@snaury
snaury / broker.go
Created May 16, 2012 21:28
Non-blocking fan-out broker in go
package main
import (
"fmt"
"time"
)
type Message struct {
Timestamp time.Time
Client *Client
@chrishamant
chrishamant / s3_multipart_upload.py
Created January 3, 2012 19:29
Example of Parallelized Multipart upload using boto
#!/usr/bin/env python
"""Split large file into multiple pieces for upload to S3.
S3 only supports 5Gb files for uploading directly, so for larger CloudBioLinux
box images we need to use boto's multipart file support.
This parallelizes the task over available cores using multiprocessing.
Usage:
s3_multipart_upload.py <file_to_transfer> <bucket_name> [<s3_key_name>]