Skip to content

Instantly share code, notes, and snippets.

@mooyoul
Last active February 17, 2017 20:27
Show Gist options
  • Save mooyoul/0296599f7a25683251ae68eec2ee1444 to your computer and use it in GitHub Desktop.
Save mooyoul/0296599f7a25683251ae68eec2ee1444 to your computer and use it in GitHub Desktop.
Fetch file from url and store to s3
'use strict';
const request = require('request');
const AWS = require('aws-sdk');
const s3 = new AWS.S3({apiVersion: '2006-03-01', region: 'ap-northeast-2'});
// fetch binary from `url` and upload to s3 using `key` as object key
const store = (url, key) => {
return new Promise((resolve, reject) => {
request({
method: 'GET',
url: url,
encoding: null // returns body as Buffer
}).on('error', (e) => {
// something went wrong during fetch avatar.
return reject(e);
}).on('response', (res) => {
if (res.statusCode.toString().slice(0, 1) !== '2') { // server respond with unexpected status code
return reject(new Error(`Unexpected status code ${res.statusCode}`));
}
s3.upload({
Bucket: process.env.S3_BUCKET,
Key: key,
ContentType: res.headers['content-type'] || 'application/octet-stream',
Body: res // note that `res` is Readable Stream, not Buffer.
}, (e, data) => {
if (e) { return reject(e); }
resolve(data);
});
});
});
};
module.exports = exports = store;
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment