Last active
          April 4, 2019 16:27 
        
      - 
      
- 
        Save michaelahlers/bb285de5dd3983b847bebe194b096df5 to your computer and use it in GitHub Desktop. 
    Bulk restore-request of objects in S3.
  
        
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
  | #!/bin/bash | |
| BUCKET_NAME="my-bucket" | |
| KEY_PREFIX="my-key-prefix" | |
| DAYS = "10" | |
| aws s3 ls --recursive "s3://$BUCKET_NAME/$KEY_PREFIX" |\ | |
| awk '{$1=$2=$3=""; print $0}' |\ | |
| sed 's/^[[:space:]]*//g' |\ | |
| tr '\n' '\0' |\ | |
| xargs -t -0 -I {} aws s3api restore-object --restore-request Days=$DAYS --bucket "$BUCKET_NAME" --key "{}" | 
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
            
Iterating over columns with
awkis problematic for object keys with reserved characters. A resilient approach is blanking the date, time, and size columns, printing the remainder, then removing any leading whitespace left over. Following that,xargsis not robust against quotes (producing “xargs: unterminated quote” errors). Convert newlines to null, then use-0to indicate null-delimited lines.See also: