Envelope Encryption using AWS KMS, Python Boto, and PyCrypto.

If you use Amazon AWS for nearly anything, then you are probably familiar with KMS, the Amazon Key Management Service.

KMS is a service which allows API-level access to cryptographic primitives without the expense and complexity of a full-fledged HSM or CloudHSM implementation. There are trade-offs in that the key material does reside on servers rather than tamper-proof devices, but these risks should be acceptable to a wide range of customers based on the care Amazon has put into the product. You should perform your own diligence on whether KMS is appropriate for your environment. If the security profile is not adequate, you should consider a stronger product such as CloudHSM or managing your own HSM solutions.

The goal here is to provide some introductory code on how to perform envelope encrypt a message using the AWS KMS API.

KMS allows you to encrypt messages of up to 4kb in size directly using the encrypt()/decrypt() API. To exceed these limitations, you must use a technique called "envelope encryption".

The steps are:

Generate a new Customer Master Key using the Boto API or the AWS Console. Note that CMKs are region-specific, so you will need to generate keys per region in a multi-region configuration.
Generate a Data Encryption Key via the generate_data_key() API. This API will return the Plaintext key, so take care with this field and clear it from memory when no longer needed. The CiphertextBlob is the Plaintext-key encrypted under the CMK. You will need to preserve this data for decryption purposes.
Locally encrypt your data. In this example, we use PyCrypto's implementation of AES using their defaults (CFB mode, no IV), so be sure you understand this thoroughly before using any example code in your production environment.
Store your locally encrypted data with the CiphertextBlob.
When decryption is needed, pass the CiphertextBlob to the KMS decrypt() API which will return the Plaintext encryption key.
Use PyCrypto's AES routines to create a new context and decrypt the encrypted ciphertext.

#!/usr/bin/env python
import base64

from boto import kms
from Crypto.Cipher import AES

pad = lambda s: s + (32 - len(s) % 32) * ' '

def get_arn(aws_data):
    return 'arn:aws:kms:{region}:{account_number}:key/{key_id}'.format(**aws_data)

def encrypt_data(aws_data, plaintext_message):
    conn = kms.connect_to_region(aws_data['region'])
    arn = get_arn(aws_data)

    data_key = conn.generate_data_key(arn, key_spec='AES_128')
    ciphertext_blob = data_key.get('CiphertextBlob')
    plaintext_key = data_key.get('Plaintext')

    # Note, does not use IV or specify mode... for demo purposes only.
    crypter = AES.new(plaintext_key)
    encrypted_data = base64.b64encode(crypter.encrypt(pad(plaintext_message)))

    # Need to preserve both of these data elements
    return encrypted_data, ciphertext_blob

def decrypt_data(aws_data, encrypted_data, ciphertext_blob):
    conn = kms.connect_to_region(aws_data['region'])

    decrypted_key = conn.decrypt(ciphertext_blob).get('Plaintext')
    crypter = AES.new(decrypted_key)

    return crypter.decrypt(base64.b64decode(encrypted_data)).rstrip()


def main():
    # Add your account number / region / KMS Key ID here.
    aws_data = {
        'region': 'us-east-1',
        'account_number': '123456789012',
        'key_id': '12345678-1234-1234-1234-123456789abc',
    }

    # And your super sekret message to envelope encrypt...
    plaintext = 'Hello, World!'

    # Store encrypted_data & ciphertext_blob in your persistent storage. You will need them both later.
    encrypted_data, ciphertext_blob = encrypt_data(aws_data, plaintext)
    print encrypted_data

    # Later on when you need to decrypt, get these from your persistent storage.
    decrypted_data = decrypt_data(aws_data, encrypted_data, ciphertext_blob)
    print decrypted_data

if __name__ == '__main__':
    main()

pmp/envelope_encryption_kms_boto_pycrypto.md

Spaider commented Jul 14, 2017