Created
June 6, 2018 14:32
-
-
Save dan-hook/843ac18047906e506f447becc4231a61 to your computer and use it in GitHub Desktop.
"Rename" an AWS Glue table by creating a new table
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import boto3 | |
database_name = "databse" | |
table_name = "prefix-dir_name" | |
new_table_name = "more_awesome_name" | |
client = boto3.client("glue") | |
response = client.get_table(DatabaseName=database_name, Name=table_name) | |
table_input = response["Table"] | |
table_input["Name"] = new_table_name | |
# Delete keys that cause create_table to fail | |
table_input.pop("CreatedBy") | |
table_input.pop("CreateTime") | |
table_input.pop("UpdateTime") | |
create_response = client.create_table(DatabaseName=database_name, TableInput=table_input) |
+1 more field to pop in order to avoid an error:
table_input.pop("IsRegisteredWithLakeFormation")
What if the Glue table is partitioned? Table replica might not behave as expected if the partition information is not copied over.
What if the Glue table is partitioned? Table replica might not behave as expected if the partition information is not copied over.
If the table is partitioned you need to load partitions afterwards.
You can do it using boto3.
Here is an example: https://gist.github.com/ramondeklein/fb016893c500685c976dd1e89a0b5873
That gist listed above by @fjavieralba works really well!!!
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Also, I had to pop the database name to avoid an error:
table_input.pop("DatabaseName")