Skip to content

Instantly share code, notes, and snippets.

View josete89's full-sized avatar

Jose Luis josete89

  • adidas-group
  • Zaragoza
View GitHub Profile

DESCRIBE FORMATTED `delta-table`;

Query result

# col_name            	data_type           	comment             	 	 
col                 	array<string>       	from deserializer   

# Detailed Table Information
Database: test 

DESCRIBE non-delta-table

col_name data_type comment
id int
productName string
quantity int

DESCRIBE delta-table

Query result:

col_name data_type comment
col array|from deserializer
{
"tables": [{
"name": "sales_predictions",
"visibility": "internal",
"columns": [{ "name": "article_number","pci": true }]
},
{
"name": "sales_trends",
"visibility": "public",
"columns": [{ "name": "date","pci": true }]
{
"outputs":{
"sales_trends":{
"file-format":"parquet",
"port-type": "blob",
"location": "s3://my-data-product/sales_trends",
"partition-columns": [ "foobar" ],
"retention-time": {"unit": "day","time": 2}
},
"sales_predictions":{
{
"inputs": {
"DataProductA":{
"tables": ["table1","table2"]
}
}
}
{
"consumers": [{
"account":"99987654321",
"contact": "[email protected]",
"type": "lakeformation",
"enterprise-system-landscape-information-tracker": "foobar",
"team": "foobar",
"consumer-role-arn": "arn:aws:iam::99987654321:role/ConsumerRole"
}]
}
{
"account-type": "aws",
"producer-role-arn": "arn:aws:iam::12345678999:role/ProducerRole",
"producer-account-id": "12345678999",
"bucket-name": "trading-producer-data"
}
{
"data-product-name": "my_data_product",
"data-product-owner": "[email protected]",
"data-product-mantainer": "[email protected]",
"enterprise-system-landscape-information-tracker": "foobar",
"edc-data-objects": [ "foobar" ],"source-system": "SAP-AFS",
"usage-patterns": ["foobar"],
"version": "0.0.1"
}

Keybase proof

I hereby claim:

  • I am josete89 on github.
  • I am alcaljos (https://keybase.io/alcaljos) on keybase.
  • I have a public key ASC05l0GF0Ny1y_ccI0Z7IZ4ItSpatIIxWnXnDpN9iVK5Qo

To claim this, I am signing this object: