Skip to content

Instantly share code, notes, and snippets.

@jy2k
Created May 2, 2021 11:52
Show Gist options
  • Save jy2k/fea1361155d72d2bbdc96b569fda022d to your computer and use it in GitHub Desktop.
Save jy2k/fea1361155d72d2bbdc96b569fda022d to your computer and use it in GitHub Desktop.
from kfp import components
components.func_to_container_op(bigquery_to_csv,
output_component_file='bq_to_csv.yaml',
#custom Docker image
base_image='gcr.io/demo-project/custom-container',
#dynamically install packages
packages_to_install=['google-cloud-bigquery-storage','google-cloud-bigquery','pandas','pyarrow'])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment