https://www.databricks.com/blog/introducing-real-time-mode-apache-sparktm-structured-streaming
https://docs.databricks.com/aws/en/ldp/for-each-batch
https://docs.databricks.com/aws/en/getting-started/data-pipeline-get-started?language=Python
https://github.com/speedboat-pro/morpheus
https://docs.databricks.com/aws/en/sql/language-manual/functions/read_files