dataders

dataders

Data + AI Summit Call for Presentations

Data teams overcome challenges by building data pipelines, using advanced analytics and developing machine learning models. These challenges often span across disciplines to incorporate multiple data types, technologies, and tools — this is the driver of data lakehouse adoption.

Are you a practitioner solving data, analytics and AI challenges using Apache Spark™, Delta Lake, MLflow, TensorFlow, PyTorch, Scikit-learn, BI and SQL analytics, real time streaming, deep learning and machine learning frameworks? If so, we invite you to share your experience with our global Summit community.

Draft your proposal for a 15-minute lightning talk, 40-minute session or 90-minute technical deep dive about how you are simplifying data, analytics and AI challenges. Share your expertise with the largest gathering of data and AI professionals.

Please visit the Data + AI Summit 2023 website to learn more about this year's Call for Presen

dataders

working title

Codd, Chomsky, McKinney, and Wickham walk into a bar… (maybe Chamberlain and Wittgenstein should also be included?)

background

• the dream of substrait is true separation b/w query engines and transformation APIs
• previously, particular APIs would give better performance due to their inextricable link to the architecture of the underlying compute engine
• if the above benefit is removed, folks could use the API with which they are most familiar
• given this, we could see an industry consolidation around the “best” transformation API.

dataders

12 Principles of Agile Software Development

background

source: agilemanifesto.org/principles

Writing these up in a numbered, markdown-friendly list, because I'm nitpicky

principles

dataders

Setup dbt-sqlserver / dbt-synapse on M1

Install pyodbc

Info gotten from here

brew install unixodbc
export LDFLAGS="-L/opt/homebrew/Cellar/unixodbc/2.3.9_1/lib"
export CPPFLAGS="-I/opt/homebrew/Cellar/unixodbc/2.3.9_1/include"

dataders

dataders

Loom overview

retro on debugging external volume creation - Watch Video

dataders

After writing this, it turns out I'm all about "deep ideas". Not really an order here, read what piques your interest and lmk what you like

The list

Whole Earth

This guy was everywhere. To me, it's really a story of the beginning of Silicon Valley as we know it. The Dead, Ken Kesey, Alen Ginsberg, early LSD experiments, Doug Englebart and his "Mother of All Demos" modern environmentalism / conservationism, Brian Eno, Steve Jobs. like what?

Very inspiring for me to read lately because he was never a great student or a great engineer, but was always curious and connecting with people.

dataders