Telemetry has the potential to guide the future of Airflow, but only if it’s implemented transparently and with community trust.&nbsp;In this episode, we’re joined by <a href="https://www.linkedin.com/in/bolke/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Bolke de Bruin</a>, Director at <a href="https://www.linkedin.com/company/metyis/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Metyis</a> and a long-time Airflow PMC member. Bolke discusses how telemetry has been handled in the past, why it matters now and what it will take to get it right.Key Takeaways:(03:20) The role of foundations in establishing credibility and sustainability.(04:52) Why data collection is critical to open-source project direction.(07:24) Lessons learned from previous approaches to user data collection.(10:23) The current state of telemetry in the project.(10:53) Community trust as a prerequisite for technical implementation.(12:54) The importance of managing sensitive data within trusted ecosystems.(16:37) Ethical considerations in balancing participation and access.(18:45) Forward-looking ideas for improving workflow design and usability.Resources Mentioned:<a href="https://www.linkedin.com/in/bolke/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Bolke de Bruin</a>https://www.linkedin.com/in/bolke/<a href="https://www.linkedin.com/company/metyis/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Metyis</a> | LinkedInhttps://www.linkedin.com/company/metyis/<a href="http://www.metyis.com" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Metyis</a> | Websitehttp://www.metyis.com<a href="https://airflow.apache.org/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Apache Airflow</a>https://airflow.apache.org/<a href="https://airflowsummit.org/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Airflow Summit</a>https://airflowsummit.org/<a href="https://lists.apache.org/list.html?dev@airflow.apache.org" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Airflow Dev List</a>https://lists.apache.org/list.html?dev@airflow.apache.org<a href="https://www.astronomer.io/events/roadshow/london/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">https://www.astronomer.io/events/roadshow/london/</a>&nbsp;&nbsp;&nbsp;<a href="https://www.astronomer.io/events/roadshow/new-york/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">https://www.astronomer.io/events/roadshow/new-york/</a>&nbsp;&nbsp;&nbsp;<a href="https://www.astronomer.io/events/roadshow/sydney/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">https://www.astronomer.io/events/roadshow/sydney/</a>&nbsp;&nbsp;&nbsp;<a href="https://www.astronomer.io/events/roadshow/san-francisco/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">https://www.astronomer.io/events/roadshow/san-francisco/</a>&nbsp;&nbsp;&nbsp;<a href="https://www.astronomer.io/events/roadshow/chicago/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">https://www.astronomer.io/events/roadshow/chicago/</a>&nbsp;Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.#AI #Automation #Airflow #MachineLearning

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

The Future of Airflow Telemetry at Metyis with Bolke de Bruin

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

AI Chapters

AI Insights

Reviews