The evolution of Airflow continues to shape data orchestration and monitoring strategies. Leveraging it beyond traditional ETL use cases opens powerful new possibilities for proactive support and internal operations.In this episode, we are joined by <a href="https://www.linkedin.com/in/collin-mcnulty/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Collin McNulty</a>, Sr. Director of Global Support at <a href="https://www.linkedin.com/company/astronomer/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Astronomer</a>, who shares insights from his journey into data engineering and the lessons learned from leading Astronomer’s Customer Reliability Engineering (CRE) team.Key Takeaways:00:00 Introduction.03:07 Lessons learned in adapting to major platform transitions.05:18 How proactive monitoring improves reliability and customer experience.08:10 Using automation to enhance internal support processes.12:09 Why keeping systems current helps avoid unnecessary issues.15:14 Approaches that strengthen system reliability and efficiency.18:46 Best practices for simplifying complex orchestration dependencies.23:24 Anticipated innovations that expand orchestration capabilities.Resources Mentioned:<a href="https://www.linkedin.com/in/collin-mcnulty/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Collin McNulty</a>https://www.linkedin.com/in/collin-mcnulty/<a href="https://www.linkedin.com/company/astronomer/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Astronomer</a> | LinkedInhttps://www.linkedin.com/company/astronomer/<a href="https://www.astronomer.io" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Astronomer</a> | Websitehttps://www.astronomer.io<a href="https://airflow.apache.org/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Apache Airflow</a>https://airflow.apache.org/<a href="https://prometheus.io/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Prometheus</a>https://prometheus.io/<a href="https://www.splunk.com/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Splunk</a>https://www.splunk.com/Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.#AI #Automation #Airflow #MachineLearning

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

How Astronomer Turns Proactive Monitoring Into Customer Success with Collin McNulty

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

AI Chapters

AI Insights

Reviews