The Financial Times leverages Airflow and AI to uncover powerful stories hidden within vast, unstructured data.In this episode, <a href="https://www.linkedin.com/in/zdravko-hvarlingov-3aa36016b/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Zdravko Hvarlingov</a>, Senior Software Engineer at the <a href="https://www.linkedin.com/company/financial-times/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Financial Times</a>, discusses building multi-tenant Airflow systems and AI-driven pipelines that surface stories that might otherwise be missed. Zdravko walks through entity extraction and fuzzy matching, linking the UK Register of Members’ Financial Interests with Companies House, and how this work cuts weeks of manual analysis to minutes.Key Takeaways:00:00 Introduction.02:12 What computational journalism means for day-to-day newsroom work.05:22 Why a shared orchestration platform supports consistent, scalable workflows.08:30 Tradeoffs of one centralized platform versus many separate instances.11:52 Using pipelines to structure messy sources for faster analysis.14:14 Turning recurring disclosures into usable data for investigations.16:03 Applying lightweight ML and matching to reveal entities and links.18:46 How automation reduces manual effort and shortens time to insight.20:41 Practical improvements that make backfilling and reliability easier.Resources Mentioned:<a href="https://www.linkedin.com/in/zdravko-hvarlingov-3aa36016b/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Zdravko Hvarlingov</a>https://www.linkedin.com/in/zdravko-hvarlingov-3aa36016b/<a href="https://www.linkedin.com/company/financial-times/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Financial Times</a> | LinkedInhttps://www.linkedin.com/company/financial-times/<a href="https://www.ft.com/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Financial Times</a> | Websitehttps://www.ft.com/<a href="https://airflow.apache.org/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Apache Airflow</a>https://airflow.apache.org/<a href="https://www.parliament.uk/mps-lords-and-offices/standards-and-financial-interests/parliamentary-commissioner-for-standards/registers-of-interests/register-of-members-financial-interests/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">UK Register of Members’ Financial Interests</a>https://www.parliament.uk/mps-lords-and-offices/standards-and-financial-interests/parliamentary-commissioner-for-standards/registers-of-interests/register-of-members-financial-interests/<a href="https://www.gov.uk/government/organisations/companies-house" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">UK Companies House</a>https://www.gov.uk/government/organisations/companies-house<a href="https://www.doppler.com/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Doppler</a>https://www.doppler.com/<a href="https://kubernetes.io/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Kubernetes</a>https://kubernetes.io/<a href="https://airflow.apache.org/docs/apache-airflow/stable/executor/kubernetes.html" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">Airflow Kubernetes Executor</a>https://airflow.apache.org/docs/apache-airflow/stable/executor/kubernetes.html<a href="https://github.com/" target="_blank" style="background-color: transparent; color: rgb(17, 85, 204);">GitHub</a>https://github.com/﻿Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.#AI #Automation #Airflow #MachineLearning

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

How Airflow and AI Power Investigative Journalism at the Financial Times with Zdravko Hvarlingov

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

AI Chapters

AI Insights

Reviews