Humans of DataHub: Steven Po
Humans of DataHub
Open Source
Data Engineering
Community
Humans of DataHub
Open Source
Data Engineering
Community
This week we are excited to share our sixth (đ€©) installment of Humans of DataHub. We are joined by Steven Po, a Senior Data Engineer at Coursera.
We had the pleasure of chatting with Steven on Zoom; check out our conversation to hear about Stevenâs work, the âš delightful âš features DataHub offers, and much more! Closed captioning is available via Youtube.
Thank you, Steven, for a wonderful conversation and all your contributions to the DataHub Community!
What is Humans of DataHub?
Humans of DataHub is a series highlighting the wonderful people that are helping define how the DataHub Community collaborates in 2022.
Whatâs DataHub?
If you are new to DataHub, just beginning to understand what âmetadataâ and âmodern data stackâ mean, or youâve just read these words for the first time (Welcome, friends! đ€ ), let us take a moment to introduce ourselves and share a little history;
DataHub is an extensible metadata platform, enabling data discovery, data observability, and federated governance to tame the complexity of increasingly diverse data ecosystems. Originally built at LinkedIn, DataHub was open-sourced under the Apache 2.0 License in 2020. It now has a thriving community with over 2.9k (đ) members and 100+ code contributors, and many companies are actively using DataHub in production.
We believe that data-driven organizations need a reimagined developer-friendly data catalog to tackle the diversity and scale of the modern data stack. Our goal is to provide the most reliable and trusted enterprise data graph to empower data teams with best-in-class search and discovery and enable continuous data quality based on DataOps practices. This allows central data teams to scale their effectiveness and companies to maximize the value they derive from data.
Want to join the DataHub Community? Visit https://datahubproject.io and say hello on Slack. đ
Humans of DataHub
Open Source
Data Engineering
Community
NEXT UP
Governing the Kafka Firehose
Kafkaâs schema registry and data portal are great, but without a way to actually enforce schema standards across all your upstream apps and services, data breakages are still going to happen. Just as important, without insight into who or what depends on this data, you canât contain the damage. And, as data teams know, Kafka data breakages almost always cascade far and wide downstreamâwrecking not just data pipelines, and not just business-critical products and services, but also any reports, dashboards, or operational analytics that depend on upstream Kafka data.
When Data Quality Fires Break Out, You're Always First to Know with Acryl Observe
Acryl Observe is a complete observability solution offered by Acryl Cloud. It helps you detect data quality issues as soon as they happen so you can address them proactively, rather than waiting for them to impact your businessâ operations and services. And it integrates seamlessly with all data warehousesâincluding Snowflake, BigQuery, Redshift, and Databricks. But Acryl Observe is more than just detection. When data breakages do inevitably occur, it gives you everything you need to assess impact, debug, and resolve them fast; notifying all the right people with real-time status updates along the way.
John Joyce
2024-04-23
Five Signs You Need a Unified Data Observability Solution
A data observability tool is like loss-prevention for your data ecosystem, equipping you with the tools you need to proactively identify and extinguish data quality fires before they can erupt into towering infernos. Damage control is key, because upstream failures almost always have cascading downstream effectsâbreaking KPIs, reports, and dashboards, along with the business products and services these support and enable. When data quality fires become routine, trust is eroded. Stakeholders no longer trust their reports, dashboards, and analytics, jeopardizing the data-driven culture youâve worked so hard to nurture
John Joyce
2024-04-17