BACK TO ALL POSTS

Simplifying Data Monitoring & Management with Subscriptions and Notifications with Acryl DataHub

Data Engineering

Metadata Management

Data Governance

Maggie Hays

Sep 20, 2023

Data Engineering

Metadata Management

Data Governance

Data Monitoring and Management Gets Easier with Subscriptions and Notifications in Acryl DataHub

Acryl DataHub's Subscriptions and Notifications feature is designed to give you real-time alerts on data assets of your choice – so you stay informed and be proactive in managing your data resources. Whether you're a data analyst, a team lead, or a data steward, this feature ensures you're always in the loop about critical changes.

With this feature, you can set up subscriptions to specific changes for a dataset or entity – and be notified when they happen.

You no longer need to manually check for upstream changes or wait for upstream stakeholders to notify you. You get a live stream of anything that happens to the assets you care about – be it deprecations, schema changes, changes in ownership, or even assertions or incidents that signal potential data quality issues.

Once your subscriptions are set up, you'll receive real-time notifications when relevant changes occur. This means you'll be the first to know about incidents, data updates, or other alterations that could affect your work.

3 Ways Acryl DataHub’s Subscriptions & Notifications Help in Better Data Monitoring & Management

1. Improved incident management

Let's say an incident occurs related to a table you're subscribed to. Maybe it was data downtime that caused the tables to have unsynced data. You immediately receive a Slack notification with all the information you need and a link to the asset.

And this is where things get even better – you don’t have to manually or periodically check if the issue is resolved. Once the issue is resolved upstream, you get a neat little notification with the change in status.

Subscription and Group Channel Notifications

Subscription and Group Channel Notifications

2. Real-time alerts for your entire team

Keep your whole team in the loop when there are critical changes to the data entities you care about most.

When creating a new Subscription, select “Manage Group Subscriptions” to configure the appropriate notifications. Keep in mind - you can only configure group-level subscriptions for you DataHub Groups you are a member of.

Subscription and Notifications - Manage Group Subscriptions

Subscription and Notifications - Manage Group Subscriptions

3. Personalized alerts for your individual needs

Besides team-level subscriptions, you can also set up personalized alerts for changes that matter to you individually. Maybe, with a rapidly growing team, you want to make sure you don’t miss any changes in ownership. Or it could be that you want to stay updated on the tags being applied for business-critical assets.

Simply subscribe to changes that matter to you – say, for ownership shifts, additions of specific tags, or tracking new glossary terms, and you’ll never be left guessing about what happened.

Subscription and Notifications - User Subscription Settings

Subscription and Notifications - User Subscription Settings

Configuring Your First Subscriptions in Acryl DataHub

Let’s get you up and running with your first Subscription! Once you’ve found an Entity you want to keep track of, do the following:

1. Decide if you want create a subscription for yourself using “Subscribe Me”, or for your team using “Manage Group Subscriptions”.
Subscription and Notifications - Dropdown Menu

Subscription and Notifications - Dropdown Menu

2. Pick the notifications that matter most for your use case; anything from schema changes, assertion failures, ownership updates – you’re in charge of what you’ll be notified about.
Subscription and Notifications - Subscriptions Settings

Subscription and Notifications - Subscriptions Settings

3. Configure your Slack Notifications using your Slack Member ID or a Slack Channel ID.

When creating your first personal Subscription, you’ll need to configure your Slack Member ID within DataHub. You can find this in your Slack Profile > click the three dots > “Copy member ID”. Don’t forget to save it as your default this will make it a breeze to configure all future Subscriptions.

Subscription and Notifications - User can Set User ID

Subscription and Notifications - User can Set User ID

When creating your first Group Subscription, you’ll need to configure the Default Channel ID for the DataHub Group. You can find this in Slack by navigating to the Channel’s “About” section, and copy the Channel ID from the bottom of the screen.

Subscription and Notifications - Group set channel ID

Subscription and Notifications - Group set channel ID

We’re working on simplifying the linking to your communication tools and expanding this feature beyond Slack to include Microsoft Teams and email subscriptions – keep an eye out for more felixibility in managing your Acryl DataHub Subscriptions and Notifications!

4. See your Subscriptions at a glance.

You can easily view and manage your individual subscriptions by navigating to “My Subscriptions” in the DataHub Settings panel.

Subscription and Notifications - User Subscriptions

Subscription and Notifications - User Subscriptions

Likewise, you can view and manage Group-level Subscriptions via the DataHub Group pages.

Subscription and Notifications - Group Subscriptions

Subscription and Notifications - Group Subscriptions

And that, folks, is a wrap for now!

Questions? Feedback? Join us in DataHub Slack and tell us all about it!

Book a demo to see all the other cool stuff we’re building for Acryl DataHub!



Data Engineering

Metadata Management

Data Governance

NEXT UP

Governing the Kafka Firehose

Kafka’s schema registry and data portal are great, but without a way to actually enforce schema standards across all your upstream apps and services, data breakages are still going to happen. Just as important, without insight into who or what depends on this data, you can’t contain the damage. And, as data teams know, Kafka data breakages almost always cascade far and wide downstream—wrecking not just data pipelines, and not just business-critical products and services, but also any reports, dashboards, or operational analytics that depend on upstream Kafka data.

When Data Quality Fires Break Out, You're Always First to Know with Acryl Observe

Acryl Observe is a complete observability solution offered by Acryl Cloud. It helps you detect data quality issues as soon as they happen so you can address them proactively, rather than waiting for them to impact your business’ operations and services. And it integrates seamlessly with all data warehouses—including Snowflake, BigQuery, Redshift, and Databricks. But Acryl Observe is more than just detection. When data breakages do inevitably occur, it gives you everything you need to assess impact, debug, and resolve them fast; notifying all the right people with real-time status updates along the way.

John Joyce

2024-04-23

Five Signs You Need a Unified Data Observability Solution

A data observability tool is like loss-prevention for your data ecosystem, equipping you with the tools you need to proactively identify and extinguish data quality fires before they can erupt into towering infernos. Damage control is key, because upstream failures almost always have cascading downstream effects—breaking KPIs, reports, and dashboards, along with the business products and services these support and enable. When data quality fires become routine, trust is eroded. Stakeholders no longer trust their reports, dashboards, and analytics, jeopardizing the data-driven culture you’ve worked so hard to nurture

John Joyce

2024-04-17

TermsPrivacySecurity
© 2024 Acryl Data