Client story
A large manufacturing was paying $800,000 a year to license enterprise data virtualization software for daily quality checks. We rebuilt it natively on Databricks, removing the license cost.
Data and Analytics
Manufacturing
Introduction
The client ran its data quality validations on an enterprise data virtualization platform, at a cost of $800,000 a year. United Hub rebuilt them natively on Databricks and eliminated the license altogether.
The challenge
Count checks, hash validation, and schema comparisons all ran through an enterprise data virtualization platform. The validation work itself was routine and short running, but the platform carried an $800,000 annual license for a job that used a fraction of its capacity. That cost was set to carry forward as the data platform grew into new layers.
Our approach
We replaced the virtualization based count and hash validations with a native PySpark solution on Databricks. It runs on a small cluster for an average of 30 minutes a day, sized to the actual work instead of a license tier. For schema comparison and future rules, we built a proof of concept using Databricks DQX, giving the team one place to define data quality checks as the Silver and Gold layers come online.
Outcomes
The $800,000 annual license was eliminated, with no loss in validation coverage.
Validation now runs on infrastructure the team already operates, at a fraction of the prior cost.
The solution created a path for extending data quality rules to the Silver and Gold layers without returning to a licensed platform.
An AI agent made thousands of engineering drawings searchable
Thousands of industrial drawing PDFs held information no one could search. We built an AI agent that reads and structures the data, so teams can query the data in natural language at scale.
$800K a year in licensing, replaced by a 30 minute Databricks job
A large manufacturing was paying $800,000 a year to license enterprise data virtualization software for daily quality checks. We rebuilt it natively on Databricks, removing the license cost.
Spotting water leaks before they reach the P&L
Water consumption data sat in disconnected sources across a property portfolio. We consolidated it into one governed model and a dashboard that flags anomalies directly.
Tell us what you are trying to build or fix. We will tell you honestly whether we are the right team for it.
CONTACT
info@unitedhubdigital.com
(864) 999-6640
Greenville, SC 29607
