Data Warehousing and Reporting at Very Large Volumes for a Home Builder

Need

The IT team was using custom developed SSIS for ETL into their data lake but the time to build/test/support these packages for the 100s of sources, 10,000+ tables/files, and 900+ millions of rows per day made it slow and costly to develop. Additionally, this home-grown approach did not support near real time replication, so they began a search for a new solution. The team looked at several tools, but needed one that could support a multitude of sources and destinations including legacy AS400/DB2 environments, on-premise SQL Server instances, and Non-Relational delta lake repositories. The team needed a solution that met their current real-time data requirements and could grow within the data ecosystem as they migrated to cloud-based platforms.

Solution

The company initially deployed Stelo to populate their Data Warehouse with over 10,000 subscriptions and can now achieve full or incremental loads on millions of rows with near real time Data Replication. Over the next few years, as sources and destination requirements increased, the company was able to increase Stelo’s transaction capacity without business disruption to keep pace with emerging data requirements. The current deployment serves both on-prem and cloud requirements, from legacy AS400/DB2 environments, SQL Server instances and delta lakes.
As part of the initial deployment, the Stelo Support worked with the IT team to train and health-check their systems. Stelo reliably powers the Data Warehouse and other IT initiatives without any complex monitoring or user intervention.