Development of DDL versioning system

About project:

Client overview

A leading financial services company faced significant challenges with their data warehouse infrastructure, struggling to maintain consistency across their database objects and manage frequent development changes. With over 1000 tables and 500 views in their system, the lack of proper version control was causing operational disruptions and data integrity issues.

Tech Stack:

SQL, Manual DDL management, Basic version control

Tech stack after migration:

SQL, Automated DDL versioning system, Hashing algorithms, Backup and comparison routines, Advanced version control

Time to deliver project:

4-6 weeks

Problem

  • The client approached us with a critical issue: their data warehouse management had descended into chaos. They struggled to maintain consistency in table structures, views, and user-defined functions, leading to frequent errors and rollbacks.

Inspection

  • We discovered a proliferation of schemas, tables, views, and user-defined functions in the DWH. Frequent changes by the development team and database migrations were causing inconsistencies and errors. There was no system in place to track or manage these changes effectively.

Recommendation

  • Implement a formal version control system for storing and managing DDL to ensure better tracking, rollback capabilities, and overall consistency in database object management.

Resolution

We implemented a DDL versioning system. We developed routines to extract DDL objects, store them in a table with automatic versioning based on hash checks. This system was deployed on both primary and backup instances, enabling automatic comparison of object structures and change detection.

Similar projects

Do you want
the same one?

Leave a request and our manager will contact you to discuss your project and give an assessment of a similar project.

Please enter your name

Please enter your email

Please enter valid email

Please enter valid phone number

Our website use cookies
Read our Privacy Policy.
Order an audit

Please enter your name

Please enter your email

Please enter valid email

Please enter valid phone number

Order Black box audit

Please enter your name

Please enter your email

Please enter valid email

Please enter valid phone number

Order White box audit

Please enter your name

Please enter your email

Please enter valid email

Please enter valid phone number