The client is a niche specialty property and casualty insurance company operating globally. Recently, the giant with nearly 6,000 employees embarked on a series of IT projects in a pursuit of digital transformation of their entire business.
As the insurance sector is embracing data technologies to create new valuable offers meeting the demands of time for their customers, it’s only logical our client started from an ETL project. They approached Symfa because of our robust ETL expertise lying at the core of any data-heavy endeavor.
The project objective was to improve and optimize data processing workflows in the Fortune 500 company with offices all over the globe, generating dozens of millions of rows on a monthly basis.
Why do businesses need ETL software in the first place? Any company that uses an ERP system at some point understands that the data within their ERP is a total mess. There are two main reasons that cause it:
Even with the first cause eliminated (which is possible in theory, but rarely in practice), the second one will persist. Controlled differences in data formats and structure technically aren’t an error, but they do cause businesses problems.
Thus, our team had two key tasks for this project:
Working in partnership with a globally acclaimed insurance corporation required going an extra mile to gain deep domain knowledge during the onboarding phase. Our team also had to rethink our data processing approaches to fit the needs of the client’s high-load data systems.
The project implies five major steps that a joint team of the client’s and Symfa talents are implementing:
The software extracts data of varying quality from multiple sources.
The extracted data is checked for correctness and fullness.
The validated data is mapped against the target model.
This step is required because of the difference in data break-down in OLTP and OLAP systems. To speed up the process, the OLTP part could be omitted, but then the audit trail would have been lost.
The audit trail in its turn is required to build a Drill-down report which shows which lines of the OLTP system made the OLAP cell.
The data is loaded into the target system (database or data warehouse).
Our team will get back to you promptly to discuss the next steps