US-based Leading Information Services Provider

Fresh Gravity implemented Penguin (Metadata Classifier), a proprietary AI-driven auto data mapping solution, to simplify and accelerate source-to-target-mapping across 3000+ US counties resulting in a reduction data mapping process by 80%.

Problem

The client analyses information assets and data to provide customers with analytics and customized data services. The client also develops proprietary research and tracks current and historical trends in several categories, including consumer credit, capital markets, real estate, fraud, regulatory compliance, natural hazards, and disaster projections. To achieve such a high standard of data analytics, the client processes data coming from 3000+ US counties. On
average, 40% of these processes require manual intervention due to input field mapping issues caused by differences in source files between consecutive versions or data feeds. These range from minor filenames or profiling layout variations to those that require wholesale remapping due to entirely new datasets/schemas. The time it can take for a capture analyst to fix or remap files can span over days or even several weeks, depending on factors such as analyst skill and/or mapping complexity.

Solution

Fresh Gravity was engaged to implement a proprietary solution – Penguin (Metadata Classifier), an innovative, best-in-class Auto Metadata Mapper to simplify and accelerate source-to-target data mapping with an augmented approach. Penguin utilizes metadata, data, and our proven data classification algorithms, along with large language models to simplify data classification and mapping. By learning semantic information from diverse data models and sources, the solution also generates corresponding ontology and canonical models automatically.

Impact

The implementation resulted in annual savings of 300K USD by reducing the data mapping process by over 80% as well as accelerated the data provisioning for business. In addition, it helped repurposing 10k+ people hours to other business needs.