About this project
A healthcare client with heavy reliance on classical Extract, Transform, Load (ETL) services was facing challenges in managing frequent data updates. Employing a team of 10 engineers, they were dedicated to the meticulous task of cleansing, refining, and transforming data to be seamlessly ingested by their enterprise system.
Recognizing the inefficiencies and limitations of this approach, we proposed a shift: migrating the entire data engineering process to Azure Data Factory and related Azure services. This transition was not just about changing platforms; it was about leveraging modern techniques to automate and refine processes that were previously labor-intensive.
Domain & Technology
- Azure Data Factory
- Azure Data Pipeline
- ETL Services
Our Services Include
- Web development
- Mobile development
- Product design
- Ideation
- Testing
Challenge
CHWE reached out to the Sobah team for this project after failing to get required delivery from 3 different partners in the past.
This problem involves data sources from over 50,000 different sources, where most of the data is unstructured.
Additionally, the user experience of the portal required encouraging citizens to be involved in their politics – a challenge that has eluded younger generations over the last few decades. Most importantly, the initiative is non-partisan and required completely neutral and data driven content to avoid any bias in the insights provided to the citizens.
Expectations
The client required our team to conduct a thorough and careful study of data sources, architectural choices and innovative search engine optimization techniques. Product involved a sophisticated phased roadmap required to be delivered over a period of years. The core requirement was to build a highly scalable, adaptable and agile product framework and architecture. We were also tasked with engaging content writers to deliver thousands of articles for educating citizens on various topics related with their politics and society. Product envisioned additional roles and content created for analysts and institutions that require bulk data and deeper insights using data analytics and AI.
Our team
- Lead Mobile App Developer
- Web Developers
- QA Testers