Seniority / Level:
Senior (7+ Years)
Location / Work Mode:
Offshore
Primary Deliverables / Focus:
Data Migration Plan (D-03), Schema Mapping Specs,
Pipeline Architecture & Final Reconciliation Report (D-08)
Role Objective & Summary
The Lead Data Engineer commands the data migration
architecture, transformation logic, and reconciliation framework. Starting in
November for legacy schema discovery, this senior engineer maps source data
structures to the modern Azure SQL schema, designs automated ETL pipelines in
Azure Data Factory, governs multi-cycle dry runs, and authors the final
audit-grade reconciliation report.
Core Key Responsibilities
· Author the Data Migration Plan (Deliverable D-03), establishing
migration stages, transformation rules, validation thresholds, and rollback
plans.
· Conduct deep legacy schema analysis, mapping historical
entities, fields, constraints, and data dictionaries to the target Azure SQL
schema.
· Architect scalable, automated ETL/ELT pipelines using Azure Data
Factory (ADF), PySpark, and SQL stored procedures.
· Design and oversee multi-cycle migration dry runs, tracking
extraction throughput, transformation accuracy, and load performance.
· Establish automated field-level checksum, hash comparison, and
record reconciliation routines to ensure zero critical data loss.
· Author the Final Data Reconciliation Report (Deliverable D-08),
certifying 100% data integrity and financial ledger reconciliation.
· Lead the technical execution of cutover data migration during
the production go-live window in September.
Required Technical Skills & Competencies
· 7+ years of data engineering and database migration experience
leading complex, large-scale enterprise data migrations.
· Extensive expertise with Microsoft Azure Data Factory (ADF),
Azure Data Lake Storage (ADLS Gen2), and Azure SQL Database / Managed Instance.
· Proficiency in SQL data manipulation, stored procedure
optimization, indexing, and bulk loading utilities (BCP, SSMA).
· Strong programming skills in Python / PySpark for complex data
transformations and normalization.
· Deep understanding of data quality governance, schema
translation, data cleansing, and audit reconciliation techniques.
· Experience working with relational (Oracle, SQL Server) and
legacy data formats (copybooks, fixed-width files, VSAM extracts).
Preferred Qualifications & Certifications
· Microsoft Certified: Azure Data Engineer Associate.
· Prior experience migrating legacy IBM or Unisys mainframe data
into modern relational cloud databases.
Skills Required
- 7+ years of data engineering and database migration experience leading complex, large-scale enterprise data migrations
- Extensive expertise with Azure Data Factory, Azure Data Lake Storage Gen2, and Azure SQL Database or Managed Instance
- Proficiency in SQL data manipulation, stored procedure optimization, indexing, and bulk loading utilities including BCP and SSMA
- Strong programming skills in Python and PySpark for complex data transformations and normalization
- Deep understanding of data quality governance, schema translation, data cleansing, and audit reconciliation techniques
- Experience with relational databases including Oracle and SQL Server, and legacy formats including copybooks, fixed-width files, and VSAM extracts
- Microsoft Certified: Azure Data Engineer Associate
- Prior experience migrating IBM or Unisys mainframe data into modern relational cloud databases
What We Do
SRM Technologies is a global IT services company specialising in automotive technologies, digital transformation and product engineering services. We provide technology consulting, platform development, data analytics, artificial intelligence, cloud enablement, digital infrastructure, quality assurance, embedded software and design to manufacturing product solutions to various industries and enterprises across the North America, Japan, Europe and India. At the heart of our organization are passionate employees who embody our core belief - 'ideas@work.' We firmly believe that ideas and innovation truly matter only when they create a meaningful impact on our customers' businesses and the lives of their end customers. Therefore, we prioritize the practical application of these ideas and their transformative impact through our talented and ever-growing workforce. 𝘚𝘙𝘔 𝘛𝘦𝘤𝘩 𝘪𝘴 𝘢 𝘱𝘳𝘰𝘶𝘥 𝘮𝘦𝘮𝘣𝘦𝘳 𝘰𝘧 𝘵𝘩𝘦 𝘚𝘙𝘔 𝘎𝘳𝘰𝘶𝘱, 𝘢 𝘮𝘶𝘭𝘵𝘪𝘯𝘢𝘵𝘪𝘰𝘯𝘢𝘭 𝘤𝘰𝘯𝘨𝘭𝘰𝘮𝘦𝘳𝘢𝘵𝘦 𝘸𝘪𝘵𝘩 𝘢 𝘳𝘪𝘤𝘩 𝘩𝘪𝘴𝘵𝘰𝘳𝘺 𝘴𝘱𝘢𝘯𝘯𝘪𝘯𝘨 𝘰𝘷𝘦𝘳 𝘧𝘰𝘶𝘳 𝘥𝘦𝘤𝘢𝘥𝘦𝘴. 𝘛𝘩𝘦 𝘚𝘙𝘔 𝘎𝘳𝘰𝘶𝘱 𝘰𝘱𝘦𝘳𝘢𝘵𝘦𝘴 𝘪𝘯 𝘥𝘪𝘷𝘦𝘳𝘴𝘦 𝘴𝘦𝘤𝘵𝘰𝘳𝘴, 𝘪𝘯𝘤𝘭𝘶𝘥𝘪𝘯𝘨 𝘌𝘥𝘶𝘤𝘢𝘵𝘪𝘰𝘯, 𝘛𝘦𝘤𝘩𝘯𝘰𝘭𝘰𝘨𝘺, 𝘏𝘦𝘢𝘭𝘵𝘩𝘤𝘢𝘳𝘦, 𝘢𝘯𝘥 𝘔𝘦𝘥𝘪𝘢









