Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.
Data Engineer
Location- Kochi/Coimbatore/Chennai
Job Overview
We are seeking a strong Data Engineer - Databricks Migration with 10+ years of experience and hands-on expertise in Databricks, PySpark, and SQL/T-SQL interpretation to support a legacy-to-Databricks migration program. The ideal candidate should have worked predominantly as a Data Engineer throughout their career, ideally beginning with Oracle, SQL Server/T-SQL, ETL, or Data Warehouse technologies and later transitioning into modern cloud-based Data Engineering. The role requires the ability to understand existing T-SQL logic and migrate transformation rules into scalable Databricks and PySpark solutions. Important screening criterion: The candidate must have worked predominantly and consistently as a Data Engineer throughout their career. Profiles that are primarily BI, reporting, dashboarding, analytics, or only recently shifted into data engineering should not be prioritized.
Key Responsibilities:
- Analyze legacy data warehouse, SQL Server, Oracle, ETL, and T-SQL based implementations for migration to Databricks.
- Read and interpret complex T-SQL scripts, stored procedures, functions, views, joins, transformation rules, and data flows.
- Convert business logic from legacy SQL/T-SQL processes into optimized Databricks and PySpark workflows.
- Design, develop, and maintain scalable ETL/ELT pipelines in Databricks.
- Support ingestion, transformation, validation, and reconciliation of enterprise data across legacy and modern platforms.
- Collaborate with architects, senior engineers, business analysts, and migration teams to understand source-to-target mapping requirements.
- Perform data quality checks, unit testing, integration testing, and defect resolution during migration execution.
- Optimize PySpark jobs, SQL queries, and Databricks notebooks for better performance and reliability.
- Document migration logic, transformation rules, dependencies, and technical design details.
- Participate in code reviews and follow Data Engineering best practices.
Key Skills:
- 5+ years of relevant Data Engineering experience, with the majority of career spent in Data Engineering roles.
- Strong hands-on experience in Databricks development.
- Strong PySpark programming experience for data transformation and pipeline development.
- Strong SQL/T-SQL understanding, especially the ability to read and interpret existing T-SQL code.
- Experience in legacy data technologies such as SQL Server, Oracle, traditional ETL tools, or Data Warehouse platforms.
- Experience in ETL/ELT development, data ingestion, transformation, and data pipeline implementation.
- Good understanding of Data Warehousing, Data Modeling, and dimensional concepts.
- Ability to migrate or re-engineer legacy SQL/ETL logic into Databricks/PySpark.
- Strong analytical, debugging, and problem-solving skills.
- Good communication skills to work with technical and business teams.
Preferred Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.
- Azure Data Factory or Azure Data Platform exposure.
- Delta Lake experience.
- Unity Catalog exposure.
- Azure Synapse Analytics experience.
- CI/CD exposure for data pipelines.
- Experience working in Agile/Scrum delivery models.
- Data governance, security, and lineage awareness.
- Relevant certifications in Databricks, Azure Data Engineering, or Cloud Data Platforms will be an added advantage.
- Strong, hands-on Data Engineering background throughout career, not a partial or recent transition.
- Avoid profiles that are mainly BI Developers, Power BI Developers, Data Analysts, or reporting-only candidates.
Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
Candidate Privacy Policy
Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:
- What information we collect during our application and recruitment process and why we collect it;
- How we handle that information; and
- How to access and update that information.
Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.
Skills Required
- 10+ years of hands-on experience (predominantly as a Data Engineer)
- Strong Databricks development experience
- Strong PySpark programming for data transformation and pipelines
- Strong SQL/T-SQL understanding and ability to read/interpret complex T-SQL code, stored procedures, functions, views
- Experience with legacy data technologies: SQL Server, Oracle, traditional ETL tools, or Data Warehouse platforms
- Experience designing, developing, and maintaining scalable ETL/ELT pipelines
- Data ingestion, transformation, validation, reconciliation and data quality testing experience
- Understanding of Data Warehousing, Data Modeling, and dimensional concepts
- Strong analytical, debugging, problem-solving, and communication skills
- Majority of career spent in Data Engineering roles (not primarily BI/reporting/analytics)
- Bachelor's or Master's degree in Computer Science/IT/Engineering or related discipline
- Azure Data Factory or Azure Data Platform exposure
- Delta Lake experience
- Unity Catalog exposure
- Azure Synapse Analytics experience
- CI/CD exposure for data pipelines
- Experience working in Agile/Scrum delivery models
- Data governance, security, and lineage awareness
- Relevant certifications in Databricks, Azure Data Engineering, or Cloud Data Platforms
Orion Innovation Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Orion Innovation and has not been reviewed or approved by Orion Innovation.
-
Wellbeing & Lifestyle Benefits — Orion highlights health and well-being initiatives such as fitness, mindfulness, and flexibility/remote options, reinforced by recognition like Cigna’s Healthy Workforce Designation. Flexibility via hybrid/remote work is positioned as a consistent part of the overall rewards experience.
-
Fair & Transparent Compensation — Pay is characterized as moderately satisfactory overall, with pockets where compensation is viewed as fair, particularly for some software engineering and certain U.S. roles. Public snapshots also indicate that competitiveness can be stronger in specific markets and functions.
-
Career-Linked Recognition & Rewards — Performance-linked outcomes are implied through mentions that hikes can be good when performance is demonstrated. Learning and development programs are also emphasized as part of the broader value proposition tied to career growth.
Orion Innovation Insights
What We Do
Orion is a leading digital transformation and product development services firm. Headquartered in Edison, NJ, we have a global team of 6,200+ associates, with engineers in 14 major delivery centers across North America, Europe, Asia Pacific and Latin America. For over 25 years, Orion has been solving complex business problems for our clients. Our transformative business solutions are rooted in digital strategy, experience design, and engineering, empowering our clients to operate with agility at scale. Our mission is to serve as an agile and trusted partner for business transformation initiatives, providing deep emerging technology, experience design, and domain expertise. Our business has more than tripled over the last three years. We have grown aggressively both organically and inorganically, adding new clients, complementary skills, domain expertise, and strengthening our global footprint.
