Sr. Data Engineer

Posted 6 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
5-5 Annually
Senior level
Software
The Role
The Data Engineer will build and maintain scalable data ingestion and transformation pipelines, optimize Spark workloads, and implement CI/CD processes.
Summary Generated by Built In

Orion Innovation is a premier, award-winning, global business and technology services firm.  Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity.  We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Job Overview:
We are seeking a talented Data Engineer with over 5 years of experience in Databricks, Delta Lake, and Azure Data Services. The ideal candidate will have hands-on expertise in building scalable data ingestion, transformation, and AI-driven data pipelines using our agents, contributing to our data-driven decision-making processes.

Key Responsibilities:

  • Build and maintain data ingestion and transformation pipelines.
  • Implement ingestion, transformation, and validation agents.
  • Optimize Spark workloads for improved performance and efficiency.
  • Implement data quality measures and testing hooks to ensure data integrity.
  • Support Continuous Integration/Continuous Deployment (CI/CD) deployments.

Qualifications:

  • 5+ years of experience in Databricks, Delta Lake, and Azure Data Services.
  • Proven expertise in building scalable data pipelines.
  • Strong understanding of data quality and testing methodologies.
  • Familiarity with CI/CD processes and tools.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

 

 

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.


Skills Required

  • 5+ years of experience in Databricks, Delta Lake, and Azure Data Services
  • Proven expertise in building scalable data pipelines
  • Strong understanding of data quality and testing methodologies
  • Familiarity with CI/CD processes and tools
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration skills

Orion Innovation Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Orion Innovation and has not been reviewed or approved by Orion Innovation.

  • Wellbeing & Lifestyle Benefits Orion highlights health and well-being initiatives such as fitness, mindfulness, and flexibility/remote options, reinforced by recognition like Cigna’s Healthy Workforce Designation. Flexibility via hybrid/remote work is positioned as a consistent part of the overall rewards experience.
  • Fair & Transparent Compensation Pay is characterized as moderately satisfactory overall, with pockets where compensation is viewed as fair, particularly for some software engineering and certain U.S. roles. Public snapshots also indicate that competitiveness can be stronger in specific markets and functions.
  • Career-Linked Recognition & Rewards Performance-linked outcomes are implied through mentions that hikes can be good when performance is demonstrated. Learning and development programs are also emphasized as part of the broader value proposition tied to career growth.

Orion Innovation Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Edison, NJ
3,410 Employees
Year Founded: 1993

What We Do

Orion is a leading digital transformation and product development services firm. Headquartered in Edison, NJ, we have a global team of 6,200+ associates, with engineers in 14 major delivery centers across North America, Europe, Asia Pacific and Latin America. For over 25 years, Orion has been solving complex business problems for our clients. Our transformative business solutions are rooted in digital strategy, experience design, and engineering, empowering our clients to operate with agility at scale.​ Our mission is to serve as an agile and trusted partner for business transformation initiatives, providing deep emerging technology, experience design, and domain expertise.​ Our business has more than tripled over the last three years. ​ We have grown aggressively both organically and inorganically, adding new clients, complementary skills, domain expertise, and strengthening our global footprint.

Similar Jobs

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Mahārāshtra, IND
38800 Employees

TransUnion Logo TransUnion

Senior Data Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Pune, Mahārāshtra, IND
13000 Employees

Mastercard Logo Mastercard

Senior Data Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Pune, Mahārāshtra, IND
38800 Employees

Citi Logo Citi

Senior Data Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
31 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account