Data Engineer

Posted 2 Days Ago
Lawrence Township, NJ, USA
In-Office
Senior level
Software
The Role
Lead end-to-end delivery of data products on Databricks, translating business requirements into technical designs, data models, builds, tests, and releases. Develop Bronze, Silver, and Gold-layer solutions using PySpark, Spark SQL, Delta Lake, Unity Catalog, Python, SQL, and Git-based CI/CD. Manage offshore engineering teams and vendors through backlog planning, design reviews, code reviews, and delivery oversight. Partner with business stakeholders on data definitions, quality, governance, and acceptance criteria.
Summary Generated by Built In

Orion Innovation is a premier, award-winning, global business and technology services firm.  Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity.  We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.


ROLE SUMMARY

The Company’s Commercialization Business Insights & Technology (CBI&T) Dat and AI (D&A) New Build team is responsible for executing on prioritized work leveraging Databricks as its data foundation platform.

Seeking US Data Lead to manage delivery of these data assets and data products end to end. This position is the technical point of contact for this work, translating business requirements from our Commercialization AI Strategy & Analytics (CASA) business partners into designed, built, tested, and released data products on Databricks.

Work with US data team members, other commercialization BI&T stakeholders, company offshore engineers and systems integrator resources.

MUST HAVE DATABRICKS EXP, DATA MODELING EXP, AND DATA PRODUCTS EXP.

KEY RESPONSIBILITIES

Data delivery

• Lead design, build, UAT, releases

• Partner with CASA data owners, domain leads, and business SMEs to translate data product scope: critical data elements, business rules, metric definitions, grain, aggregation logic, and acceptance criteria into technical design and execution.

• Produce core design artifacts: source-to-target mappings, analytical requirement documents, Bronze, Silver Gold-layer logical data models.

Technical build and data modeling

• Hands on understanding of of Databricks tools, (PySpark, Spark SQL, Delta Lake, etc.)

• Apply platform standards for Unity Catalog cataloging, table design and clustering, performance tuning, data quality controls, and CI/CD through Git.

• Data Product data modeling

Offshore/Vendor Engagement

• Day-to-day work of an offshore engineering pod in Hyderabad, India — backlog grooming, task assignment, design review, and code review.

• Provide technical direction to systems integrator and consulting partners working on the same domains, and hold their deliverables to company standards.

• Review vendor work products against statement-of-work scope and flag gaps early.


REQUIRED QUALIFICATIONS

• 6–10+ years in data engineering

• Databricks experience

• Strong data product and data modeling skills. Proven experience defining and delivering data products with business stakeholders, not just executing handed-down specifications.

• Demonstrated hands-on Databricks experience: PySpark, Spark SQL, Delta Lake, and experience with medallion architecture (Bronze/Raw, Silver/Refined, Gold/Published) including what logic belongs in which layer and why.

• Experience with Unity Catalog: catalogs and schemas, access control, and data classification.

• Experience leading distributed and offshore teams, with demonstrated ability to get quality output from an India-based delivery pod.

• Advanced SQL, Python, and a Git-based development workflow.

• Excellent written and verbal communication; able work independently with business stakeholders

• Self-directed. This team needs people who can take an ambiguous business ask and drive it to released data products


PREFERRED QUALIFICATIONS

• Pharmaceutical or life sciences commercial data experience, and familiarity with industry data sources such as IQVIA, Symphony Health, Komodo, Flatiron, specialty pharmacy and distributor data, Veeva CRM, and marketing or digital engagement platforms.

• Understanding of commercial analytics use cases: field force performance, customer, patient journey and line of therapy

• Familiarity with data governance concepts: data ownership, stewardship, critical data elements, and data quality frameworks.

• Experience in a regulated environment with audit, privacy, and access-control requirements

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.


Skills Required

  • 6-10+ years of experience in data engineering
  • Experience with Databricks
  • Strong data product and data modeling skills
  • Hands-on experience with PySpark, Spark SQL, Delta Lake, and medallion architecture
  • Experience with Unity Catalog, including catalogs, schemas, access control, and data classification
  • Experience leading distributed and offshore engineering teams
  • Advanced SQL and Python skills
  • Experience with Git-based development workflows
  • Excellent written and verbal communication skills
  • Ability to work independently with business stakeholders
  • Ability to drive ambiguous business requirements through released data products
  • Pharmaceutical or life sciences commercial data experience
  • Familiarity with IQVIA, Symphony Health, Komodo, Flatiron, specialty pharmacy, distributor data, Veeva CRM, or marketing and digital engagement platforms
  • Understanding of commercial analytics use cases
  • Familiarity with data governance concepts and data quality frameworks
  • Experience in regulated environments with audit, privacy, and access-control requirements

Orion Innovation Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Orion Innovation and has not been reviewed or approved by Orion Innovation.

  • Wellbeing & Lifestyle Benefits — Orion highlights health and well-being initiatives such as fitness, mindfulness, and flexibility/remote options, reinforced by recognition like Cigna’s Healthy Workforce Designation. Flexibility via hybrid/remote work is positioned as a consistent part of the overall rewards experience.
  • Fair & Transparent Compensation — Pay is characterized as moderately satisfactory overall, with pockets where compensation is viewed as fair, particularly for some software engineering and certain U.S. roles. Public snapshots also indicate that competitiveness can be stronger in specific markets and functions.
  • Career-Linked Recognition & Rewards — Performance-linked outcomes are implied through mentions that hikes can be good when performance is demonstrated. Learning and development programs are also emphasized as part of the broader value proposition tied to career growth.

Orion Innovation Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Edison, NJ
3,410 Employees
Year Founded: 1993

What We Do

Orion is a leading digital transformation and product development services firm. Headquartered in Edison, NJ, we have a global team of 6,200+ associates, with engineers in 14 major delivery centers across North America, Europe, Asia Pacific and Latin America. For over 25 years, Orion has been solving complex business problems for our clients. Our transformative business solutions are rooted in digital strategy, experience design, and engineering, empowering our clients to operate with agility at scale.​ Our mission is to serve as an agile and trusted partner for business transformation initiatives, providing deep emerging technology, experience design, and domain expertise.​ Our business has more than tripled over the last three years. ​ We have grown aggressively both organically and inorganically, adding new clients, complementary skills, domain expertise, and strengthening our global footprint.

Similar Jobs

JPMorganChase Logo JPMorganChase

Data Engineer

Financial Services
Hybrid
Jersey City, NJ, USA
289097 Employees

Samsara Logo Samsara

Data Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
99K-167K Annually

CrowdStrike Logo CrowdStrike

Senior Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
140K-215K Annually

Edmunds Logo Edmunds

Data Engineer

AdTech • Automotive • Big Data • Consumer Web
Remote or Hybrid
USA
500 Employees
125K-159K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account