Principal Data Engineer

Posted 6 Days Ago
Be an Early Applicant
Durham, NC, USA
In-Office
Senior level
Fintech
The Role
Design, develop, test, deploy, and maintain scalable ETL and BI/data warehouse solutions in cloud/on-prem environments. Build CI/CD pipelines, automation, test frameworks, and data quality processes. Collaborate with analysts and engineers in Agile teams to deliver reliable, observable, enterprise-grade data platforms.
Summary Generated by Built In
Job Description:

Position Description:

Builds automation pipelines using DevOps concepts and Continuous Integration and Continuous Delivery (CI/CD) tools -- Jenkins, Stash, Concourse, and Artifactory. Develops Oracle SQL and PL/SQL stored procedures for relational databases. Develops new web based applications within cloud environments – Snowflake and Amazon Web Services (AWS). Designs, builds, and maintains reporting platforms. Writes codes with object-oriented programming languages -- Python/Spark. Performs shell scripting and scheduling using programming languages -- Python and Spark. Works in Agile environment executing projects using Kanban and SCRUM. Works with analysts to create profiles and rules for data quality using Informatica Data Quality IDQ tools and Address doctor.

Primary Responsibilities:

  • Responsible for designing, developing, testing, deploying, maintaining and improving customer-facing software solutions.
  • Performs test automation frameworks and standard methodologies to build a reliable product.
  • Designs and builds Extract, Transact, and Load (ETL) solutions while incorporating TEST automation frameworks in highly scalable distributed data processing systems.
  • Delivers software in an Agile environment.
  • Develops and maintains databases using principles of Database Warehousing and Data mart concepts.
  • Confers with systems analysts and other software engineers/developers to design systems and to obtain information on project limitations and capabilities, performance requirements, and interfaces.
  • Develops and oversees software system testing and validation procedures, programming, and documentation.

Education and Experience:

Bachelor’s degree in Computer Science, Engineering, Information Technology, Information Systems or a closely related field (or foreign education equivalent)  and five (5) years of experience as a Principal Data Engineer (or closely related occupation) designing and developing highly scalable Business Intelligence (BI) and analytical solutions in on-premise and Cloud platforms in a financial services environment using data warehouse and Data mart methodologies.

Or, alternatively, Master’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Principal Data Engineer (or closely related occupation)  designing and developing highly scalable Business Intelligence (BI) and analytical solutions in on-premise and Cloud platforms in a financial services environment using data warehouse and Data mart methodologies.

Skills and Knowledge:

Candidate must also possess:

  • Demonstrated Expertise (“DE”) designing and developing data warehouse applications according to business user requirements, using AWS services, Docker Container, Snowflake, Informatica, Oracle, PL/SQL, and Control-M; maintaining Continuous Integration/Continuous Delivery (CI/CD) pipelines for application code using Jenkins, Jenkinscore, Terracore, bitbucket, Github, and Concourse; developing Unix shell scripts; and creating Control-M jobs to automate and schedule end-to-end processes.
  • DE developing real time Big Data solutions on Hadoop, using Hive/Impala, Kafka, Scala, Spark SQL, and Python to build highly scalable and data availability platform to the end user.
  • DE participating and implementing all aspects of the Software Development Lifecycle (SDLC) in delivering innovative solutions according to financial services standards, security requirements, software development best practices, and Agile methodologies; and utilizing Alation and Collibra to efficiently catalog, analyze and govern data assets, ensuring data quality, compliance and informed decision-making across the organization.
  • DE performing Test-Driven Development (TDD), using JUnit; conducting performance testing using JMeter; Data profiling, and Data mining; troubleshooting issues using Datadog for Observability; and creating stable and highly available solutions, using Service Level Objectives (SLO) and Service Level Indicators (SLI) concepts.

#PE1M2

#LI-DNI

Certifications:

Category:Information Technology

Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.

Skills Required

  • Bachelor's degree in Computer Science, Engineering, IT, Information Systems (or foreign equivalent) and five years of Principal Data Engineer experience
  • Master's degree in Computer Science, Engineering, IT, Information Systems (or foreign equivalent) and three years of Principal Data Engineer experience (alternative)
  • Designing and developing highly scalable BI and analytical solutions using data warehouse and data mart methodologies in financial services environments
  • Hands-on experience with AWS and Snowflake for cloud data solutions
  • Developing Oracle databases and PL/SQL stored procedures
  • Experience with Informatica (including Informatica Data Quality IDQ) and AddressDoctor for data quality
  • Build and maintain CI/CD pipelines using Jenkins, Jenkinscore, Stash, Concourse, Artifactory, Bitbucket, and GitHub
  • Develop ETL and real-time big data solutions using Hadoop, Hive/Impala, Kafka, Scala, Spark SQL, and Python
  • Docker/container experience and Unix shell scripting for automation and scheduling
  • Create and manage Control-M jobs to automate and schedule processes
  • Apply Test-Driven Development (TDD) practices using JUnit and performance testing with JMeter
  • Use observability tools such as Datadog and apply SLO/SLI concepts for reliability
  • Familiarity with data catalog and governance tools Alation and Collibra
  • Experience working in Agile environments (Kanban, Scrum) delivering software through full SDLC

Fidelity Investments Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Fidelity Investments and has not been reviewed or approved by Fidelity Investments.

  • Strong & Reliable Incentives Bonuses, commissions, and profit-sharing are presented as generous and meaningful components of total compensation, with certain roles achieving high total earnings through multiple pay streams. Variable pay is consistently framed as a positive contributor beyond base salary.
  • Retirement Support A 401(k) match up to 7% alongside additional profit-sharing up to 10% materially enhances long-term compensation. These retirement features are highlighted as standout strengths of the overall package.
  • Parental & Family Support Generous paid parental leave (16 weeks maternity, 12 weeks parental), backup dependent care, and adoption assistance provide robust family support. Hybrid work and caregiving resources further ease family responsibilities.

Fidelity Investments Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, MA
58,848 Employees
Year Founded: 1946

What We Do

At Fidelity, our goal is to make financial expertise broadly accessible and effective in helping people live the lives they want. We do this by focusing on a diverse set of customers: - from 23 million people investing their life savings, to 20,000 businesses managing their employee benefits to 10,000 advisors needing innovative technology to invest their clients’ money. We offer investment management, retirement planning, portfolio guidance, brokerage, and many other financial products. Privately held for nearly 70 years, we’ve always believed by providing investors with access to the information and expertise, we can help them achieve better results. That’s been our approach- innovative yet personal, compassionate yet responsible, grounded by a tireless work ethic—it is the heart of the Fidelity way.

Similar Jobs

Bank of America Logo Bank of America

Principal Engineer

Big Data • Fintech • Mobile • Payments • Financial Services • Data Privacy
In-Office
Charlotte, NC, USA
208000 Employees

CrowdStrike Logo CrowdStrike

Data Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
7 Locations
10000 Employees
195K-320K Annually

General Dynamics Information Technology Logo General Dynamics Information Technology

Data Engineer

Aerospace • Information Technology • Professional Services • Security • Software
Hybrid
Fort Bragg, NC, USA
21625 Employees
145K-196K Annually

Photon Logo Photon

Data Engineer

Agency • Information Technology
In-Office or Remote
2 Locations
5017 Employees
36K-127K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account