Principal Data Engineer

Reposted 6 Days Ago
Durham, NC, USA
In-Office
Senior level
Fintech
The Role
The Principal Data Engineer is responsible for designing, developing, and maintaining scalable BI solutions and data pipelines using various technologies in a financial services environment.
Summary Generated by Built In
Job Description:

Position Description:

Builds automation pipelines using DevOps concepts and Continuous Integration and Continuous Delivery (CI/CD) tools -- Jenkins, Stash, Concourse, and Artifactory. Develops Oracle SQL and PL/SQL stored procedures for relational databases. Develops new web based applications within cloud environments – Snowflake and Amazon Web Services (AWS). Designs, builds, and maintains reporting platforms. Writes codes with object-oriented programming languages -- Python/Spark. Performs shell scripting and scheduling using programming languages -- Python and Spark. Works in Agile environment executing projects using Kanban and SCRUM. Works with analysts to create profiles and rules for data quality using Informatica Data Quality IDQ tools and Address doctor.

Primary Responsibilities:

  • Responsible for designing, developing, testing, deploying, maintaining and improving customer-facing software solutions.
  • Performs test automation frameworks and standard methodologies to build a reliable product.
  • Designs and builds Extract, Transact, and Load (ETL) solutions while incorporating TEST automation frameworks in highly scalable distributed data processing systems.
  • Delivers software in an Agile environment.
  • Develops and maintains databases using principles of Database Warehousing and Data mart concepts.
  • Confers with systems analysts and other software engineers/developers to design systems and to obtain information on project limitations and capabilities, performance requirements, and interfaces.
  • Develops and oversees software system testing and validation procedures, programming, and documentation.

Education and Experience:

Bachelor’s degree in Computer Science, Engineering, Information Technology, Information Systems or a closely related field (or foreign education equivalent)  and five (5) years of experience as a Principal Data Engineer (or closely related occupation) designing and developing highly scalable Business Intelligence (BI) and analytical solutions in on-premise and Cloud platforms in a financial services environment using data warehouse and Data mart methodologies.

Or, alternatively, Master’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Principal Data Engineer (or closely related occupation)  designing and developing highly scalable Business Intelligence (BI) and analytical solutions in on-premise and Cloud platforms in a financial services environment using data warehouse and Data mart methodologies.

Skills and Knowledge:

Candidate must also possess:

  • Demonstrated Expertise (“DE”) designing and developing data warehouse applications according to business user requirements, using AWS services, Docker Container, Snowflake, Informatica, Oracle, PL/SQL, and Control-M; maintaining Continuous Integration/Continuous Delivery (CI/CD) pipelines for application code using Jenkins, Jenkinscore, Terracore, bitbucket, Github, and Concourse; developing Unix shell scripts; and creating Control-M jobs to automate and schedule end-to-end processes.
  • DE developing real time Big Data solutions on Hadoop, using Hive/Impala, Kafka, Scala, Spark SQL, and Python to build highly scalable and data availability platform to the end user.
  • DE participating and implementing all aspects of the Software Development Lifecycle (SDLC) in delivering innovative solutions according to financial services standards, security requirements, software development best practices, and Agile methodologies; and utilizing Alation and Collibra to efficiently catalog, analyze and govern data assets, ensuring data quality, compliance and informed decision-making across the organization.
  • DE performing Test-Driven Development (TDD), using JUnit; conducting performance testing using JMeter; Data profiling, and Data mining; troubleshooting issues using Datadog for Observability; and creating stable and highly available solutions, using Service Level Objectives (SLO) and Service Level Indicators (SLI) concepts.

#PE1M2

#LI-DNI

Certifications:

Category:Information Technology

Most roles at Fidelity are Hybrid, requiring associates to work onsite every other week (all business days, M-F) in a Fidelity office. This does not apply to Remote or fully Onsite roles. Some roles may have unique onsite requirements. Please consult with your recruiter for the specific expectations for this position.

Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.

Top Skills

Amazon Web Services
Artifactory
Concourse
Control-M
Datadog
Hadoop
Hive
Impala
Informatica
Jenkins
Jmeter
Junit
Kafka
Oracle Sql
Pl/Sql
Python
Scala
Snowflake
Spark
Stash
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, MA
58,848 Employees
Year Founded: 1946

What We Do

At Fidelity, our goal is to make financial expertise broadly accessible and effective in helping people live the lives they want. We do this by focusing on a diverse set of customers: - from 23 million people investing their life savings, to 20,000 businesses managing their employee benefits to 10,000 advisors needing innovative technology to invest their clients’ money. We offer investment management, retirement planning, portfolio guidance, brokerage, and many other financial products. Privately held for nearly 70 years, we’ve always believed by providing investors with access to the information and expertise, we can help them achieve better results. That’s been our approach- innovative yet personal, compassionate yet responsible, grounded by a tireless work ethic—it is the heart of the Fidelity way.

Similar Jobs

Citizens Logo Citizens

Data Engineer

Digital Media • Fintech • Information Technology • Machine Learning • Financial Services • Cybersecurity • Automation
In-Office or Remote
2 Locations
17000 Employees
150K-180K Annually
In-Office or Remote
4 Locations
5001 Employees
131K-175K Annually
In-Office
Durham, NC, USA
58848 Employees
In-Office
Durham, NC, USA
58848 Employees

Similar Companies Hiring

Rain Thumbnail
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
New York, NY
100 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account