Principal Data Engineer

Reposted 9 Days Ago
Be an Early Applicant
Durham, NC
In-Office
Senior level
Fintech
The Role
Develops and maintains enterprise data warehousing and reporting platforms, migrates databases to AWS, builds CI pipelines, and provides ETL solutions.
Summary Generated by Built In
Job Description:

Position Description:

Develops enterprise data warehouse and reporting platforms using Oracle SQL and Amazon Web Services (AWS) -- S3, Aurora PostgresSQL, and Lambda. Migrates legacy on-premise databases to AWS Aurora PostgresSQL and Snowflake databases. Develops orchestration processes using Control-M or Autosys platforms. Builds and deploys applications using Continuous Integration (CI) pipelines – GitHub, Liquibase, Alembic, and AWS CodeCommit. Performs unit and integration testing using SQL queries, Python, Spark, and PySpark. Provides Extract Transform and Load (ETL) solutions by developing complex or multiple software applications. Develops reporting platform using Business Objects, Tableau, or PowerBI.

Primary Responsibilities:

  • Designs, implements, and maintains data structures, batch jobs, and interfaces to external systems.
  • Develops original and creative technical solutions to on-going development efforts.
  • Develops applications for multiple projects supporting several divisional initiatives.
  • Supports and performs all phases of testing leading to implementation.
  • Assists in the planning and conducting of user acceptance testing.
  • Develops comprehensive documentation for multiple applications supporting several corporate initiatives.
  • Responsible for post-installation validation and triaging of any issues.
  • Establishes project plans for projects of moderate scope.
  • Performs independent and complex technical and functional analysis for multiple projects supporting several initiatives.
  • Manages data services hosted on the operational data stores and file-based interfaces.
  • Confers with systems analysts and other software engineers/developers to design systems.
  • Gathers information on project limitations and capabilities, performance requirements, and interfaces.
  • Develops and oversees software system testing and validation procedures, programming, and documentation.

Education and Experience:

Bachelor’s degree  in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and five (5) years of experience as a Principal Data Engineer (or closely related occupation) performing data analysis, data modeling, database tuning, Change Data Capture (CDC), and implementing data solutions in AWS and on prem data centers, using ETL tools.

Or, alternatively, Master’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent)  and three (3) years of experience as a Principal Data Engineer (or closely related occupation) performing data analysis, data modeling, database tuning, Change Data Capture (CDC), and implementing data solutions in AWS and on prem data centers, using ETL tools.

Skills and Knowledge:

Candidate must also possess:

  • Demonstrated Expertise (“DE”) performing data modeling, design, and development of Online Transaction Processing (OLTP)/Online Analytical Processing (OLAP) databases -- Oracle, Sybase, AWS RDS Postgres, MYSQL, and Databricks -- for enterprise or financial services, using SQL, PL/SQL, and Python.
  • DE building big data processing architecture using AWS Cloud Services -- S3, Lambda, EC2, EMR, IAM, KMS, Step Function, MWAA, Python CDK, and DMS; implementing ETL frameworks (Databricks Auto Loader) and Delta Live Tables (DLT) using orchestrator tools -- Autosys, Airflow, and Control-M; and performing monitoring of all data infrastructure using Grafana.
  • DE designing, developing, and supporting reporting and analytical dashboards to meet the needs of client service users and data scientists, using Tableau.
  • DE automating the deployment of database and applications through established Continuous Integration/Continuous Deployment (CI/CD) pipelines, using GitHub, Bitbucket, AWS Code Commit, Alembic, and Jenkins.

#PE1M2

#LI-DNI

Certifications:

Category:Information Technology

Most roles at Fidelity are Hybrid, requiring associates to work onsite every other week (all business days, M-F) in a Fidelity office. This does not apply to Remote or fully Onsite roles.

Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.

Top Skills

Alembic
Amazon Web Services
Aurora Postgressql
Autosys
Aws Codecommit
Business Objects
Control-M
ETL
Git
Lambda
Liquibase
Oracle Sql
Power BI
Pyspark
Python
S3
Spark
SQL
Tableau
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boston, MA
58,848 Employees
Year Founded: 1946

What We Do

At Fidelity, our goal is to make financial expertise broadly accessible and effective in helping people live the lives they want. We do this by focusing on a diverse set of customers: - from 23 million people investing their life savings, to 20,000 businesses managing their employee benefits to 10,000 advisors needing innovative technology to invest their clients’ money. We offer investment management, retirement planning, portfolio guidance, brokerage, and many other financial products.

Privately held for nearly 70 years, we’ve always believed by providing investors with access to the information and expertise, we can help them achieve better results. That’s been our approach- innovative yet personal, compassionate yet responsible, grounded by a tireless work ethic—it is the heart of the Fidelity way.

Similar Jobs

Wells Fargo Logo Wells Fargo

Principal Engineer

Fintech • Financial Services
Hybrid
3 Locations
205000 Employees
159K-305K Annually
In-Office
Durham, NC, USA
58848 Employees
In-Office
Durham, NC, USA
58848 Employees

The Hartford Financial Services Group, Inc. Logo The Hartford Financial Services Group, Inc.

Data Engineer

Fintech • Payments • Financial Services
In-Office
3 Locations
20002 Employees
168K-253K Annually

Similar Companies Hiring

Camber Thumbnail
Social Impact • Healthtech • Fintech
New York, NY
53 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
80 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account