Lead Cloud Data Engineer

Posted 3 Days Ago
3 Locations
In-Office
Senior level
Financial Services
The Role
Lead the design, development, optimization, and monitoring of scalable cloud data pipelines using AWS Glue, PySpark, and Amazon Redshift. Integrate diverse data sources, ensure data quality, deploy infrastructure with Terraform, and improve reliability, performance, and cost efficiency. Collaborate with data professionals and stakeholders, document architecture standards, ensure security compliance, mentor junior engineers, conduct code reviews, and evaluate AWS technologies. The role requires a bachelor’s degree, substantial cloud data engineering experience, and hybrid work in specified locations.
Summary Generated by Built In

Job Description Summary

We are seeking a highly skilled Lead Cloud Data Engineer to join our team. The ideal candidate will have extensive experience with AWS Glue, PySpark, and Amazon Redshift. You will be responsible for designing, implementing, and optimizing data pipelines, ensuring data quality, and collaborating with cross-functional teams to meet business needs.

Job Description

This position will follow our hybrid work model, we expect the selected candidate to be in office 2-3 days a week(10-12 days a month ) at the following office location: St. Petersburg, FL/ Memphis, TN/ Denver, CO/Southfield, MI

Responsibilities:

  • Design and develop scalable ETL pipelines using AWS Glue and PySpark.

  • Integrate data from various sources into Amazon Redshift, ensuring data quality and consistency.

  • Optimize the performance of data processing jobs and Redshift queries.

  • Deploy infrastructure as code (IaC) with Terraform

  • Monitor and troubleshoot data pipelines to ensure reliability and efficiency.

  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.

  • Ensure compliance with security policies and regulations.

  • Document data workflows and best practices.

  • Mentor and guide junior engineers on the team.

  • Continuously explore new AWS services and technologies to improve existing solutions.

Skills:

  • Expert level experience with AWS Cloud Services is preferred, knowledge of other Cloud Providers is a plus

  • Experience and understanding of AWS Cloud Services components like Redshift, S3, Kafka, Glue, AirFlow, SageMaker, EMR, Athena, Lake Formation, DynamoDB, Aurora, VPC,  IAM and many other Cloud Service modules.

  • Working experience in Python is preferred, Java and other languages are a plus

  • Nice to have Terraform or other Infrastructure as Code experience

  • Knowledge and experience with Analytics, Data Warehouse and Big Data concepts across both batch and streaming patterns

  • Solid understanding of networking, infrastructure, cost management, SRE concepts

  • Creating patterns for adoption from scratch and being able to document and articulate coding and architecture standards for others to follow.

  • Performance tuning and optimization of code and infrastructure

  • Creating a culture of continuous improvement, performs code reviews and makes recommendations for improvement or streamlining patterns

  • Relevant experience in various database platforms, ETL solutions/products, Infrastructure, ETL architecture and On-Prem or Cloud Services.

  • Financial Services Industry knowledge is a plus.

Ability to:

  • Identify and understand issues, problems and opportunities for automation.

  • Good communication and organization skills that clearly convey information and ideas through a variety of media to individuals or groups in a manner that engages the audience and helps them understand and retain the message.

  • Use effective approaches for choosing a course of action or developing appropriate solutions; recommend or take action that is consistent with available facts, constraints and probable consequences.

  • Demonstrate a satisfactory level of technical and professional skill or knowledge in position-related areas; remains current with developments and trends in areas of expertise.

  • Develop and use collaborative relationships to facilitate the accomplishment of work goals.

  • Make internal and external clients and their needs a primary focus of actions; develop and sustain productive client relationships.

Certifications
Preferred, not required
•    AWS Certified Solutions Architect
•    AWS Certified Big Data
•    AWS Certified Data Analytics
•    AWS Certified Developer
•    AWS Certified Machine Learning

Education

Bachelor’s: Computer and Information Science (Required)

Work Experience

General Experience - 6 to 10 years

Certifications

Travel

Less than 25%

Workstyle

Hybrid

The total compensation for this position includes base salary or wages, and may include components such as additional compensation (cash or equity), discretionary bonuses, or commissions. This position is eligible for a benefits package that may include medical, dental, and vision; life insurance; critical illness insurance and accident insurance; disability benefits; retirement savings; paid time off (including vacation, holidays, and sick leave); and parental leave.  Eligibility for benefits and specific offerings may vary based on position and employment status. To view more details of the benefits offered, visit Myrjbenefits.com.



At Raymond James our associates use five guiding behaviors (Develop, Collaborate, Decide, Deliver, Improve) to deliver on the firm's core values of client-first, integrity, independence and a conservative, long-term view. 
We expect our associates at all levels to:
•  Grow professionally and inspire others to do the same
•  Work with and through others to achieve desired outcomes
•  Make prompt, pragmatic choices and act with the client in mind
•  Take ownership and hold themselves and others accountable for delivering results that matter
•  Contribute to the continuous evolution of the firm

At Raymond James – as part of our people-first culture, we honor, value, and respect the uniqueness, experiences, and backgrounds of all of our Associates.  When associates bring their best authentic selves, our organization, clients, and communities thrive. The Company is an equal opportunity employer and makes all employment decisions on the basis of merit and business needs. 

#LI-SA1

Skills Required

  • Bachelor’s degree in Computer and Information Science
  • 6 to 10 years of general work experience
  • Experience with AWS cloud services
  • Experience with AWS Glue, PySpark, and Amazon Redshift
  • Experience with AWS services including S3, Kafka, Airflow, SageMaker, EMR, Athena, Lake Formation, DynamoDB, Aurora, VPC, and IAM
  • Working experience with Python
  • Knowledge of analytics, data warehouses, and big data concepts across batch and streaming patterns
  • Understanding of networking, infrastructure, cost management, and SRE concepts
  • Experience with database platforms, ETL solutions, ETL architecture, infrastructure, and on-premises or cloud services
  • Terraform or other infrastructure-as-code experience
  • Java or other programming languages
  • Financial services industry knowledge
  • AWS Certified Solutions Architect
  • AWS Certified Big Data
  • AWS Certified Data Analytics
  • AWS Certified Developer
  • AWS Certified Machine Learning
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: St. Petersburg, FL
14,491 Employees
Year Founded: 1962

What We Do

Founded in 1962 and a public company since 1983, Raymond James Financial, Inc. is a Florida-based diversified holding company providing financial services to individuals, corporations and municipalities through its subsidiary companies engaged primarily in investment and financial planning, in addition to capital markets and asset management. The firm's stock is traded on the New York Stock Exchange (RJF). Through its three broker/dealer subsidiaries, Raymond James Financial has approximately 8,400 financial advisors throughout the United States, Canada and overseas. Total client assets are $1.18 trillion (as of 9/30/2021). Raymond James has been recognized nationally for its community support and corporate philanthropy. The company has been ranked as one of the best in the country in customer service, as a great place to work and as a national leader in support of the arts.

Similar Jobs

In-Office or Remote
50 Locations
17989 Employees
118K-197K Annually

Zeta Global Logo Zeta Global

Paid Search Manager

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Remote or Hybrid
United States
2429 Employees
80K-90K Annually

Spectrum Logo Spectrum

Account Executive

Information Technology • Internet of Things • Mobile • On-Demand • Software
In-Office
Cookeville, TN, USA
100000 Employees

Bestow Logo Bestow

Customer Success Manager

Big Data • Fintech • Information Technology • Insurance • Software
Remote or Hybrid
US
160 Employees
107K-126K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account