Lead Software Engineer Data Engineering AWS Data bricks

Reposted 4 Days Ago
Be an Early Applicant
Hyderabad, Telangana
Hybrid
Senior level
Financial Services
We’re one of the world’s biggest technology-driven companies
The Role
The Lead Software Engineer will develop data solutions using AWS and Databricks, collaborate with teams on deployment strategies, and maintain data pipelines.
Summary Generated by Built In
Job Description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorgan Chase within Corporate Technology, you play a vital role in an agile team dedicated to enhancing, building, and delivering reliable, market-leading technology products in a secure, stable, and scalable manner. As a key technical contributor, you are tasked with implementing essential technology solutions across diverse technical domains, supporting various business functions to achieve the firm's strategic goals.
Job responsibilities
  • Develop appropriate level designs and ensure consensus from peers where necessary.
  • Collaborate with software engineers and cross-functional teams to design and implement deployment strategies using AWS Cloud and Databricks pipelines.
  • Work with software engineers and teams to design, develop, test, and implement solutions within applications.
  • Engage with technical experts, key stakeholders, and team members to resolve complex problems effectively.
  • Understand leadership objectives and proactively address issues before they impact customers.
  • Design, develop, and maintain robust data pipelines to ingest, process, and store large volumes of data from various sources.
  • Implement ETL (Extract, Transform, Load) processes to ensure data quality and integrity using tools like Apache Spark and PySpark.
  • Monitor and optimize the performance of data systems and pipelines.
  • Implement best practices for data storage, retrieval, and processing
  • Maintain comprehensive documentation of data systems, processes, and workflows.
  • Ensure compliance with data governance and security policies

Required qualifications, capabilities, and skills
  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Formal training or certification in AWS/Databricks with 10+ years of applied experience.
  • Expertise in programming languages such as Python and PySpark.
  • 10+ years of professional experience in designing and implementing data pipelines in a cloud environment.
  • Proficient in design, architecture, and development using AWS Services, Databricks, Spark, Snowflake, etc.
  • Experience with continuous integration and continuous delivery tools like Jenkins, GitLab, or Terraform.
  • Familiarity with container and container orchestration technologies such as ECS, Kubernetes, and Docker.
  • Ability to troubleshoot common Big Data and Cloud technologies and issues.
  • Practical cloud native experience

Preferred qualifications, capabilities, and skills
  • 5+ years of experience in leading and developing data solutions in the AWS cloud.
  • 10+ years of experience in building, implementing, and managing data pipelines using Databricks on Spark or similar cloud technologies

Top Skills

Spark
AWS
Databricks
Docker
Ecs
Gitlab
Jenkins
Kubernetes
Pyspark
Snowflake
Terraform

What the Team is Saying

Nick S.
Lupe C.
Edwin T.
Dawn T.
Meng M.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
289,097 Employees
Year Founded: 1799

What We Do

JPMorgan Chase & Co. (NYSE: JPM) is a leading global financial services firm with assets of $3.7 trillion and operations worldwide. The firm is a leader in investment banking, financial services for consumers and small businesses, commercial banking, financial transaction processing, and asset management. A component of the Dow Jones Industrial Average, JPMorgan Chase & Co. serves millions of consumers in the United States and many of the world’s most prominent corporate, institutional and government clients under its J.P. Morgan and Chase brands.

Technology fuels every aspect of our company and is at the heart of everything we do. With over 50,000 technologists globally and an annual tech spend of $12 billion, we are dedicated to improving the design, analytics, development, coding, testing and application programming that goes into creating high quality software and new products.

Learn more about technology at our firm, explore resources from our Distinguished Engineers, AI & ML researchers, and other experts; access the latest episode of our TechTrends podcast, and more at www.jpmorgan.com/technology. Information about JPMorgan Chase & Co. is available at www.jpmorganchase.com.

©2023 JPMorgan Chase & Co. All rights reserved. JPMorgan Chase is an Equal Opportunity Employer, including Disability/Veterans.

Why Work With Us

Our technologists work on a diverse range of solutions that include strategic technology initiatives, big data, mobile, electronic payments, machine learning, cybersecurity, enterprise cloud development, and other state-of-the-art technologies.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

JPMorganChase Teams

Team
Product + Tech
About our Teams

JPMorganChase Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
Company Office Image
HQNew York, NY
SG
Bengaluru, Karnataka
Bournemouth, GB
Buenos Aires, Avaya
Chicago, IL
Dallas, TX
Dublin, IE
Glasgow, GB
Houston, TX
Hyderabad, Telangana
London, GB
Mumbai, Maharashtra
New York, NY
Philadelphia, PA
San Francisco, CA
Tampa, FL
Westerville, OH
Wilmington, DE
Learn more

Similar Jobs

Hybrid
Hyderabad, Telangana, IND
289097 Employees
Hybrid
Hyderabad, Telangana, IND
289097 Employees
Hybrid
Hyderabad, Telangana, IND
289097 Employees
Hybrid
Hyderabad, Telangana, IND
289097 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account