Embrace this pivotal role as an essential member of a high performing team dedicated to reaching new heights in data engineering. Your contributions will be instrumental in shaping the future of one of the world's largest and most influential companies.
As a Lead Data Engineer at JPMorgan Chase within the Consumer & Community Banking in Connected Commerce Travel Technology Team, you are an integral part of an agile team that works to enhance, build, and deliver large-scale data collection, storage, access, and analytics in a secure, stable, and scalable way. Leverage your deep technical expertise and problem solving capabilities to lead and drive significant business impact and tackle a diverse array of challenges that span multiple data pipelines, data architectures, and other data consumers.
Job responsibilities
- Lead the design, development, and maintenance of robust, scalable cloud-based data processing pipelines and infrastructure, ensuring adherence to engineering standards, governance frameworks, and industry best practices.
- Architect and refine data models for large-scale datasets, optimizing for efficient storage, high-performance retrieval, and advanced analytics while upholding data integrity and quality.
- Partner with cross-functional teams to translate complex business requirements into effective, scalable data engineering solutions that drive organizational value.
- Champion a culture of innovation and continuous improvement, proactively identifying and implementing enhancements to data infrastructure, processing workflows, and analytics capabilities.
- Define and execute data strategy, including the development of enterprise data models and the management of end-to-end data infrastructure-from design and construction to installation and ongoing maintenance of large-scale processing systems.
- Drive data quality initiatives, ensure seamless data accessibility for analysts and data scientists, and maintain strict compliance with data governance and regulatory requirements.
- Align data engineering practices with business objectives, ensuring solutions are both technically sound and strategically relevant.
- Author, review, and approve technical requirements and architectural designs, and lead process re-engineering efforts to deliver cost-effective, high-impact business solution
Required qualifications, capabilities, and skills
- Expert in at least two programming languages (Python, and Java)
- Expert in at least one distributed data processing framework (Spark)
- Expert in at least one cloud data Lakehouse platforms (AWS Data lake services or Databricks, if not Hadoop),
- Expert in at least one scheduling/orchestration tools ( Airflow, alternatively AWS Step Functions or similar)
- Expert with relational and NoSQL databases.
- Expert in data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), and big-data storage formats (Parquet, Iceberg, or similar)
- Proficiency in microservices architecture, serverless computing and distributed cluster computing tools such as Docker, Kubernetes etc.
- Proficiency in one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.)
- Experience with test-driven development (TDD) or behavior-driven development (BDD) practices, as well as working with continuous integration and continuous deployment (CI/CD) tools.
- Experience organizing and leading design workshops, coding sessions, and hackathons to promote a culture of excellence and innovation in data engineering.
- Expertise in architecting reusable, future-ready design patterns that address diverse use cases across the organization.
Preferred qualifications, capabilities, and skills
- Hands-on experience with Infrastructure as Code (IaC) tools, preferably Terraform; experience with AWS CloudFormation is also valued.
- Proficiency in cloud-based data pipeline technologies such as Fivetran, dbt, Prophecy.io, or similar platforms.
- Experience with front-end development frameworks, ideally React; familiarity with Angular is also beneficial.
- Strong working knowledge of the Snowflake data platform.
- Experience in budgeting and resource allocation for data engineering projects.
- Proven ability to manage vendor relationships effectively.
Top Skills
What the Team is Saying
What We Do
JPMorgan Chase & Co. (NYSE: JPM) is a leading global financial services firm with assets of $3.7 trillion and operations worldwide. The firm is a leader in investment banking, financial services for consumers and small businesses, commercial banking, financial transaction processing, and asset management. A component of the Dow Jones Industrial Average, JPMorgan Chase & Co. serves millions of consumers in the United States and many of the world’s most prominent corporate, institutional and government clients under its J.P. Morgan and Chase brands.
Technology fuels every aspect of our company and is at the heart of everything we do. With over 50,000 technologists globally and an annual tech spend of $12 billion, we are dedicated to improving the design, analytics, development, coding, testing and application programming that goes into creating high quality software and new products.
Learn more about technology at our firm, explore resources from our Distinguished Engineers, AI & ML researchers, and other experts; access the latest episode of our TechTrends podcast, and more at www.jpmorgan.com/technology. Information about JPMorgan Chase & Co. is available at www.jpmorganchase.com.
©2023 JPMorgan Chase & Co. All rights reserved. JPMorgan Chase is an Equal Opportunity Employer, including Disability/Veterans.
Why Work With Us
Our technologists work on a diverse range of solutions that include strategic technology initiatives, big data, mobile, electronic payments, machine learning, cybersecurity, enterprise cloud development, and other state-of-the-art technologies.
Gallery
JPMorganChase Teams
JPMorganChase Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
