Senior Lead Software Engineer - Big Data

Posted Yesterday
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
Hybrid
Senior level
Financial Services
We’re one of the world’s biggest technology-driven companies
The Role
Leads engineering teams responsible for enterprise data platforms, warehouses, lakes, and production data solutions. Designs Databricks-based architectures, reusable ETL frameworks, batch and streaming pipelines, and secure AWS solutions. Oversees data modeling, governance, reporting accuracy, performance, cost, reliability, and incident resolution. Mentors engineers, sets technical direction, enforces software engineering practices, and drives responsible AI-assisted development, automation, testing, and operational improvements across the SDLC.
Summary Generated by Built In

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Senior Lead Software Engineer at JPMorganChase within the Commercial and Investment Bank and C360 Technology team,  you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. You will set the technical direction, build reusable frameworks and guide a team of engineers. You  also have a solid understanding of the broader software and application landscape that our data solutions integrate with.

Job responsibilities

  • Take full responsibility for the data platforms, including architecture, roadmap, reliability, cost, operational health and production support.
  • Mentor and guide engineers. Set technical direction, clear blockers quickly, delegate effectively and answer for the team's deliverables and code quality.
  • Architect and build data warehouse and data lake solutions on Databricks. Apply sound data modeling, history tracking and data organization practices so the data is well structured and ready for analytics.
  • Create reusable, configurable ETL and processing frameworks covering ingestion, transformation, data quality, reconciliation and auditability, and drive their adoption across teams.
  • Define and govern standard approaches for bringing data in from databases, files, APIs and event sources, covering both full and incremental loads and ship high-volume batch and streaming pipelines with Spark/PySpark and Kafka/Kinesis. Make sure they're reliable, resilient to failure and meet agreed service levels.
  • Tune performance and cost across Spark, Databricks, SQL engines and NoSQL stores. Design secure, resilient solutions on AWS using services such as S3, Glue, EMR, Lambda, Redshift and Athena.
  • Govern the models, aggregates and data marts behind reporting so that business and regulatory reports are accurate, reconciled, timely and fast.
  • Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.
  • Applies knowledge of tools within the Software Development Life Cycle toolchain, including approved AI-assisted development and automation capabilities, to improve the value realized by automation at scale.
  • Enforce modular design, code reviews, CI/CD, automated testing, monitoring and Git-based workflows. Work with application, API and UI teams, using your knowledge of the full software stack to shape integration decisions.
  • Promote reuse-first practices that use enterprise-authorized AI capabilities for design analysis, test generation, control validation and documentation. Validate all outputs, respect data sensitivity, and keep work traceable and auditable.


    Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Experience in data engineering with a track record of leading teams, mentoring engineers, removing obstacles and being accountable for delivery, platform stability and incident resolution.
  • Expertise in designing and developing data warehouses and data lakes on Databricks, with strong data modeling skills. Familiarity with Snowflake and comparable platforms such as Redshift, BigQuery or Azure Synapse.
  • Exceptional SQL skills, including complex queries, optimization and analytical problem solving on large datasets with solid grounding in reporting: business-friendly data layers, BI tools (e.g., Tableau, Power BI, QuickSight), dashboard performance, and accuracy controls.
  • Outstanding production-grade Python and PySpark, with clean, efficient, testable and maintainable code.
  • Mastery of data ingestion and processing designs, with a history of building enterprise ETL frameworks and running batch and streaming workloads.
  • Broad knowledge of relational databases (e.g., PostgreSQL, Oracle), NoSQL stores (e.g., DynamoDB, MongoDB, Cassandra) and AWS data services. You can tune performance across these technologies and choose the right one for each use case.
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.
  • A well-rounded understanding of software engineering and application development, including the SDLC, design principles, microservices, APIs (e.g., Spring Boot) and front-end concepts. You also troubleshoot well and know CI/CD and GitHub/Bitbucket workflows.
  • Experience using enterprise-authorized AI capabilities in engineering work. You review and validate AI-assisted outputs before using them, escalate when unsure, and follow data handling requirements.


    Preferred qualifications, capabilities, and skills

  • Infrastructure provisioning in AWS using Infrastructure as Code (e.g., Terraform, AWS CloudFormation).
  • Databricks and/or AWS certifications.
  • Hands-on experience with Snowflake, or with migrating data between platforms.
  • Experience with orchestration tools (e.g., Airflow) and with data governance and lineage tools.
  • Experience with containerization (Docker/Kubernetes) and in financial services or other regulated environments.

Skills Required

  • Formal training or certification in software engineering concepts
  • 5+ years of applied software engineering experience
  • Data engineering experience leading teams, mentoring engineers, and owning delivery, platform stability, and incident resolution
  • Experience designing and developing data warehouses and data lakes on Databricks
  • Strong data modeling skills
  • Familiarity with Snowflake or comparable platforms such as Redshift, BigQuery, or Azure Synapse
  • Exceptional SQL skills, including complex queries, optimization, and analytical problem solving on large datasets
  • Experience with reporting data layers, BI tools, dashboard performance, and accuracy controls
  • Production-grade Python and PySpark experience
  • Mastery of data ingestion and processing designs, enterprise ETL frameworks, and batch and streaming workloads
  • Knowledge of relational databases, NoSQL stores, and AWS data services
  • Experience tuning performance across databases and data technologies
  • Experience leading enterprise-authorized AI-assisted software development tools
  • Knowledge of responsible AI use, data sensitivity, secure handling, resiliency, and security controls
  • Understanding of SDLC, software design principles, microservices, APIs, front-end concepts, CI/CD, and Git workflows
  • AWS Infrastructure as Code experience using Terraform or AWS CloudFormation
  • Databricks or AWS certification
  • Hands-on Snowflake experience or experience migrating data between platforms
  • Experience with Airflow and data governance or lineage tools
  • Experience with Docker or Kubernetes
  • Experience in financial services or another regulated environment

JPMorganChase Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about JPMorganChase and has not been reviewed or approved by JPMorganChase.

  • Healthcare Strength — Medical coverage and wellness resources, including mental-health support and wellness incentives, are described as comprehensive and accessible; feedback suggests income-based contributions help keep care affordable.
  • Retirement Support — A dollar-for-dollar 401(k) match up to 5% of eligible pay, plus additional employer contributions in some cases, is highlighted as a strong pillar of financial security. Feedback suggests this structure is a notable advantage of the total rewards package.
  • Parental & Family Support — Up to 16 weeks of paid parental leave for all parents, along with fertility, adoption, surrogacy, childcare, and family-support resources, signals a family-forward approach. Feedback suggests these programs are a standout feature of the package.

JPMorganChase Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
289,097 Employees
Year Founded: 1799

What We Do

JPMorgan Chase & Co. (NYSE: JPM) is a leading global financial services firm with assets of $3.7 trillion and operations worldwide. The firm is a leader in investment banking, financial services for consumers and small businesses, commercial banking, financial transaction processing, and asset management. A component of the Dow Jones Industrial Average, JPMorgan Chase & Co. serves millions of consumers in the United States and many of the world’s most prominent corporate, institutional and government clients under its J.P. Morgan and Chase brands. Technology fuels every aspect of our company and is at the heart of everything we do. With over 50,000 technologists globally and an annual tech spend of $12 billion, we are dedicated to improving the design, analytics, development, coding, testing and application programming that goes into creating high quality software and new products. Learn more about technology at our firm, explore resources from our Distinguished Engineers, AI & ML researchers, and other experts; access the latest episode of our TechTrends podcast, and more at www.jpmorgan.com/technology. Information about JPMorgan Chase & Co. is available at www.jpmorganchase.com. ©2023 JPMorgan Chase & Co. All rights reserved. JPMorgan Chase is an Equal Opportunity Employer, including Disability/Veterans.

Why Work With Us

Our technologists work on a diverse range of solutions that include strategic technology initiatives, big data, mobile, electronic payments, machine learning, cybersecurity, enterprise cloud development, and other state-of-the-art technologies.

Gallery

Gallery

Similar Jobs

Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

Atlassian Logo Atlassian

Senior Forward Deployed Engineer, AI

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

Cloudflare Logo Cloudflare

Engineering Manager

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
India
4400 Employees

Cloudflare Logo Cloudflare

Account Executive

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
4400 Employees

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account