Senior Data Engineer.

Posted Yesterday
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
Hybrid
Senior level
Fintech • Financial Services
Wells Fargo: Tech-powered. Innovation-led. We're transforming financial services.
The Role
Lead design, build, and delivery of large-scale batch and streaming data pipelines and lakehouse systems. Optimize Spark workloads, implement data quality, observability and governance, develop APIs and CI/CD automation, and mentor engineers while collaborating with cross-functional teams and ensuring compliance for financial data workflows.
Summary Generated by Built In
About this role:
Wells Fargo is seeking a Senior Software Engineer - Data Engineering
In this role, you will:
  • Lead moderately complex initiatives and deliverables within technical domain environments
  • Contribute to large scale planning of strategies
  • Design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments
  • Review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures
  • Resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements
  • Collaborate and consult with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals
  • Lead projects and act as an escalation point, provide guidance and direction to less experienced staff
Required Qualifications:
  • 4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Desired Qualifications:
  • Design, build, test, deploy, and maintain large-scale structured and unstructured data pipelines using Python, SQL, Apache Spark, and modern data lake/lakehouse technologies.
  • Develop and optimize metadata-driven pipelines, wrappers, ingestion frameworks, and validation layers to support GFCM data workflows.
  • Build and maintain high-quality ELT/ETL pipelines following best practices in reliability, performance, observability, and reusability.
Distributed Computing & Lakehouse Engineering
  • Engineer and optimize Spark pipelines for large-scale batch and streaming workloads (partitioning, caching, Catalyst optimization, AQE, Tungsten).
  • Work with open table formats such as Iceberg, Delta, or Hudi for versioned data, time-travel, compaction, and schema evolution.
  • Implement Medallion (Bronze/Silver/Gold) architecture patterns for modern lakehouse systems.
Data Quality, Testing & Observability
  • Implement automated data quality frameworks using tools such as Great Expectations / Deequ or custom validators.
  • Build data health monitoring frameworks with SLAs/SLOs, anomaly detection, and lineage capture.
  • Ensure strong validation layers during Data Center exits, migration programs, and DPC onboarding.
API & Microservice Development
  • Build RESTful and metadata APIs using Python frameworks (FastAPI/Flask) to enable secure, governed data access.
  • Collaborate with application teams to integrate data access patterns and platform services.
Cloud & Platform Engineering
  • Design and deploy data pipelines in cloud platforms (AWS, Azure, GCP) leveraging managed compute, orchestration, and storage.
  • Build CI/CD workflows and infrastructure automation using Jenkins, GitHub Actions, Azure DevOps, Terraform, or Helm.
  • Apply secure engineering principles including IAM, secrets management, encryption standards, and network controls.
Orchestration & Scheduling
  • Build resilient orchestration flows using Autosys or equivalent tools.
  • Apply modular design with retries, alerts, SLAs, and workflow dependency management.
Collaboration & Delivery
  • Work with cross-functional Agile teams (Product, Architecture, QA, Treasury SMEs).
  • Analyze technical requirements, evaluate design alternatives, and provide recommendations aligned with enterprise standards.
  • Independently deliver complex engineering tasks and contribute to architecture/roadmap discussions.
Job Expectations:
  • 4+ years of hands-on experience with Python, SQL, and bash scripting for automation.
  • Strong experience building big data pipelines using Apache Spark, Hive, Hadoop.
  • Experience with Autosys/Airflow or similar orchestration tools.
  • Working knowledge of REST APIs, Object Storage, Dremio, and CI/CD pipelines.
  • Strong troubleshooting and problem-solving capabilities.
  • Solid foundation in data modeling (conceptual/logical/physical) and database design.
  • Experience architecting pipelines using distributed systems patterns (shuffle optimization, spill, broadcast, storage layouts).
  • Experience with streaming frameworks like Spark Structured Streaming or Apache Flink.
Data Lakehouse & Storage
  • Hands-on with optimization techniques: clustering, Z-ordering, vectorized IO (Parquet/ORC), compaction.
  • Experience implementing Medallion architectures and governed ingestion zones.
Data Quality & Governance
  • Knowledge of data governance platforms (Collibra, Alation, Purview).
  • Understanding of financial data controls, validation rules, reconciliation checks, and compliance (SOX/PCI).
  • Experience implementing lineage, observability, drift detection.
Platform & DevOps
  • Cloud-native engineering experience - serverless, managed Spark, event-driven architectures.
  • Familiarity with containerization (Docker, K8s) and workflow operators.
  • Strong experience implementing test automation for data pipelines (unit, contract, integration tests).
GenAI for Data Engineering
  • Applying GenAI for metadata extraction, data anomaly detection, automated documentation, or pipeline optimization.
Domain Expertise
  • Exposure to financial risk, treasury functions, or Collateral Management processes.
Posting End Date:
28 Jun 2026
*Job posting may come down early due to volume of applicants.
We Value Equal Opportunity
Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.
Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.
Applicants with Disabilities
To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo .
Drug and Alcohol Policy
Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.
Wells Fargo Recruitment and Hiring Requirements:
a. Third-Party recordings are prohibited unless authorized by Wells Fargo.
b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.

Skills Required

  • 4+ years of software engineering experience
  • 4+ years hands-on experience with Python, SQL, and bash scripting
  • Strong experience building big data pipelines with Apache Spark, Hive, and Hadoop
  • Experience with orchestration tools such as Autosys or Airflow
  • Working knowledge of REST APIs, object storage, Dremio, and CI/CD pipelines
  • Solid foundation in data modeling and database design
  • Experience with distributed systems patterns and streaming frameworks (Spark Structured Streaming or Flink)
  • Cloud experience deploying data pipelines on AWS, Azure, or GCP
  • Experience with CI/CD and infrastructure automation (Jenkins, GitHub Actions, Azure DevOps, Terraform, Helm)
  • Experience with Iceberg, Delta, or Hudi (open table formats)
  • Experience implementing automated data quality frameworks (Great Expectations, Deequ, or custom validators)
  • Familiarity with optimization techniques (clustering, Z-ordering, vectorized IO, compaction)
  • Knowledge of data governance tools (Collibra, Alation, Purview) and financial data controls (SOX/PCI)
  • Familiarity with containerization and orchestration (Docker, Kubernetes)
  • Experience applying GenAI to metadata, anomaly detection, or documentation
  • Exposure to financial risk, treasury, or collateral management processes

Wells Fargo Compensation & Benefits Highlights

  • Retirement Support The package includes a dollar‑for‑dollar 401(k) match on employee contributions up to 6% of eligible pay and access to a stock purchase plan with no brokerage or dividend reinvestment fees. This combination supports long‑term savings and ownership alongside salary.
  • Parental & Family Support The offering provides up to 16 weeks of paid parental leave for a primary caregiver, reimbursement up to a $35,000 lifetime maximum for adoption, surrogacy, and donor expenses, and backup child and adult care days. Additional paid critical caregiving leave underscores support for broader family needs.
  • Leave & Time Off Breadth Paid time off scales meaningfully with tenure, paired with up to 13 paid holidays annually and separate community‑service PTO. This breadth gives employees structured flexibility for rest, holidays, and volunteering.

Wells Fargo Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
205,000 Employees
Year Founded: 1852

What We Do

Wells Fargo & Company (NYSE: WFC) is a leading financial services company that has approximately $2.1 trillion in assets. We provide a diversified set of banking, investment and mortgage products and services, as well as consumer and commercial finance, through our four reportable operating segments: Consumer Banking and Lending, Commercial Banking, Corporate and Investment Banking, and Wealth & Investment Management. Wells Fargo ranked No. 33 on Fortune’s 2025 rankings of America’s largest corporations. Our technology professionals drive innovation, information security, and big data analytics while maintaining a network that handles more than 12 billion customer interactions a year. Join us! Are you looking for more? Find it here. At Wells Fargo, we're more than a financial services leader – we’re a global trailblazer committed to driving innovation, empowering communities, and helping our customers succeed. We believe that a meaningful career is much more than just a job – it’s about finding all of the elements to help you thrive, in one place. Living the Well Life means you’re supported in life, not just work. It means having robust benefits, competitive compensation, and programs designed to help you find work-life balance and well-being. You’ll be rewarded for investing in your community, celebrated for being your authentic self, and empowered to grow. And we’re recognized for it – Wells Fargo once again ranked in the top three – making us the #1 financial services employer – on the 2025 LinkedIn Top Companies list of best workplaces “to grow your career” in the U.S. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic. © 2026 Wells Fargo Bank, N.A. All rights reserved. Member FDIC.

Why Work With Us

We're known for our “Well Life” approach to supporting employees’ career aspirations, work-life balance, and mental and physical health. We ranked in the top 3 on the 2025 LinkedIn Top Companies list – and #1 among financial services companies – as the best workplace “to grow your career” in the U.S.

Gallery

Gallery
Gallery
Gallery
Gallery

Wells Fargo Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: 3 days a week
HQSan Francisco, CA
Bangalore, Bangalore
Belfast, GB
Bengaluru, Karnataka
Chandler, AZ
Charlotte, NC
Technology Center
Hyderabad, Telangana
Irving, TX
New York, NY
New York, NY
Phoenix, AZ
Learn more

Similar Jobs

Wells Fargo Logo Wells Fargo

Consultant

Fintech • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
205000 Employees

Wells Fargo Logo Wells Fargo

Consultant

Fintech • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
205000 Employees

Wells Fargo Logo Wells Fargo

Product Manager

Fintech • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
205000 Employees

Wells Fargo Logo Wells Fargo

Software Engineer

Fintech • Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
205000 Employees
159K-305K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account