Sr. Data Engineer (PySpark / Scala)

Posted 13 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
In-Office
Senior level
Fintech • Information Technology • Payments
Join a world leader in payments and technology!
The Role
The Sr. Data Engineer will develop scalable data pipelines using PySpark/Scala, manage Hadoop systems, and work with cloud platforms like AWS/Azure, while applying Agile and CI/CD practices.
Summary Generated by Built In
Company Description

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world.

Progress starts with you.

Job Description

  • Proficient in developing scalable data pipelines utilizing Spark (PySpark / Scala).
  • Demonstrated proficiency in Hadoop ecosystem.
  • Hands-on experience with distributed, scalable, concurrent, and low-latency systems, including database technologies like MySQL and NoSQL data warehouses such as HBase.
  • Experience working with Docker and Kubernetes.
  • Experience working with cloud platforms such as AWS or Azure.
  • Knowledge of GenAI and agentic frameworks is advantageous.
  • Experience working in an Agile and Test-Driven Development environment.
  • Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Selenium, Chef desirable.
  • Strong on driving for results and self-motivated, strong learning mindset, with good understanding of related advanced/new technology.
  • Keep up with the technology development in the related areas in the industry, which could be leveraged to enhance current architectures and build durable new ones.
  • Strategic thinker and good business acumen to orient data engineering to the business needs of internal clients.
  • Demonstrated intellectual and analytical rigor, strong attention to detail, team oriented, energetic, collaborative, diplomatic, and flexible style.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Bachelor degree in a technical field such as computer science, computer
engineering or related field required
5+ years of software development experience (with a concentration in data
centric initiatives), with demonstrated expertise in leveraging standard
development best practice methodologies
Minimum of 3 years of hands-on expertise with Spark (PySpark / Scala), Hadoop and related technologies

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Top Skills

Artifactory
AWS
Azure
Chef
Docker
Git
Hadoop
Hbase
Jenkins
Kubernetes
MySQL
NoSQL
Pyspark
Scala
Selenium
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
33,000 Employees
Year Founded: 1958

What We Do

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges,
growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters – to you, to your community, and to the world.

Progress starts with you

For more information, visit visa.com/about, @LifeatVisa Instagram, and @VisaNews on X.

Why Work With Us

At Visa, every voice powers progress. We believe inclusion fuels innovation — and that unique perspectives create better outcomes for our teams, our business, and the world we serve. With more than 13K members across our Employee Resource Groups, you’ll find community, allyship, and opportunities to lead, learn and make an impact beyond your desk.

Gallery

Gallery

Similar Jobs

Zscaler Logo Zscaler

Staff Threat Researcher - Malware Analysis, Reverse Engineering

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Hybrid
4 Locations
8697 Employees

BlackLine Logo BlackLine

Senior Site Reliability Engineer

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Remote or Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
1810 Employees

MetLife Logo MetLife

Software Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
India
43000 Employees

MetLife Logo MetLife

Unit Manager - Data Governance

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
India
43000 Employees

Similar Companies Hiring

Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
80 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Citizens Bank Thumbnail
Fintech
US
17000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account