Sr. Data Engineer (Python, Spark, Hadoop, Hive, 4-7 years' experience)

Reposted 4 Days Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka
In-Office
Senior level
Fintech • Information Technology • Payments
Join a world leader in payments and technology!
The Role
This role involves designing and developing data solutions, managing ETL pipelines using big data technologies while ensuring data quality and security.
Summary Generated by Built In
Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa is seeking highly energetic, passionate, technology enthusiast for Data Engineering team.

The successful candidate will work as a Senior Data Engineer and be part of the Risk Solution Services team to design and develop solutions for all data requirements. The ideal candidate will bring robust technical strength in developing solutions in extremely high volume, low latency ETL workflow design and also bring an excellent understanding of data. This role will participate in design discussions, create solutions, develop programs and ensure successful delivery of business capabilities. This role will assume technical ownership of multiple applications and create robust and scalable solutions.
 Visa provides a challenging environment of volume, velocity and variety that is rarely matched.

Candidates looking forward to thrive in such environment are encouraged to apply.

Responsibilities:

  • Experience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark)
  • Responsible for the implementation and test of scalable distributed ensuring security, timeliness and quality of data.
  • Experience supporting production systems
  • Work closely with other engineers and peers to design and develop ETL pipelines
  • Work with product managers in understanding and clarifying on the requirements
  • Demonstrate inclination towards continuous learning and professional development.
  • Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment.

This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications

  • 5+ years of relevant work experience and Bachelors degree or with an Advanced Degree
  • 4+ years of experience in Hadoop using Core Java Programming, Scala, Spark, Kafka, Hive on Linux/Unix environment.
  • Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
  • Experience in writing Spark and Hive code to process large data sets in Hadoop environments
  • Strong experience with SQL for extracting, aggregating, and processing big data using Hadoop
  • Development experience in one or more of the following: Scala, Python or Java.
  • Basic experience with Unix/Shell or Python scripting
  • Exposure to Scheduling tools like Airflow and Control – M will be a plus
  • Experience using VCS like Git
  • Basic understanding of RDBMs viz, MS SQL, DB2, Oracle, etc. for data retrieval
  • Understanding of Kafka, Apache Hudi is a plus.
  • Thrive in self-motivated internal innovation driven environment.
  • Adapting fast to new application knowledge and changes.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Top Skills

Airflow
Git
Hadoop
Hive
Kafka
Python
Scala
Spark
SQL
Unix
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
26,500 Employees
Year Founded: 1958

What We Do

At Visa, we are driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. As our products and technology have evolved with the world, Visa remains ubiquitous, reaching new customers in new and often invisible ways. We are at the center of this digital revolution with a network that connects people with over 80 million businesses all over the world. And Visa’s network is expanding, accelerating our growth. Our resilient business model, with its strong track record of success, will provide you with amazing opportunities to grow in your career, as well.

We are looking for people like YOU. Come join a people-centric company where you can invest in your career.

For more information, visit visa.com/about, visacorporate.tumblr.com and @VisaNews on Twitter.

Why Work With Us

Our employees are our company. Creating an inclusive and diverse workplace has been our key priority. With our purpose to “uplift everyone, everywhere” as our guide, we’re building an environment where diverse backgrounds and perspectives are celebrated and drive success inside our company and out in our communities.

Gallery

Gallery

Similar Jobs

Hybrid
Bengaluru, Karnataka, IND
289097 Employees
Hybrid
Bengaluru, Karnataka, IND
289097 Employees
Hybrid
Bengaluru, Karnataka, IND
289097 Employees
Hybrid
Bengaluru, Karnataka, IND
289097 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
40 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account