Staff Systems Engineer - Big Data Platform & Cloud Engineering

Reposted 5 Days Ago
Be an Early Applicant
Singapore
In-Office
Senior level
Fintech • Information Technology • Payments
Join a world leader in payments and technology!
The Role
As a Staff Systems Engineer, you will design, manage, and optimize Hadoop and Kafka clusters on cloud platforms, ensuring high performance and reliability while developing tools for system monitoring and analysis.
Summary Generated by Built In
Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce. We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second across 80M merchants, 15k Financial Institutions, and billions of everyday people. While working with us you’ll get to work on complex distributed systems and solve massive scale problems centered on new payment flows, business and data solutions, cyber security, and B2C platforms.

The Opportunity:

As a Staff Site Reliability Engineer in Product Reliability Engineering, you will be part of a team that maintains and support Open Source Hadoop,Big data ,Kafka Platforms, Cloud ensuring their availability, performance, reliability, and improving operational efficiency. You will be responsible for driving innovation for our partners and clients, within Visa and globally.

The Work itself:

Essential Functions:

· Design, build and manage Hadoop and Kafka clusters on Cloud - AWS, GCP and Azure.

· Manage and optimize Open Source Apache Hadoop,Big Data and Kafka clusters for high performance, reliability, and scalability.

· Develop tools and processes to monitor and analyze system performance and to identify potential issues.

· Collaborate with other teams to design and implement Solutions to improve reliability and efficiency of the in-premise Hadoop, Big data  and cloud platforms.

· Effective root cause analysis of major production incidents and the development of learning documentation.

· The role involves planning and performing capacity expansions and upgrades in a timely manner to avoid any scaling issues and bugs.

· The successful candidate will tune alerting and set up observability to proactively identify issues and performance problems.

· The role involves creating standard operating procedure documents and guidelines on effectively managing and utilizing the platforms.

 The person will leverage DevOps tools, disciplines (Incident, problem, and change management), and standards in day-to-day operations.

· The individual will concentrate on developing tool and automations to minimize manual effort. This can be achieved through Ansible, Python, Java  scripting, or by using any other programming language.

 The Skills You Bring:

· Energy and Experience: A growth mindset that is curious and passionate about technologies and enjoys challenging projects on a global scale.

·  Challenge the Status Quo: Comfort in pushing the boundaries, “hacking” beyond traditional solutions.

·  Language Expertise: Expertise in one or more general development languages (e.g., Java, python) or full stack development

·  Learner: Constant drive to learn new technologies

· Partnership: Experience collaborating with Engineering, Application and Other functional teams.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Basic Qualifications
·5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.

Preferred Qualifications:
· 5 or more years of work experience with a Bachelors Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD
· Experience with managing and optimizing Hadoop, Big Data and Kafka clusters in production environment
· Demonstrated experience with AWS EMR , MSK and GCP Hadoop and Kafka cloud platforms
· Proficient in one of programming languages Python, Java or full stack development.
· Familiarity with big data tools (Spark, Kafka, etc.) and frameworks (HDFS, MapReduce, etc.).
· Strong knowledge in system architecture and design patterns for high-performance computing.
· Good understanding of data security and privacy concerns.
· Excellent problem-solving and troubleshooting skills.
· Strong communication and collaboration skills.
· Observability: knowledge on observability tools like Grafana, Opera and Splunk.
· Linux: understanding of Linux, networking, CPU, memory, and storage.
· Communication: Excellent interpersonal skills, along with superior verbal and written communication abilities.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Top Skills

Ansible
AWS
Azure
GCP
Grafana
Hadoop
Java
Kafka
Python
Spark
Splunk
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
26,500 Employees
Year Founded: 1958

What We Do

At Visa, we are driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. As our products and technology have evolved with the world, Visa remains ubiquitous, reaching new customers in new and often invisible ways. We are at the center of this digital revolution with a network that connects people with over 80 million businesses all over the world. And Visa’s network is expanding, accelerating our growth. Our resilient business model, with its strong track record of success, will provide you with amazing opportunities to grow in your career, as well.

We are looking for people like YOU. Come join a people-centric company where you can invest in your career.

For more information, visit visa.com/about, visacorporate.tumblr.com and @VisaNews on Twitter.

Why Work With Us

Our employees are our company. Creating an inclusive and diverse workplace has been our key priority. With our purpose to “uplift everyone, everywhere” as our guide, we’re building an environment where diverse backgrounds and perspectives are celebrated and drive success inside our company and out in our communities.

Gallery

Gallery

Similar Jobs

Xero Logo Xero

Customer Training Manager - Asia

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
Singapore, SGP
4500 Employees

WISE Logo WISE

Counsel

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Singapore, SGP
6000 Employees

Adyen Logo Adyen

Counsel

Fintech • Payments • Financial Services
Easy Apply
Hybrid
Singapore, SGP
4568 Employees

Airwallex Logo Airwallex

Information Technology Engineer

Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
In-Office
3 Locations
1800 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
40 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account