11. Data Engineer

Posted 7 Days Ago
Be an Early Applicant
Gurugram, Haryana
5-7 Years Experience
Fintech • Payments • Financial Services
The Role
As a Data Engineer, you will design, develop, and maintain scalable data ingestion pipelines and optimize large scale data pipelines. You'll implement data processing workflows and collaborate with teams for seamless data flow while following best practices for data governance and security.
Summary Generated by Built In


About PayPay India 

PayPay, a fintech company providing a service enjoyed by over 63 million users (as of April 2024) merely 5 years since its launch in 2018 in Japan. The company is now home to a very diverse team of members from more than 50 countries. We grew to a team of several thousand employees in Japan but are far from over. We are still in the Day 1. Every day, new members join us from all over the world to create new value and deliver it to society.

 

 

 

 

Why India ?

To build our Payment services, we got technical cooperation from Paytm (A large payment service company in India). And based on their customer-first technologies , we created and expanded the smartphone payment service in Japan. Therefore, we have decided to establish a development base in India, because it is a major IT country with many talented engineers, as evidenced by the fact that cutting-edge mobile payments can continue to be generated.

OUR VISION IS UNLIMITED

We dare to believe that we do not need a clear vision to create a future beyond our imagination. PayPay will always stay true to our roots and realise a vision (future) that no one else can imagine by constantly taking risks and challenging ourselves. With this mindset, you will be presented with new and exciting opportunities on a daily basis and have the opportunity to grow and reach new dimensions that you could never have imagined.

 

Job Description

PayPay's growth is driving a rapid expansion of PayPay product teams and the need for a robust Data Engineering Platform to support our growing business needs is more critical than ever. The DaaS team’s responsibility is to design, implement, and operate this platform using cutting edge technologies such as Spark, Hudi, Delta Lake, Scala, and AWS suite of data tools.

We are looking for talented Data Engineers to join our team and help us scale our platform across the organizations.


Main Responsibilities

  • Design, develop, and maintain scalable data ingestion pipelines using AWS Glue, Step Functions, Lambda, and Terraform.
  • Optimize and manage large scale data pipelines to ensure high performance, reliability, and efficiency.
  • Implement data processing workflows using Hudi, Delta Lake, Spark, and Scala.
  • Maintain and enhance Lakeformation and Glue Data Catalog for effective data management and discovery.
  • Collaborate with cross-functional teams to ensure seamless data flow and integration across the organization.
  • Implement best practices for observability, data governance, security, and compliance.

Qualifications

  • 6+ years experience as a Data Engineer or in a similar role.
  • Hands-on experience with Apache Hudi, Delta Lake, Spark, and Scala.
  • Experience designing, building, and operating a DataLake or Data Warehouse.
  • Knowledge of Data Orchestration tools such as Airflow, Dagster, Prefect.
  • Strong expertise in AWS services, including Glue, Step Functions, Lambda, and EMR.
  • Familiarity with change data capture tools like Canal, Debezium, and Maxwell.
  • Experience with data warehousing tools like AWS Athena, BigQuery, Databricks.
  • Experience in at least one primary language (e.g. Scala, Python, Java) and SQL (any variant).
  • Experience with data cataloging and metadata management using AWS Glue Data Catalog, Lakeformation, or Unity Catalog.
  • Proficiency in Terraform for infrastructure as code (IaC).
  • Strong problem-solving skills and ability to troubleshoot complex data issues.
  • Excellent communication and collaboration skills.
  • Ability to work in a fast-paced, dynamic environment and manage multiple tasks simultaneously.



Top Skills

Java
Python
Scala
The Company
Minato, Tokyo
1,057 Employees
On-site Workplace
Year Founded: 2018

What We Do

PayPay, a FinTech company, that achieved more than 60M users within around 5 years since its launch in 2018 has hugely diversified employees who are from about 50 different countries. The number of employees by now is more than 1,000 staff members, and yet the company is still incomplete and at a growing stage.

To build "PayPay", we allied with Paytm, the biggest payment service company in India. Based on their customer-first technologies , we created and expanded the smartphone payment service in Japan.

Our biggest competitor is "cash". We are seeking for people who can accept this challenge positively, brush up the product at a tremendous speed that other companies could never achieve, and who are passionate about promoting and spreading such a financial life platform in a short time along with professionalism.

About our working style, we had introduced a new personnel system called WFA (Working From Anywhere*). At PayPay, we work fully remotely in Japan. Therefore, the working place or your living place doesn't matter. Even if you are living in a local area, the salary and benefit package will be at an international level while you enjoy working with world class colleagues. You will find such a way of working at PayPay! *This WFA policy is applicable only within Japan

Jobs at Similar Companies

Bectran, Inc Logo Bectran, Inc

Content Writer

Artificial Intelligence • Fintech • Information Technology • Machine Learning • Software • Automation
Schaumburg, IL, USA
51 Employees

MassMutual India Logo MassMutual India

Operations Assistant Manager - Pension Risk Transfer

Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana, IND

Energy CX Logo Energy CX

Strategic Account Executive

Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Easy Apply
Chicago, IL, USA
55 Employees

Similar Companies Hiring

Bectran, Inc Thumbnail
Software • Machine Learning • Information Technology • Fintech • Automation • Artificial Intelligence
Schaumburg, IL
51 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account