Software Engineer - Big Data

Reposted 15 Days Ago
Be an Early Applicant
Hiring Remotely in Petah Tikva
In-Office or Remote
Senior level
Big Data
The Role
The Software Engineer will develop and maintain big data products, architecting solutions for large-scale data processing while ensuring minimal latency and storage efficiency.
Summary Generated by Built In
Description

Pipl is the identity trust company. Our solutions allow organizations to provide frictionless customer experiences and approve more transactions with greater confidence and speed. We use multivariate linking to establish deep connections among more than 330 billion trust signals—email, mobile phone and social media data that spans the globe—and then look at the big picture to derive identity trust. 

We're looking for a Software Engineer to play a key role in our Data Infrastructure team. If you have a passion for big-data and you enjoy tackling complex data challenges, this one's for you!

In your day-to-day, you'll define, shape, and evolve the architecture of large-scale data products. You'll be responsible for processing terabytes of data as well as building and maintaining production systems with sub-millisecond latency response time while targeting to reduce storage consumption as much as possible.

You will work with a strong team of big data developers. Additionally, you will be involved in researching, designing, and implementing robust systems that handle vast amounts of data, serving as the backbone of our search index. You'll also be part of a team that conducts POCs for new requirements and emerging technologies.


Requirements
  • 5 years of experience as Backend engineer
  • Strong understanding of data warehousing, data lakes, and big data technologies
  • Experience with Java, Spring and specifically with streaming
  • Experience with Python
  • Experience with different DBs - MySQL and key/value DBs
  • Experience with Google Cloud Platform (GCP) services such as BigTable, BigQuery, Cloud Dataflow, Cloud queue, and Cloud Dataproc, Google composer (Airflow)

Working at PIPL
None

Top Skills

BigQuery
Bigtable
Cloud Dataflow
Cloud Dataproc
Cloud Queue
Google Cloud Platform
Google Composer
Java
MySQL
Python
Spring
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Post Falls, ID
160 Employees
Year Founded: 2005

What We Do

Pipl is the identity trust company that makes sure no one pretends to be you. We do this by understanding the deep connections between the data elements that make up an identity and looking at the big picture. We analyze the relationships of many identifiers such as email, mobile-phone and social-media data that spans the globe.

Our identity resolution engine continuously collects, cross references and connects identity records to create data clusters across the internet and numerous exclusive sources. The result is a searchable index of more than 3.5 billion identity profiles comprising over 3.6 billion phone numbers and 1.7 billion email addresses, with coverage in more than 150 countries.

Our API and manual review solutions allow merchants to provide frictionless customer experiences and approve more transactions while reducing chargebacks and the risk of fraud.

Similar Jobs

ServiceNow Logo ServiceNow

Staff Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Petah Tikva, ISR
27000 Employees

ServiceNow Logo ServiceNow

Senior Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Petah Tikva, ISR
27000 Employees

HiBob Logo HiBob

Customer Success Manager

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Israel
1350 Employees

HiBob Logo HiBob

Architect

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Israel
1350 Employees

Similar Companies Hiring

MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana
Tastewise Thumbnail
Software • Retail • Generative AI • Food • Big Data Analytics • Big Data • Artificial Intelligence
NYC, NYC
120 Employees
Prolaio Thumbnail
Wearables • Mobile • Healthtech • Big Data • Artificial Intelligence • Analytics
Chicago, IL
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account