Sr. Software Engineer - Big Data

Posted Yesterday
San Francisco, CA, USA
Hybrid
130K-197K Annually
Senior level
Big Data • Cloud • Marketing Tech • Social Impact • Software
LiveRamp makes it safe and easy for companies to use data effectively—and needs brilliant people to make it happen.
The Role
Lead the design, implementation, modernization, and optimization of large-scale big data systems processing trillions of identity graph connections. Develop batch processing solutions, REST APIs, and scalable applications using Spark, cloud platforms, and modern infrastructure tools. Collaborate with product managers and engineering teams while emphasizing performance, reliability, security, privacy, compliance, and cost effectiveness.
Summary Generated by Built In

LiveRamp is shaping the future of responsible data collaboration between the world’s leading brands, retailers, financial services providers, and healthcare innovators. As consumers embrace new AI-driven experiences, the LiveRamp data collaboration network exponentially expands the breadth and accuracy of the data on which marketing AI capabilities operate, powering deeper customer insight and measurable performance on a global scale. LiveRamp is headquartered in San Francisco, California, with offices worldwide. Learn more at LiveRamp.com.

We on the Identity Engineering team maintain the graph processing engine that connects the trillions of different identifiers for consumers and the devices they use online. Help us process this trillion edge graph as quickly and efficiently as possible.

We handle product requests and enhancements, focusing on scalability, modernization, performance, cost, security, legal compliance, reliability, and quality. Projects include architectural refreshes like POCs for batch data processing, developing new REST APIs, and migrating applications to Spark and SingleStore. These initiatives aim to improve processing speed, scalability, maintainability, and cost-effectiveness.

You will:
  • Lead complex problems, by breaking into their essential components, design and implement elegant solutions focussing on value delivered.

  • Deliver on the problems problems by collaborating with the team and cross functional teams

  • Modernize our applications to be modular, scalable by leveraging the latest stack

  • Collaborate closely with product managers, and other engineers to deliver high-quality software

  • Design with privacy and security-first principles and err on the side of shipping fast and iterating.

About you:
  • 6+ years of professional software development experience, primarily focused on big data technologies.

  • 3+ years of experience writing and optimizing large-scale batch processing using Spark/Hadoop or similar

  • 3+ years of Java , SQL programming skills

  • 2+ years of experience using cloud based platforms such as GCP, AWS, Azure or similar technologies.

  • Experience with technologies like Docker, Terraform and/or Kubernetes

  • Startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive.

Preferred Qualifications:
  • Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam

  • Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle

  • Experience with designing and implementing interfaces and infrastructure for large scale systems and RESTful APIs

The approximate annual base compensation range is $130,000 to $196,500. The actual offer, reflecting the total compensation package and benefits, will be determined by a number of factors including the applicant's experience, knowledge, skills, and abilities, geography, as well as internal equity among our team.

We use automated decision systems (ADS) as part of our recruitment and hiring process. If you require an accommodation or believe that the use of an ADS may create a barrier to your application or participation in the hiring process due to a disability or other protected characteristic, please let us know. We are committed to providing reasonable accommodations and ensuring an equitable hiring experience for all candidates.

To all recruitment agencies: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.

Skills Required

  • 6+ years of professional software development experience, primarily focused on big data technologies
  • 3+ years of experience writing and optimizing large-scale batch processing using Spark, Hadoop, or similar technologies
  • 3+ years of Java programming experience
  • 3+ years of SQL programming experience
  • 2+ years of experience using cloud-based platforms such as GCP, AWS, Azure, or similar technologies
  • Experience with Docker, Terraform, and/or Kubernetes
  • Experience with GCP products such as BigTable, BigQuery, Dataproc, and PubSub, or data tools such as Kafka, Hive, or Apache Beam
  • Experience with Terraform, Kubernetes, Helm, or Gradle
  • Experience designing and implementing interfaces and infrastructure for large-scale systems and RESTful APIs
  • Collaborative, ethical, hardworking, productive, and adaptable startup-oriented approach

LiveRamp Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about LiveRamp and has not been reviewed or approved by LiveRamp.

  • Retirement Support — Retirement programs include a dollar‑for‑dollar 401(k) match up to 6% with no vesting. Feedback suggests this level of matching is stronger than many peers and a clear financial pillar.
  • Healthcare Strength — Health coverage offers multiple employer‑verified medical, dental, and vision options, alongside disability coverage and other core protections. Feedback suggests the breadth and depth of plan choices are well‑regarded in the U.S.
  • Parental & Family Support — Paid parental bonding leave for all new parents is available, with additional resources such as backup care and family‑forming support. Feedback suggests these offerings materially support caregiving needs and work‑life balance.

LiveRamp Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
1,190 Employees
Year Founded: 2011

What We Do

Those who want to make a lasting impact in all that they do will find a home at LiveRamp—an inclusive, collaborative environment where exceptional talent is nurtured and championed. If you love collaborating with great people to solve complex problems and champion innovative ideas, view our career opportunities and consider joining our team!

Similar Jobs

tvScientific Logo tvScientific

Senior Software Engineer

AdTech • Marketing Tech
In-Office or Remote
San Francisco, CA, USA
137 Employees
124K-255K Annually

ZipRecruiter Logo ZipRecruiter

Senior Software Engineer

Big Data • HR Tech • Mobile • Software • Database
In-Office or Remote
Santa Monica, CA, USA
1100 Employees
140K-200K Annually

Dynatrace Logo Dynatrace

Practitioner Engagements Program Lead

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Remote or Hybrid
United States
5600 Employees
148K-185K Annually

ServiceNow Logo ServiceNow

Staff Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Mountain View, CA, USA
29000 Employees
167K-291K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account