Sr Software Engineer - Hadoop Platform at Uber (San Francisco, CA)

| San Francisco, CA
Sorry, this job was removed at 8:38 p.m. (CST) on Thursday, February 10, 2022
Find out who's hiring in San Francisco, CA.
See all Developer + Engineer jobs in San Francisco, CA
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
The Hadoop Platform team aims to build the next generation of intelligent data services that will profoundly impact how we march towards the vision of Uber's data-driven, real-time marketplace. Our team builds libraries and distributed services around the Hadoop stack (Hive, Presto, HDFS, Kafka, ....) to ease user interaction with the Big Data world. We share them with the open-source community (e.g., Hudi or Marmaray).
The Data Ingestion team owns the platform that moves hundreds of TBs of data a day from thousands of data sources to Uber's data lake. The hundreds of PBs data ingested by the Data Ingestion platform is the source of truth for business analytics and insights at Uber, powering various data-driven decisions. The platform consists of Marmaray, built from the ground-up at Uber and various services and tooling to operate the Data ingestion platform at scale and to deliver new data to customers at lower latencies.
What you will do:
We are currently looking for a strong engineer to join the Data Ingestion team to
  1. Design and implement distributed solutions to make new data available faster for business analytical needs.
  2. Drive reliability and operational scalability improvements through design and automation - scaling with the ever-increasing data volume flowing through the systems and the number of data sources producing data, observability, and monitoring.
  3. Drive efficiency efforts for one of the largest consumers of Uber's Data Infrastructure.
  4. Collaborate with multiple partner teams to achieve these multi-faceted goals.

Basic Qualifications ----
  1. Bachelor's degree with 4+ years of experience.
  2. Strong problem solving and coding skills in at least one of Java / C++ / Python.
  3. Experience with developing, debugging, and shipping software products on large codebases.

Preferred Qualifications ----
  1. Masters or Ph.D. in Computer Science or related subject area.
  2. Experience designing and executing large-scale distributed applications.
  3. Experience with big data infrastructure tools and software such as Spark, HDFS, Yarn.
  4. Demonstrated experience working collaboratively in cross-functional teams.
  5. Passion for learning new technologies, domains, and challenging the status quo.
Read Full Job Description
Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • C#Languages
    • C++Languages
    • GolangLanguages
    • JavaLanguages
    • JavascriptLanguages
    • KotlinLanguages
    • PerlLanguages
    • PHPLanguages
    • PythonLanguages
    • RLanguages
    • RubyLanguages
    • ScalaLanguages
    • SqlLanguages
    • SwiftLanguages
    • GoLanguages
    • ReactLibraries
    • ReduxLibraries
    • Twitter BootstrapLibraries
    • ASP.NETFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • SparkFrameworks
    • TensorFlowFrameworks
    • AccessDatabases
    • Microsoft SQL ServerDatabases
    • MySQLDatabases
    • Google AnalyticsAnalytics
    • FigmaDesign
    • PhotoshopDesign
    • FigmaDesign
    • AsanaManagement
    • ConfluenceManagement
    • JIRAManagement
    • WordpressCMS
    • DocuSignCRM
    • SalesforceCRM
    • SplashCRM
    • SendGridEmail
    • Adobe CampaignLead Gen

An Insider's view of Uber

What’s the vibe like in the office?

When I went into the office for my final interview with Uber, I had the same feeling that I did when I stepped onto my college’s campus for the first time: it just felt like the right fit. The office was high-paced but also relaxed and you could immediately tell that people were friends and genuinely enjoyed being there.

Paige Sammarco

Account Executive, Uber Eats

What kinds of technical challenges do you and your team face?

One of the big challenges today with experimentation is around guaranteeing correctness, especially for small changes to ensure confidence in results. Was that change the cause of new behavior? Did other experiments get in the way? It all comes down to how accurately you can detect small changes within consumer behavior.

Azarias Reda

Head of Uber's Experimentation API team

What makes someone successful on your team?

"It’s not just about the individual contributor. The most successful people are the ones learning from others. On my team, I make sure that everyone shares best practices and we foster a collaborative culture. So when you’re on a call, you’re never really alone. And that applies to everyone."

Ali Faivus

Head of Mid-Market Sales

How do you empower your team to be more creative?

We make sure we don’t ship org structures, but rather aligned products. How can our products complement one another, building upon each other to achieve our primary goals? Whether it’s scheduling, routing, predictive analytics, or operational excellence, we are acting as one, and smartly leveraging our domains and strengths.

Joe Chang

Director of Engineering, Uber Freight

How does your team reward individual success?

I believe recognizing someone’s contributions are a big part of team play. On our weekly meetings, we always start with a shout-out, and it’s amazing how this simple topic stimulates the team to recognize small victories and accredit colleagues for their accomplishments. This brings our team together and fosters a more collaborative environment.

Silvia Penna

Sr Manager, Central Operations

More Jobs at Uber

Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
View Uber's full profileSee more Uber jobs