Senior Software Engineer: Data Storage & Compute

| South Bay
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
About the role:
The Lakehouse Storage, Compute & Management Services team is part of the Data Platform team and is responsible for building the underlying storage, resource management and table management infrastructure (with Apache YARN, Kubernetes, Spark, Hudi, Parquet) for the entire company.
• Design systems architecture and deliver software and tools to advance the reliability of infrastructure including availability, performance, efficiency and scaling.• Provide technical leadership, influence and partner with fellow engineers to architect, design and build infrastructure that can stand the test of scale and availability, while reducing operational overhead.• Drive efficiencies in systems and processes through automation: capacity planning, configuration management, performance tuning, monitoring and root cause analysis.• Participate in periodic on-call rotations and be available for escalations.• Collaborate with platform, product and security engineering teams, and enable successful use of infrastructure and foundational services, and manage upstream and downstream dependencies• Partners with stakeholders and leads team efforts to build and maintain backend services and solutions to support user-facing products, downstream services, or infrastructure tools and platforms used across Uber
About the Team:
Uber is committed to delivering safer and more reliable transportation across our global markets. To accomplish this, Uber relies heavily on making data-driven decisions at every level, from forecasting rider demand during high traffic events to identifying and addressing bottlenecks in our driver-partner sign-up process. Over time, the need for more insights has resulted in over 100's of petabytes of analytical data that needs to be cleaned, stored, and served with minimum latency through our multilayered Data Platform architecture.
Since the beginning of Data engineering at Uber, we have worked to develop a Big Data platform that ensures data reliability, scalability, and ease-of-use, and are now focusing on increasing our platform's speed and efficiency Uber's Big Data Platform: 100+ Petabytes with Minute Latency.
This team manages more than 20,000+ node clusters to serve exabyte storage that supports scheduling compute resources for 500k+ data process applications daily. We implement and support a storage platform that manages Uber's exabyte Lakehouse that provides ingestion and query engine API's that facilitate management of 10K+ tables and millions of queries a week. Additionally, our team builds and manages self service table management services that allow for data encryption, data deletions, data sorting and other kinds of use-cases for all of Uber.
Minimum qualifications:
• Masters or equivalent in Computer Science, Engineering, Mathematics or related field with 2-years of experience OR 4-years of full-time Software Engineering work experience.
• Highly proficient in one of the following programming languages: Java, Go, C/C++. Good scripting skills and ability to pick up new ones.• Systematic problem solving approach and knowledge of algorithms, data structures and complexity analysis.• A love for coding, debugging and attacking hard problems.• Good working knowledge of networking and RPC stack (TCP/IP, HTTP, Thrift).• Good working knowledge of distributed caching, storage and indexing systems.• Grit, drive and a strong sense of ownership coupled with a penchant for collaboration
Technical skills:
Preferred:
• Under the hood experience with Apache YARN, Kubernetes, Apache Spark, Hudi, Hadoop HDFS or similar systems such as Apache HBase is a strong plus• Experience with highly available/fault tolerant, replicated data storage systems, large scale data processing systems or enterprise/cloud storage systems is also a strong plus• 3+ years of experience building and managing distributed systems. Sound understanding of distributed system fundamentals.
At Uber, we ignite opportunity by setting the world in motion. We take on big problems to help drivers, riders, delivery partners, and eaters get moving in more than 10,000 cities around the world.
We welcome people from all backgrounds who seek the opportunity to help build a future where everyone and everything can move independently. If you have the curiosity, passion, and collaborative spirit, work with us, and let's move the world forward, together.
Uber is proud to be an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires accommodation, please let us know by completing this form.
Read Full Job Description
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • .NETLanguages
    • C#Languages
    • C++Languages
    • GolangLanguages
    • JavaLanguages
    • JavascriptLanguages
    • KotlinLanguages
    • PerlLanguages
    • PHPLanguages
    • PythonLanguages
    • RLanguages
    • RubyLanguages
    • ScalaLanguages
    • SqlLanguages
    • SwiftLanguages
    • GoLanguages
    • ReactLibraries
    • ReduxLibraries
    • Twitter BootstrapLibraries
    • ASP.NETFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • SparkFrameworks
    • TensorFlowFrameworks
    • AccessDatabases
    • Microsoft SQL ServerDatabases
    • MySQLDatabases
    • Google AnalyticsAnalytics
    • FigmaDesign
    • PhotoshopDesign
    • FigmaDesign
    • AsanaManagement
    • ConfluenceManagement
    • JIRAManagement
    • WordpressCMS
    • DocuSignCRM
    • SalesforceCRM
    • SplashCRM
    • SendGridEmail
    • Adobe CampaignLead Gen

An Insider's view of Uber

What’s the vibe like in the office?

When I went into the office for my final interview with Uber, I had the same feeling that I did when I stepped onto my college’s campus for the first time: it just felt like the right fit. The office was high-paced but also relaxed and you could immediately tell that people were friends and genuinely enjoyed being there.

Paige Sammarco

Account Executive, Uber Eats

What kinds of technical challenges do you and your team face?

One of the big challenges today with experimentation is around guaranteeing correctness, especially for small changes to ensure confidence in results. Was that change the cause of new behavior? Did other experiments get in the way? It all comes down to how accurately you can detect small changes within consumer behavior.

Azarias Reda

Head of Uber's Experimentation API team

What makes someone successful on your team?

"It’s not just about the individual contributor. The most successful people are the ones learning from others. On my team, I make sure that everyone shares best practices and we foster a collaborative culture. So when you’re on a call, you’re never really alone. And that applies to everyone."

Ali Faivus

Head of Mid-Market Sales

How do you empower your team to be more creative?

We make sure we don’t ship org structures, but rather aligned products. How can our products complement one another, building upon each other to achieve our primary goals? Whether it’s scheduling, routing, predictive analytics, or operational excellence, we are acting as one, and smartly leveraging our domains and strengths.

Joe Chang

Director of Engineering, Uber Freight

How does your team reward individual success?

I believe recognizing someone’s contributions are a big part of team play. On our weekly meetings, we always start with a shout-out, and it’s amazing how this simple topic stimulates the team to recognize small victories and accredit colleagues for their accomplishments. This brings our team together and fosters a more collaborative environment.

Silvia Penna

Sr Manager, Central Operations

What are Uber Perks + Benefits

Uber Benefits Overview

Doing your best work means being your best self. To help, we offer a wide range of benefits and perks, some that only Uber can, to support your health and wellbeing.

Culture
Volunteer in local community
Our people, process, and technology can help transform cities into safer, more efficient, and more beautiful places. Learn more: https://www.uber.com/community/supporting-cities/
Partners with Nonprofits
Technology, when it's done right—and combined with good partnerships—has the potential to contribute to a better world for all. Learn more: https://www.uber.com/us/en/community/
Friends outside of work
Eat lunch together
Intracompany committees
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Open office floor plan
Diversity
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Diversity manifesto
Diversity Employee Resource Groups
Hiring Practices that Promote Diversity
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Wellness Programs
Onsite Gym
Mental Health Benefits
Retirement & Stock Options Benefits
401(K)
Company Equity
Employee Stock Purchase Plan
Performance Bonus
Child Care & Parental Leave Benefits
Child Care Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Were providing more flexibility for some employees to be fully remote and we’re establishing a process to apply to be fully remote if employees think that’s best for them.
Family Medical Leave
Adoption Assistance
Vacation & Time Off Benefits
Unlimited Vacation Policy
Generous PTO
Sabbatical
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Free Daily Meals
Game Room
Stocked Kitchen
Pet Friendly
Fitness Subsidies
Home Office Stipend for Remote Employees
Professional Development Benefits
Diversity Program
Cross functional training encouraged
Promote from within
Mentorship program
Online course subscriptions available
More Jobs at Uber208 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Operations
Product
Project Mgmt
Product
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Product
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
Seattle, WA
Developer
new
Seattle, WA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
New York City, NY
Developer
new
New York City, NY
Data + Analytics
new
Remote
Developer
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Product
new
New York City, NY
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
South Bay
Developer
new
South Bay
Product
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
Remote
Operations
new
Austin, TX
Project Mgmt
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Operations
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
New York City, NY
Developer
new
South Bay
Developer
new
South Bay
Developer
new
Seattle, WA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
New York City, NY
Developer
new
South Bay
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
Seattle, WA
Developer
new
Peninsula
Product
new
San Francisco, CA
Developer
new
San Francisco, CA
Project Mgmt
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
New York City, NY
Developer
new
San Francisco, CA
Data + Analytics
new
Seattle, WA
Developer
new
New York City, NY
Developer
new
San Francisco, CA
Developer
new
Peninsula
Developer
new
San Francisco, CA
Operations
new
San Francisco, CA
Project Mgmt
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
South Bay
Project Mgmt
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Project Mgmt
new
San Francisco, CA
Product
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
South Bay
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
South Bay
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
New York City, NY
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
Seattle, WA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
Seattle, WA
Project Mgmt
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
South Bay
Operations
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
Seattle, WA
Developer
new
Peninsula
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
Seattle, WA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
New York City, NY
Developer
new
South Bay
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
South Bay
Developer
new
San Francisco, CA
Data + Analytics
new
San Francisco, CA
Developer
new
San Francisco, CA
Developer
new
San Francisco, CA
Data + Analytics
new
Peninsula
Product
new
San Francisco, CA
Developer
new
San Francisco, CA
Product
new
San Francisco, CA
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView Uber's full profileSee more Uber jobs