Software Engineer, Spark Team

| South Bay
Sorry, this job was removed at 4:37 a.m. (CST) on Saturday, November 6, 2021
Find out who's hiring remotely in San Francisco, CA.
See all Remote Developer + Engineer jobs in San Francisco, CA
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

About the role:
Partners with stakeholders and leads team efforts to build and maintain backend services and solutions to support user-facing products, downstream services, or infrastructure tools and platforms used across Uber. Spark is our main batch big data analytics query engine at Uber. It accounts for the majority of our data compute resources, powers most of our major ingestion, ETL, data science, and machine learning workloads. Spark at Uber is used by over 2.5K weekly active users, who run 3M+ applications every week.
As part of the Spark team, you will design, implement, optimize, and manage large scale distributed computing infrastructure that will impact multiple business use cases at Uber scale. You will also have the opportunity to collaborate with the open source community for Spark and related domains.
About the Team:
Uber has unique challenging data use cases at the intersection of massive data, realtime requirements, privacy and security considerations, geospatial and large distributed machine learning. The Apache Spark team powers these use-cases with a Spark as a service platform. This platform is the backbone of all large-scale data processing at Uber, and powers the core matching algorithms that powers our many business lines. Spark is also the data fabric for the company that connects many diverse data sources ranging across HDFS, Pinot, Kafka, Cassandra, ElasticSearch, etc.
We have a diverse user base ranging from machine learning scientists to data analysts. Our workload ranges from very complex RDD processing frameworks for ingestion, that shuffle hundreds of petabytes a day, complex distributed deep learning using Horovod and Michaelangelo, to notebooks and plain old SQL ETL. Many of our jobs are themselves deep million line frameworks that further enable Uber's engineers to do experimentation, machine learning, log analytics etc.
Minimum qualifications:
• BS equivalent in Computer Science, Engineering, Mathematics or related field OR 2-years full-time Software Engineering work experience, WHICH INCLUDES 1-years total technical software engineering experience in one or more of the following areas:
• Programming language (e.g. C, C++, Java, Python, or Go)
• Note the 1-years total of specialized software engineering experience may have been gained through education and full-time work experience, additional training, coursework, research, or similar (OR some combination of these). The years of specialized experience are not necessarily in addition to the years of Education & full-time work experience indicated.
Technical skills:
Preferred:
• Distributed systems
At Uber, we ignite opportunity by setting the world in motion. We take on big problems to help drivers, riders, delivery partners, and eaters get moving in more than 10,000 cities around the world.
We welcome people from all backgrounds who seek the opportunity to help build a future where everyone and everything can move independently. If you have the curiosity, passion, and collaborative spirit, work with us, and let's move the world forward, together.
Uber is proud to be an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires accommodation, please let us know by completing this form.

More Information on Uber
Uber operates in the 3PL: Third Party Logistics industry. The company is located in San Francisco, CA, New York City, NY, Chicago, IL and Seattle, WA. Uber was founded in 2009. It has 21000 total employees. It offers perks and benefits such as Volunteer in local community, Partners with nonprofits, Friends outside of work, Eat lunch together, Intracompany committees and OKR operational model. To see all 65 open jobs at Uber, click here.
Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about UberFind similar jobs