Staff Software Engineer - Distributed Systems, AI (Foster City, CA)

About Alluxio:

Proven at a global web scale in production for modern data services, Alluxio is the developer of open-source data orchestration software for large-scale analytics and AI. Alluxio is in production use today at eight out of the top ten internet companies, and seven of the ten highest-valued companies in the world. Our mission is to orchestrate data for all data-driven applications in any cloud! 

As customers continuously push the envelope for ways to extract value from data, Alluxio is driving innovation in data access and management for large-scale distributed systems. Alluxio is charging full steam to help customers navigate digital transformation. Venture-backed by Andreessen Horowitz, Hillhouse Capital, and Seven Seas Partners. Alluxio was founded at UC Berkeley’s AMPLab by the creators of the Tachyon open-source project.

Alluxio data orchestration platform is a new layer between storage and compute engines. This new data layer serves data to large-scale analytics and AI in any cloud across clusters, regions, clouds, and countries, providing simplified data access to files and objects. Features like intelligent caching, unified namespace, and data management provide agility and cost efficiency to customers in financial services, high-tech, retail, and telecommunications.

Alluxio is trusted by Meta, Uber, Tencent, Tiktok, Alibaba, Expedia, Rakuten, Microsoft, Walmart, and more! Please review Wikipedia to learn more about us! Join our world-class team of empathetic, enthusiastic, and creative people who can work on some of the toughest big data problems.

About the Role:

As a Staff Software Engineer at Alluxio, you will tackle complex and cutting-edge challenges in the realm of distributed data services. Your work will involve optimizing latency and throughput for distributed systems, by using concurrent data structures, improved locking mechanisms, and leveraging advanced hardware technologies. You’ll also focus on building scalable systems that operate efficiently across thousands of nodes while ensuring data durability and high availability. This role is ideal for a software engineer who thrives on solving technical challenges and collaborating with senior team members to deliver innovative solutions.

Responsibilities:

• Integrate Alluxio into the AI ecosystem through various compute frameworks used for executing AI workloads.
• Drive the evolution of the Alluxio project, advancing the state-of-the-art in distributed systems engineering.
• Solve complex challenges in areas such as distributed data services, memory and data structure efficiency, thread concurrency, locking optimizations, process coordination, and caching strategies.
• Develop and implement scalable solutions to manage thousands of nodes, ensuring data durability and high availability in distributed environments.
• Collaborate with senior engineers to design and refine cutting-edge features that push the boundaries of distributed systems performance.

Qualifications:

• Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience; advanced degrees preferred.
• Software development experience in one or more general-purpose programming languages, including but not limited to Java, C/C++, or Go.
• Must have experience with at least two of the following: distributed and parallel systems, distributed storage systems, architecting large-scale software systems, and security software development.
• Excellent analytical and problem-solving skills.
• Proficiency in verbal and written English communication.
• Ability and enthusiasm to work in a fast-paced, collaborative, and iterative programming environment.
• Interest and ability to learn additional programming languages as needed is preferred.

Why Join Alluxio:

• Be part of a world-class team dedicated to solving some of the toughest challenges in big data.
• Work in a dynamic and innovative environment with opportunities for professional growth and development.
• Enjoy a collaborative culture that values empathy, enthusiasm, and creativity.

Alluxio is an equal opportunity employer and does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or other non-merit factors.

The base salary range for this US full-time position is $180-220k, depending on experience, and subject to standard withholding and applicable taxes. All candidates receive equity (stock options) and access to a comprehensive benefits offering. The base salary range reflects the minimum and maximum target for candidates across all US locations. Work location, skills, experience, and any relevant education or training determine the compensation awarded to the candidate. The Recruiting Team or Hiring Manager can share more about the specific salary range with you during the recruitment process.