Cloud Platform Software Engineer
Hyderabad, IN / Remote
About DataPelago:
DataPelago is at the forefront of revolutionizing data processing for traditional analytics and cutting-edge GenAI preprocessing. We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray and others operate on diverse, large-scale data. Our team of engineers drive and adopt advances in hardware-accelerated computing, parallel processing of large-scale data, query optimization, distributed systems, compilers, machine learning, and cloud-native computing. We are looking for specialists to join our engineering team and shape the future of accelerated data processing.
The Opportunity:
As a Cloud Platform Software Engineer, you will be a key individual contributor in advancing the
SaaS platform for automating the multi-cloud deployment and operation of DataPelago’s data processing engine. You will enhance functional breadth, performance, scale, and reliability of the SaaS platform on multiple clouds. This is a unique opportunity to make a significant impact on a category-defining product and work with a talented team of engineers.
What You'll Do:
• Architect: Influence the architecture of how our data processing engine is deployed and op-
erated as an enterprise-class service in the customer’s preferred cloud environment.
• Design: Lead design of functional and performance enhancements to the automation capa-
bilities of the SaaS platform on different clouds.
• Core Development: Individually design, implement, test, optimize, and maintain compo-
nents of the SaaS platform.
• Collaboration: Partner effectively with the data processing engineering team and product
management in implementing SaaS platform capabilities.
• Continuous Improvement: Foster best practices in design and code reviews, testing, CI/CD,
and issue resolution to maintain highest product quality, security, efficiency, & productivity.
What You'll Bring:
• Bachelor's degree in Computer Science or a related field with 5+ years of relevant experi-
ence OR a Master's degree in Computer Science or a related field with 3+ years of relevant
experience.
• 3+ years of technical experience in developing microservice-based, multi-tenant, cloud-na-
tive application for AWS, GCP, or Azure.
• 3+ years of technical experience developing and running infrastructure-as-code for produc-
tion applications.
• Demonstrated experience in AWS, GCP, or Azure core services, API, permissions model.
• Strong fundamentals in building scalable, highly available, secure implementations of dis-
tributed, multi-tier, always-on applications.
• Strong programming skills in Golang.
• Strong development experience in Linux environments.
• Strong analytical and problem-solving skills with a passion for performance optimization.
Location Considerations:
We value face-to-face collaboration, but recognize that talent can be found anywhere. Our engineering team works at our headquarters in Mountain View, CA, at our India office in Hyderabad, and at remote locations. This position will be primarily based in India, in Hyderabad (preferred) or remote.
Why Join DataPelago?
• Technology Leadership: Shape the architecture and development of a multi-cloud service for
accelerated computing.
• Significant Impact: Your contributions will directly impact the performance and scalability
of our mission-critical platform.
• Growth: Expand your technical expertise and scope of responsibilities working with other
talented engineers and with a growing product.
• Competitive compensation, stock options, comprehensive benefits package, leadership de-
velopment opportunities
Top Skills
What We Do
We are on a mission to make it viable to extract value from all data in the world — so humanity can capture every insight, cure, invention, and opportunity.
Traditional processing solutions based on CPUs and today’s software architectures cannot handle the complexity and volume of data, doubling every two years, with unstructured data now accounting for 90% of all data created. The surge of GenAI and its dependence on huge volumes of unstructured data is compounding the processing challenge. DataPelago is creating a new data processing standard for the accelerated computing era to overcome these performance, cost and scalability limitations.
DataPelago's revolutionary Universal Data Processing Engine accelerates any engine, including open source, on any hardware, using any data type. DataPelago enables organizations to extract value from data at unprecedented price and performance for their GenAI and analytics workloads.
