Sr. Software Engineer in Test - Storage -Ozone / HDFS

Reposted 14 Days Ago
Be an Early Applicant
Bangalore, Bengaluru Urban, Karnataka
In-Office
Senior level
Big Data • Software • Analytics
The Role
The Senior Software Engineer will design and implement core features of Apache Ozone and HDFS, focusing on distributed systems and backend engineering.
Summary Generated by Built In

Business Area:

Engineering

Seniority Level:

Mid-Senior level

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry.  Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

At Cloudera, our Data Services Pillar is the heart of data innovation. We don’t just work with technology; we build it. Our mission is to empower data practitioners by creating seamless, enterprise-grade experiences for data engineering, warehousing, streaming, operational databases, and AI.

This is your opportunity to build cloud-native solutions that are deployable anywhere—whether in massive clusters on any cloud provider or in private data centers. You’ll work with cutting-edge technologies like Trino, Spark, Airflow, and advanced AI inferencing systems to shape the future of analytics. Your code will directly influence how data engineers, analysts, and developers worldwide find value in their data.

We believe in the power of open source. You’ll collaborate with project committers, contributing upstream to keep technologies like Apache Hive and Impala evolving. You’ll harden these engines for rock-solid security, optimize them for peak performance, and make them effortlessly run across all environments.
Join us and help build the trusted, cloud-native platform that powers insights for the most data-intensive companies on the planet.
 

Cloudera is looking for an exceptional and passionate software engineer in Test with a distributed systems background to join the Storage Engineering team focused on building Apache Ozone. The Storage team is responsible for the primary storage and storage access layers which are core to the Cloudera Data Platform. Apache Ozone (https://ozone.apache.org) is an open source project purposed to build a massively scalable distributed object store. Ozone is designed to scale to thousands of nodes, tens of billions of objects and overcome the limitations of the Hadoop Distributed File System (HDFS).

As the Software Engineer in Test you will:

  • Responsible for delivery of high quality features/releases of Cloudera's Data Platform line of products.

  • Alongside, you will develop an understanding of popular open source projects of Apache Hadoop; hyperscale cloud platforms like AWS, Azure and Container technologies like Kubernetes and Docker.

We’re excited about you if you have:

  • Strong programming skills in one or more of the following languages: Python/Java/Javascript 

  • Ability to design, build and maintain automated testing frameworks, tools, and automated test suites, in Python (pytest), preferred or Java (TestNG/JUnit).

  • Sound knowledge of test methodologies, including creation of test cases and test plans.

  • Good Debugging skills, esp. involving distributed systems, preferably on Linux

  • Ability to work closely with the Engineering teams and come up with test scenarios for new features, involving Big Data technologies.

  • Working knowledge in storage systems and experience in developing, and executing comprehensive storage testing strategies, evaluating functional, performance, scalability, stress, integrity, security aspects of storage systems will be considered a strong asset.

  • Ability to Design and maintain CI/CD pipelines for enabling fast paced, low touch releases of our product 

  • Ability to work effectively both independently and as part of a team. 

  • Knowledge of Public Clouds (AWS/Azure) and/or Container Technologies (Docker, Kubernetes) is a plus

You may also have:

  • BS/MS in Computer Science or related field

  • 4+ years experience in test development, automation framework and tools development

  • Strong knowledge in back-end testing on any of the following : Web Services, Databases, enterprise storage products or large scale distributed systems

  • Strong knowledge in popular test automation frameworks and test automation methodologies

  • Familiarity with DevOps technologies such as Docker, Kubernetes, Ansible, Jenkins, Github, Maven etc

  • Excellent communication and collaboration skills.

  • Comfortable working in fast paced environments

  • Working knowledge of Apache Hive, Impala, Hue, and Big Data ecosystem is an added advantage.

What you can expect from us:

  • Generous PTO Policy 

  • Support work life balance with Unplugged Days

  • Flexible WFH Policy 

  • Mental & Physical Wellness programs 

  • Phone and Internet Reimbursement program 

  • Access to Continued Career Development 

  • Comprehensive Benefits and Competitive Packages 

  • Paid Volunteer Time

  • Employee Resource Groups

EEO/VEVRAA

#LI-VG1

Top Skills

Apache Hadoop
Apache Ozone
Hbase
Hdfs
Hive
Java
Mapreduce
Spark
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alot, CA
3,092 Employees
Year Founded: 2008

What We Do

At Cloudera, we believe that data can make what is impossible today, possible tomorrow. We empower people to transform complex data into clear and actionable insights. Cloudera delivers an enterprise data cloud for any data, anywhere, from the Edge to AI. Powered by the relentless innovation of the open source community,

Similar Jobs

Toast Logo Toast

Security Engineer

Cloud • Fintech • Food • Information Technology • Software • Hospitality
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
5000 Employees

Magna International Logo Magna International

Project Administrator, Industrial Solutions

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
171000 Employees

Magna International Logo Magna International

Engineer (Base Software)

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
171000 Employees
5-5 Annually

ServiceNow Logo ServiceNow

Consultant

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
28000 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account