Software Engineer (Quality & Reliability) — AI-powered Command Line Assistant

Posted 17 Days Ago
Be an Early Applicant
2 Locations
In-Office
Mid level
Cloud • Information Technology • Internet of Things • Software • Consulting • Infrastructure as a Service (IaaS) • Automation
Creating better technology the open source way
The Role
Develop production-grade software for the AI-powered Command Line Assistant, focusing on quality, reliability, and system validation. Responsibilities include automation, debugging, and participating in open source contributions.
Summary Generated by Built In

The Command Line Assistant (CLA) team (powered by RHEL Lightspeed) is hiring a Software Engineer to build AI-powered RHEL experiences—shipping production software while engineering the quality, reliability, and evaluation signals that make AI verifiable and production-ready for real-world system administration. The RHEL command line assistant provides an optional AI enabled assistant which is available from the RHEL command line. It uses a natural language interface to answer RHEL-related questions, help with troubleshooting, and can be used as a learning aid.

What You’ll Do  
  • Build and maintain production-grade software (tools, services, libraries, CLIs) that improves CLA behavior and operational reliability.

  • Implement automation and evaluation systems: test frameworks, harnesses, data generators, and CI quality gates that scale with the product.

  • Define and run validation across unit, integration, system, performance, and other non-functional checks.

  • Triage and debug failures across product code, test code, CI pipelines, environments, and integrations; drive root-cause fixes and targeted improvements.

  • Improve testability and observability by adding diagnostics, structured logs, metrics, and troubleshooting hooks in the codebase.

  • Own CI/CD validation workflows (e.g., tmt/fmf, Testing Farm) and improve signal quality (flake reduction, regression prevention).

  • Participate in open source development: upstream work, reviews, proposals, and contributions where appropriate.

  • Engage with Fedora and community workflows (as relevant) to validate early changes and strengthen upstream/downstream feedback loops.

  • Document results and present findings to stakeholders.
     

What You’ll Bring
  • 3+ years of software engineering experience with strong emphasis on automation, debugging, and maintainable systems.

  • 2–3 years strong experience with Python (pytest preferred) and writing testable, well-structured code.

  • Experience in Linux/RHEL environments and system-level troubleshooting (logs, processes, basic networking).

  • Practical experience with CI/CD pipelines, code review, and version control (Git).

  • Experience with AI/ML technologies such as foundational frameworks, large language models (LLMs), Retrieval Augmented Generation (RAG) paradigms, embedding models, vector databases, CLI assistants.

  • Clear written and verbal communication; effective in distributed work across time zones.

The following are considered a plus: 

  • Exposure to AI/ML evaluation concepts, or interest in applying QE methods to AI-enabled systems.

  • Experience designing LLM evaluations for production.

  • Knowledge of RHEL release workflows and enterprise testing cycles. Experience with RPM-based distributions and packaging basics.

  • Familiarity with LLM-enabled CLI assistants (i.e Goose).

  • Engineering experience with Gemini on Vertex AI (prompting, model parameter tuning for reliability, safety settings, structured outputs/function calling) and understanding how these impact determinism, latency, and CI stability.

  • Familiarity with Fedora, upstream/downstream practices, and community contribution processes.

  • Familiarity with virtualization and containerization. 

  • Rust experience (or interest), especially for CLI/tooling.

  • Familiarity with Ansible or similar automation for provisioning/test environments.

    About Red Hat

    Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.

    Inclusion at Red Hat
    Red Hat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.

    Equal Opportunity Policy (EEO)
    Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.


    Red Hat does not seek or accept unsolicited resumes or CVs from recruitment agencies. We are not responsible for, and will not pay, any fees, commissions, or any other payment related to unsolicited resumes or CVs except as required in a written contract between Red Hat and the recruitment agency or party requesting payment of a fee.

    Red Hat supports individuals with disabilities and provides reasonable accommodations to job applicants. If you need assistance completing our online job application, email [email protected]. General inquiries, such as those regarding the status of a job application, will not receive a reply.

    Top Skills

    Ai/Ml
    Ansible
    Ci/Cd
    Git
    Llms
    Pytest
    Python
    Rhel
    Rust
    Am I A Good Fit?
    beta
    Get Personalized Job Insights.
    Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

    The Company
    HQ: Raleigh, NC
    20,000 Employees
    Year Founded: 1993

    What We Do

    At Red Hat, we connect an innovative community of customers, partners, and contributors to deliver an open source stack of trusted, high-performing solutions.

    We offer cloud, Linux, middleware, storage, and virtualization technologies, together with award-winning global customer support, consulting, and implementation services. Red Hat is a rapidly growing company supporting more than 90% of Fortune 500 companies.

    Why Work With Us

    Red Hatters freely exchange different viewpoints, contribute ideas, and solve problems together. Our love of collaboration, accountability, a sense of community, and a measure of autonomy combine to create a powerful force that fosters innovation and makes Red Hat a great place to work.

    Gallery

    Gallery

    Similar Jobs

    WHOOP Logo WHOOP

    Senior Visual Merchandising Manager

    Fitness • Hardware • Healthtech • Sports • Wearables
    Easy Apply
    Remote or Hybrid
    3 Locations
    500 Employees
    7-7 Annually

    MongoDB Logo MongoDB

    Senior Solutions Architect

    Big Data • Cloud • Software • Database
    Easy Apply
    Remote or Hybrid
    2 Locations
    5550 Employees

    CrowdStrike Logo CrowdStrike

    Security Researcher (Remote, GBR)

    Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
    Remote or Hybrid
    4 Locations
    10000 Employees

    CrowdStrike Logo CrowdStrike

    Intelligence Analyst, Recon+ (Remote)

    Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
    Remote or Hybrid
    3 Locations
    10000 Employees

    Similar Companies Hiring

    Scotch Thumbnail
    Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
    US
    25 Employees
    Milestone Systems Thumbnail
    Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
    Lake Oswego, OR
    1500 Employees
    Fairly Even Thumbnail
    Software • Sales • Robotics • Other • Hospitality • Hardware
    New York, NY

    Sign up now Access later

    Create Free Account

    Please log in or sign up to report this job.

    Create Free Account