AI/ML Engineer

The AI/ML Engineer / Senior AI/ML Engineer is a highly technical, hands-on role at the intersection of Enterprise AI and client-facing architecture. As part of our Customer Engineering function, you will write production-grade solution blueprints alongside strategic customers and technology partners. Your mission is to solve immediate, high-stakes operational bottlenecks in the APAC region by delivering repeatable, extensible, and open-sourced AI Quickstarts that show the industry how to solve complex challenges.

In this team, career growth and seniority are defined purely by your technical competence, architectural depth, and ability to deliver end-to-end solutions autonomously in highly ambiguous environments. There is no expectation of team management, project coordination, or formal talent mentorship; your progression is driven entirely by engineering impact.

• Enterprise-Minded Blueprinting: Design and build comprehensive, production-ready architecture blueprints and reference codebases. These blueprints must naturally take into account critical enterprise requirements—including systems-level hardening, infrastructure scalability, and network isolation boundaries—without you needing to perform the last-mile hands-on production deployment yourself.

• Open-Source AI Quickstarts: Package repeatable, extensible technical architectures as open-sourced AI Quickstarts to solve complex, real-world industry problems and accelerate ecosystem adoption.

• Co-Development & Integration: Collaborate with external engineering teams (such as semiconductor partners, regional AI programs, and software vendors) to validate joint-architecture blueprints, ensuring stable integrations across the system stack.

• Benchmarking & Evaluation: Design and integrate automated testing, evaluation harnesses, and system-level telemetry into blueprints to monitor and measure performance metrics like latency, throughput, cost, and model quality.

• Regulated & Secure Design: Proactively incorporate robust data privacy standards, secure network perimeters, and localized hosting considerations into all solution blueprints to satisfy compliance and risk management requirements in highly regulated environments.

To be considered for this role, all candidates must meet the following baseline requirements:

• Education: Bachelor’s or Master's degree in Computer Science, Computer Engineering, or a related quantitative field.

• Software Engineering Foundations: Excellent understanding of software engineering fundamentals, including clean code principles, test-driven development (TDD), CI/CD automation pipelines, and version control (Git) workflows.

• Communication: Clear verbal and written communication skills in English, with the ability to articulate complex technical architectures to other engineers and technical stakeholders.

• Programming Languages: Exceptional, hands-on proficiency in Python (specifically for machine learning and systems programming). Solid familiarity with lower-level system languages such as Go or C/C++ is highly preferred.

• Deep Learning & ML Libraries: Strong familiarity with PyTorch and core NLP/vision ecosystems (e.g., Hugging Face Transformers, datasets, and tokenizers).

• Cloud-Native Frameworks: Strong practical experience deploying containerized applications on Kubernetes or production-grade enterprise container orchestration platforms.

• Base MLOps Knowledge: Conceptual and hands-on understanding of model serving lifecycles, data ingestion steps, and automated packaging.

We are building a multi-disciplinary engineering squad. Candidates are expected to bring experience in some of the following domains, and will have the opportunity to continuously develop their skills across all of them as they grow in seniority:

• Platform & Pipeline Engineering: Experience with distributed computing frameworks and cluster schedulers (such as Ray), workflow orchestration (such as MLflow or Kubeflow), distributed unstructured data parsing tools (such as Docling), and vector database structures.

• Generative AI & Agentic Architectures: Familiarity with LLM orchestration engines (such as LangChain, LlamaIndex, or LangGraph), agentic workflows (AgentOps), tool-calling protocols (such as Model Context Protocol) and model fine-tuning (PEFT/SFT).

• Hardware Heterogeneity & Runtime Optimization: Understanding of model serving runtimes (such as vLLM), optimizing engines for latency and throughput (e.g., KV cache offloading, chunked prefill), and running benchmarks across diverse hardware setups including CUDA, ROCm, and emerging GPU/NPU architectures.

• Regulated Deployments: Designing isolated, air-gapped container networks, secure registry services, and local inference environments to meet strict data residency, privacy, and compliance policies.

While not strictly required, experience applying AI/ML architectures to solve challenges in the following regulated industries is a strong advantage:

• Financial Services (FSI): Familiarity with risk-assessment models, fraud detection patterns, or compliance requirements under regulatory frameworks.

• Public Sector & Healthcare: Experience handling highly sensitive or anonymized datasets, building secure data boundaries, or deploying solutions under strict government compliance protocols.

• Telecommunications & Manufacturing: Experience with edge AI deployments, high-throughput streaming pipelines, or low-latency remote architectures.

• Pioneering Ecosystem Impact: Work in a highly strategic center of gravity where your contributions directly shape open-source solution blueprints and AI Quickstarts used by the wider community.

• Pure Engineering Focus: Grow along a dedicated technical track where career progression is tied directly to your architectural depth and software contribution, free from administrative management or project coordination overhead.

• State-of-the-Art Technologies: Gain hands-on exposure to emerging global hardware platforms, next-generation agentic runtimes, and localized enterprise software stacks.

#LI-SH4

About Red Hat

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.

Inclusion at Red Hat
Red Hat’s culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.

Equal Opportunity Policy (EEO)
Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.