Senior LLM Engineer

Reposted Yesterday
Be an Early Applicant
Budapest
In-Office
Senior level
Machine Learning • Analytics
The Role
Design and implement AI-powered features for cost optimization in cloud infrastructure, using LLMs to deliver automated, intelligent recommendations.
Summary Generated by Built In
Rabbit is a GCP cost-optimization and automation platform that helps enterprises make BigQuery and other GCP workloads truly cost-efficient. We combine deep platform intelligence, automation, and generative AI to turn cost insights into action.

The Challenge: AI has the potential to transform how infrastructure is managed, but most companies are still figuring out how to use LLMs beyond chatbots. We're building truly agentic systems that autonomously optimize cloud infrastructure — safely, intelligently, and at scale.

Role Overview

If you're excited about AI, but tired of building demos — this is your role.

Rabbit is evolving into a proactive cost optimization platform — a system that doesn't just recommend, but acts. We're looking for a Senior LLM / Agentic Engineer to pioneer AI-powered automation capabilities that help enterprises reduce cloud costs intelligently and safely.

The opportunity: This is the frontier of LLM applications. Not chatbots. Not summaries. Real autonomous agents that analyze petabytes of cost data, identify optimization opportunities, and implement changes to production infrastructure. You'll research, design, and implement LLM-driven features that turn cost insights into automated actions — and you'll do it first.

In our startup environment, you're not just implementing someone else's AI strategy — you're inventing it. Your experiments with prompt engineering, function calling, and agent architectures will directly shape the product. If you're ambitious, curious about AI's potential, and ready to push beyond what's been done before, this is where you belong.

What You'll Do
  • Research, design, and implement AI-powered features that deliver automated cost optimization capabilities
  • Build LLM-driven systems that transform cost insights into intelligent, actionable recommendations
  • Develop safe and secure AI integration patterns that respect customer data boundaries and GCP security models
  • Collaborate with the Application Architect to embed AI capabilities into Rabbit's backend architecture
  • Experiment with emerging AI technologies and techniques to solve complex cost optimization challenges
  • Ensure AI systems are accurate, reliable, and production-ready
  • Continuously improve the effectiveness and safety of AI-powered automation features
What We're Looking For
  • 5+ years in backend or applied ML engineering, with at least 1–2 years hands-on with LLM APIs (OpenAI, Vertex AI, Anthropic)
  • Strong Python skills and experience with frameworks such as LangChain, LlamaIndex, or Vertex AI Agents
  • Understanding of structured output generation, function calling, and API tool integration
  • Familiarity with GitHub Actions / REST APIs and CI/CD automation
  • Experience building or deploying production LLM systems (not just prototypes)
  • Bonus: knowledge of cloud cost management or GCP optimization concepts
Why Join Rabbit

For AI engineers who want to build the future, not just talk about it:

  • Ship real AI agents, not demos: Your work will go to production, managing real infrastructure for Fortune 500 companies. No more "this is just a prototype" — you'll build production-grade agentic systems that customers trust with their infrastructure
  • Define the category: We're pioneering AI-driven infrastructure automation. There's no playbook. You'll help write it — through research, experimentation, and production deployments that push the boundaries of what LLMs can do
  • Technical freedom meets real impact: Experiment with latest models (GPT-4, Claude, Gemini), try new architectures, research novel approaches — and when something works, ship it. Your ideas have a direct path to production
  • Solve genuinely hard problems: Building autonomous agents that safely modify production infrastructure at scale, ensuring reliability while pushing automation boundaries — these are challenges worthy of your best work
  • Learn at the cutting edge: Work with senior engineers who are as excited about AI's potential as you are. Collaborate with data architects who understand the domain deeply. Level up faster than you thought possible

Not for everyone. Perfect for you if: You're less interested in AI hype, more interested in AI reality. You want to build systems that work, not just impress at demos. You're ready to pioneer something genuinely new.

Top Skills

Ci/Cd
Github Actions
Langchain
Llamaindex
Openai
Python
Rest Apis
Vertex Ai
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Budapest
182 Employees
Year Founded: 2009

What We Do

Let’s become partners, and move your business to the cloud together! Aliz helps you reach your business goals with Machine Learning and data solutions – powered by Google Cloud. Because of our strong partnership with Google, we have access to the most modern technologies and developments in the industry; and those resources combined with our dedicated, professional team is ensured to give your company a competitive edge. Data has become the most valuable resource – if you use it well. We help you put your company’s data to use, gain valuable insights, predict future trends, and optimise your business to increase ROI. Join those who are already in the cloud, taking full advantage of their automated processes – and make your business even more successful than it is now. We are committed to delivering quality to our clients. To ensure that your company is provided the best possible solution tailored to your business needs, we use cutting-edge technologies, and we’re very proud to be able to call ourselves the only Premier Google Cloud partners in the CEE region. So far we have helped airlines, retailers, telco companies, and many more high-profile clients to make their business more successful. We are specialised in Machine Learning and Big Data – with our analytics and data warehousing solutions, the sky is the limit.

Similar Jobs

Yext Logo Yext

User Experience Researcher

Artificial Intelligence • Information Technology • Internet of Things • Social Media • Software • SEO
Easy Apply
In-Office
Budapest, HUN
1150 Employees

Teya Logo Teya

Sales Support Specialist

Fintech • Payments • Financial Services
In-Office
Budapest, HUN
900 Employees

Mondelēz International Logo Mondelēz International

Brand Manager

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Hybrid
Budapest, HUN
90000 Employees

Wise Logo Wise

Employer Brand Lead

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Budapest, HUN
6500 Employees
1M-2M Annually

Similar Companies Hiring

Northslope Technologies Thumbnail
Software • Information Technology • Generative AI • Consulting • Artificial Intelligence • Analytics
Denver, CO
60 Employees
Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account