Experienced AI Software Engineer

Posted 2 Days Ago
Easy Apply
Be an Early Applicant
Hiring Remotely in Haifa, ISR
Remote
Senior level
Artificial Intelligence • Hardware • Internet of Things • Machine Learning • Software • Manufacturing
We are transforming how people and machines work together to push the boundaries of human productivity.
The Role
The Senior AI Software Engineer will build GenAI infrastructure, design AI agents, integrate workflows, and improve AI system reliability and efficiency.
Summary Generated by Built In

Our mission is to transform how people and machines work together to push the boundaries of human productivity. A leader in Industrial AI, Augury helps the world’s manufacturers leverage real-time production insights to drive new levels of efficiency. Combining predictive and prescriptive AI technology with industry expertise, production teams can proactively address alerts, minimize downtime, reduce asset costs, and maximize yield and capacity. Our customers achieve payback in six months or less, enabling global scale. We're looking for team members excited to partner with the world's manufacturers and build the future of production together.

You are a Senior AI Software Engineer looking to join a GenAI Infrastructure team and build production-grade GenAI capabilities and the infrastructure behind them. You will be a hands-on engineer focused on AI agents, RAG pipelines, tool-calling workflows, backend services, data access layers, evaluation, observability, and reusable GenAI infrastructure used across product teams. You will not be focused solely on model research or prompt design. Instead, you will be a strong software engineer who can design, build, ship, and operate reliable AI-powered systems in production.

A Day In Your Life 

  • Build reusable infrastructure, SDKs, and internal frameworks for AI-powered product capabilities.
  • Design and implement AI agents, RAG flows, tool-calling workflows, and LLM orchestration pipelines.
  • Build production-grade GenAI services, APIs, and backend infrastructure.
  • Integrate LLM workflows with internal microservices, data platforms, vector search, and event-driven systems.
  • Design secure data-access patterns that enforce authorization, tenant separation, and user-level scope.
  • Implement evaluation, tracing, monitoring, and quality-control mechanisms for GenAI systems.
  • Improve latency, reliability, fallback behavior, cost efficiency, and production readiness.
  • Work on customer-facing AI experiences, including conversational and proactive agentic product flows.
  • Collaborate with backend engineers, product managers, data engineers, AI/ML engineers, and domain experts.

You Will Bring

  • 6+ years of professional software engineering experience.
  • Strong Python development skills.
  • Strong backend engineering background, including APIs, services, integrations, or microservices.
  • Proven experience designing, shipping, or operating LLM-powered applications or GenAI systems.
  • Experience with RAG, AI agents, tool/function calling, prompt orchestration, evaluation, and observability.
  • Experience with microservices, distributed systems, and production backend architecture.
  • Strong understanding of system design, reliability, security, scalability, latency, and maintainability.
  • Ability to work with complex data models and expose them safely through AI systems.
  • Ability to operate in ambiguous technical areas and turn prototypes into production-ready systems.
  • Strong communication skills and ability to explain technical decisions clearly.

Preferred Qualifications

  • Experience with LangChain, LangGraph, or LangSmith.
  • Experience with Go, MongoDB, Databricks, Kubernetes, Docker, REST APIs, vector search, or event-driven systems.
  • Experience with Azure OpenAI, Gemini, or similar LLM platforms.
  • Experience building or using knowledge graphs, GraphRAG, or graph databases such as Neo4j.
  • Experience building multi-agent systems or orchestrating multiple specialized agents/tools in production.
  • Experience building internal platforms, SDKs, developer tools, or shared engineering infrastructure.
  • Experience with authorization, data segregation, multi-tenant systems, or user-level data scoping.
  • Experience in industrial, IoT, predictive maintenance, manufacturing, or operational-data domains.

What Success Looks Like

  • You build reusable infrastructure that accelerates GenAI development across teams.
  • You ship reliable GenAI capabilities that run in production.
  • You improve how AI agents retrieve data, call tools, enforce permissions, and generate grounded responses.
  • You contribute to practical standards around GenAI architecture, evaluation, monitoring, security, and deployment.

Perks

  • Stock options
  • Paid parental leave
  • Flex PTO

Augury is a people-first organization. We believe in fostering an inclusive environment in which employees feel encouraged to share their unique perspectives, leverage their strengths, and act authentically. We know that diverse teams are strong teams, and we welcome those from all backgrounds and varying experiences. We are committed to providing employees with a work environment free of discrimination and harassment. We believe that diversity is more than just good intentions, and we are committed to creating an inclusive environment for all employees.

Augury is a proud equal opportunity employer, we strive to create a work environment in which everyone, all applicants, employees, customers, guests, and vendors feel safe and comfortable. We commit to maintain a workplace that is free of any type of harassment and does not tolerate anyone intimidating, humiliating, or hurting others. We prohibit willful discrimination based on age, gender, ethnicity, race, color, religion, political opinions, sexual orientation, sexual identity or expression, military or veteran status, disability or any other characteristic protected by law.

Skills Required

  • 6+ years of professional software engineering experience
  • Strong Python development skills
  • Strong backend engineering background, including APIs, services, integrations, or microservices
  • Proven experience designing, shipping, or operating LLM-powered applications or GenAI systems
  • Experience with RAG, AI agents, tool/function calling, prompt orchestration, evaluation, and observability
  • Experience with microservices, distributed systems, and production backend architecture
  • Strong understanding of system design, reliability, security, scalability, latency, and maintainability
  • Ability to work with complex data models and expose them safely through AI systems
  • Ability to operate in ambiguous technical areas and turn prototypes into production-ready systems
  • Strong communication skills and ability to explain technical decisions clearly

What the Team is Saying

Danielle
Angela
Brandon
Hari
Einat
Gal

Augury Compensation & Benefits Highlights

  • Leave & Time Off Breadth Flexible or unlimited PTO is paired with paid holidays, sick time, volunteer time, and company‑wide shutdowns. Feedback suggests this breadth makes time away more feasible across different needs.
  • Flexible Benefits Remote‑work support includes home‑office and phone stipends plus company‑paid coworking access. Flexible scheduling and remote options expand how employees can use and experience the benefits.
  • Healthcare Strength Comprehensive medical, dental, and vision coverage is provided alongside life and disability insurance. Feedback suggests the overall health coverage forms a solid core of the total rewards package.

Augury Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
203 Employees
Year Founded: 2011

What We Do

Our mission is to provide manufacturers and other industrial sectors with insights into the health of machines, processes, and operations to transform how people work and what they can create. A pioneer in Machine Health and Process Health solutions, we use purpose-built AI, trained by industry experts and the world’s largest data library, to help customers eliminate production downtime, improve process efficiency, maximize yield, and reduce waste and emissions.

Why Work With Us

We believe the best perk is who you work with, professionally and personally. Our team is a diverse group of people that breed creative thinking and want to solve big challenges together. Each person understands the impact of their role on our customers and Augury's success.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Augury Offices

Remote Workspace

Employees work remotely.

Typical time on-site: None
HQNew York, NY
Haifa, Israel
Tel Aviv, Israel
Learn more

Similar Jobs

Augury Logo Augury

Office Manager

Artificial Intelligence • Hardware • Internet of Things • Machine Learning • Software • Manufacturing
Easy Apply
Remote
Haifa, ISR
203 Employees

Augury Logo Augury

IoT Embedded Linux Engineer

Artificial Intelligence • Hardware • Internet of Things • Machine Learning • Software • Manufacturing
Easy Apply
Remote
Haifa, ISR
203 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account