We Are KPMG Israel.
KPMG Israel is more than a professional services firm, we are a community of people driven by impact.
As part of a leading global network, we partner with the most influential organizations to drive large-scale business and technology transformation, combining strategic thinking, innovation, and advanced technologies.
Guided by integrity, excellence, and forward thinking, we help organizations navigate complexity and create real change.
Our people are at the center, with space to lead, experiment, and grow in a dynamic and collaborative environment that connects personal development with meaningful impact on the future of business and society.
About the Role
We're looking for a hands-on AI Tech lead to both build and guide. You'll architect and ship production GenAI systems while mentoring a team of engineers - keeping one hand on the keyboard and one eye on the roadmap. This isn't a seat at a whiteboard; it's a role for someone who can write a RAG pipeline in the morning and run a technical design review in the afternoon.
What you'll do
Lead the design and delivery of end-to-end GenAI solutions, from prototyping to production - LLM-powered applications, agents, RAG systems, and fine-tuned models.
Stay hands-on: write production-quality code, review PRs, and set the technical bar for the team.
Define architecture patterns for prompt engineering, context management, retrieval pipelines, and model evaluation.
Mentor and grow a team of AI/ML engineers -run design reviews, pair-program, and provide technical feedback.
Partner with product, data, and platform teams to scope feasibility and drive AI initiatives from ideation to deployment.
Evaluate and introduce new models, tools, and frameworks (LangChain, LlamaIndex, vector DBs, etc.) as the space evolves
Requirements3+ years of software engineering, with 2+ years in ML/AI roles
Hands-on experience building and shipping LLM-based applications (RAG, agents, fine-tuning)
Proficiency in Python; strong command of ML/AI libraries
Experience with at least one major LLM provider (OpenAI, Anthropic, Cohere, open-source)
Proven ability to lead or mentor engineers in a technical context
Comfort working in cloud environments (AWS, GCP, or Azure) with MLOps practices
Skills Required
- 5+ years of experience as a backend software engineer.
- Experience leading the design of AI/GenAI solutions with architectural decisions.
- Proficiency in Python for backend development.
- Experience with production-grade systems including APIs, microservices, and databases.
- Hands-on experience with a major cloud platform (AWS, GCP, Azure).
- Bachelor's degree in Computer Science or related field or equivalent practical experience.
- Leadership capabilities.
- Experience with multiple cloud platforms.
- Experience with Docker and Kubernetes.
- Experience with LLM provider APIs including function calling.
- Data pipeline development experience.
KPMG Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about KPMG and has not been reviewed or approved by KPMG.
-
Leave & Time Off Breadth — Feedback suggests the firm provides generous Paid Time Off, paid holidays, sabbatical leave, military leave, paid volunteer time, and paid sick days. Flexibility is further supported through a hybrid work approach intended to promote well-being.
-
Healthcare Strength — Feedback suggests employees have access to comprehensive health, dental, and vision insurance alongside mental health benefits. Tax-advantaged accounts such as FSA and HSA further strengthen the healthcare offering.
-
Retirement Support — Feedback suggests the package includes a 401(k) plan, a pension plan, life and AD&D insurance, disability coverage, and retiree health and medical benefits. These elements indicate a strong focus on long-term financial security.
KPMG Insights
What We Do
KPMG is a global network of professional firms providing Audit, Tax and Advisory services. We have 273,000 outstanding professionals working together to deliver value in 143 countries and territories. With a worldwide presence, KPMG continues to build on our successes thanks to clear vision, defined values and, above all, our people. Our industry focus helps KPMG firms’ professionals develop a rich understanding of clients' businesses and the insight, skills and resources required to address industry-specific issues and opportunities. The independent member firms of the KPMG network are affiliated with KPMG International Cooperative (“KPMG International”), a Swiss entity. Each KPMG firm is a legally distinct and separate entity and describes itself as such
