IT Software Engineer

Reposted 8 Hours Ago
Be an Early Applicant
3 Locations
In-Office
Senior level
Cloud • Software • Analytics
The Role
The AI Product Owner will lead cross-functional AI projects, transforming internal processes and driving measurable outcomes by leveraging AI solutions across various business functions.
Summary Generated by Built In

At NiCE, we don’t limit our challenges. We challenge our limits. Always. We’re ambitious. We’re game changers. And we play to win. We set the highest standards and execute beyond them. And if you’re like us, we can offer you the ultimate career opportunity that will light a fire within you.

IT Software Engineer, Core AI Development

So, what’s the role all about?

NICE is assembling a core engineering team to build the internal AI platform that powers intelligent automation across the enterprise. As IT Software Engineer in the Orchestration AI Development team, you will move beyond using AI tools, you will build them.

You will implement the foundational components of NICE's AI architecture: the integration layer that connects enterprise systems via MCP, the agent orchestration engine, the Models Gateway, RAG pipelines, and the tooling that makes every developer at NICE more productive. Your work ships to production and is used daily by hundreds of colleagues.

This is a full-stack engineering role with a strong AI focus. You will write clean, production-quality code, collaborate closely with the Software Architect and DevOps teams, and operate with significant autonomy on technically complex problems.

 

 How will you make an impact?  

You will own and build the core components of NICE's AI platform, the integration layer, agent platform, Models Gateway, RAG pipelines, and developer tooling, working hands-on across the stack with the Architect, DevOps, and Security teams.

Build the MCP Integration Layer 

 Implement MCP server and client libraries that connect enterprise systems (Atlassian, Microsoft 365, ServiceNow, Workday, Salesforce, Snowflake) to AI agents
 Design and expose clean tool schemas; handle auth flows (OAuth2, managed identity); implement error handling, retries, and rate limiting
 Build the A2A (Agent-to-Agent) interoperability layer enabling multi-agent collaboration across the platform

Develop the AI Agentic Platform 

 Implement production-grade AI agent frameworks: ReAct loops, tool-augmented reasoning, multi-agent orchestration, memory and state management
 Build agent harnesses for specific NICE use cases: IT helpdesk automation, procurement workflows, HR self-service, developer productivity agents
 Integrate with Azure AI Foundry and Anthropic Claude API, managing context windows, tool use, streaming responses, and multi-turn conversations

Engineer the Models Gateway 

 Build a unified gateway abstracting multiple LLM providers (Azure OpenAI, Anthropic, open-source models via Azure ML)
 Implement model routing logic, fallback chains, cost-based dispatch, latency budgeting, and per-team quota enforcement
 Add logging, token metering, and usage dashboards for FinOps visibility

Build RAG Pipelines & Vector Infrastructure 

 Design and implement document ingestion pipelines: chunking, embedding generation, metadata enrichment, and upsert into vector stores
 Build retrieval pipelines with hybrid search (dense + sparse), re-ranking, and context assembly for LLM prompts
 Manage vector DB infrastructure on Azure AI Search and/other; own schema design and index optimization

Implement Prompt Management & LLM Evals 

 Build a prompt registry: version control, templating engine, environment promotion, and rollback
 Design and run LLM evaluation pipelines: automated regression tests, hallucination detection, task-specific benchmarks
 Implement human-in-the-loop feedback collection and model performance tracking dashboards

Contribute to Developer Tooling & CI/CD 

 Build and maintain GitHub Actions workflows for AI component testing, deployment, and rollback
 Write reusable SDK / client libraries for internal teams consuming the AI platform
 Integrate GitHub Copilot and Azure AI Foundry into the development workflow; document patterns for the broader R&D org

Observability & Production Operations 

 Instrument all AI components with OpenTelemetry: traces, metrics, and structured logs
 Build Azure Monitor dashboards and alerts covering inference latency, error rates, token spend, and agent success rates
 Participate in on-call rotation for critical AI platform services

 

Have you got what it takes? 
 2-5 years of professional software engineering experience with Python or TypeScript in production environments
 Hands-on experience building and deploying LLM-powered applications: RAG pipelines, agents, tool use, or prompt engineering systems
 Strong understanding of REST API design, async programming, and event-driven architecture
 Experience with at least one agent or orchestration framework: LangChain, LangGraph, AutoGen, CrewAI, or equivalent
 Practical knowledge of Azure services: at minimum Azure OpenAI, Azure Storage, and Azure Container Apps or AKS
 Solid Git workflow: branching, PRs, code review, CI integration
 Ability to write clean, tested, documented code that others can build on
 Comfort working in fast-moving environments with evolving requirements
 Fluency in English

Bonus: 

 Experience implementing MCP servers / clients or similar tool-integration protocols
 Familiarity with the Anthropic Claude API, tool use patterns, and multi-turn conversation management
 Experience with vector databases: Azure AI Search, pgvector, Qdrant, Weaviate, or Pinecone
 Knowledge of LLM evaluation frameworks: Evals, RAGAS, LangSmith, or custom harness development
 Experience with GitHub Copilot enterprise configuration, policy management, or extension development
 Background in enterprise IT systems integration (Jira, ServiceNow, Salesforce, Workday, M365)
 Familiarity with OpenTelemetry instrumentation and Azure Monitor / Grafana

 

Why Join Us? 

At NiCE, we don’t just connect systems, we connect people, platforms, and possibilities. In this role, you’ll be at the heart of driving product unification, governance, and go-to-market alignment across a mission-critical platform. You’ll join a team that breaks down silos and enables seamless customer experiences across our product ecosystem. 

If you are a strategic thinker, a collaborative leader, and passionate about delivering cross-platform value, this is your opportunity to shape the future of customer experience with NiCE. 

 

What’s in it for you?

Join an ever-growing, market disrupting, global company where the teams – comprised of the best of the best – work in a fast-paced, collaborative, and creative environment! As the market leader, every day at NiCE is a chance to learn and grow, and there are endless internal career opportunities across multiple roles, disciplines, domains, and locations. If you are passionate, innovative, and excited to constantly raise the bar, you may just be our next NiCEr!

Enjoy NiCE-FLEX! 

At NiCE, we work according to the NiCE-FLEX hybrid model, which enables maximum flexibility: 2 days working from the office and 3 days of remote work, each week. Naturally, office days focus on face-to-face meetings, where teamwork and collaborative thinking generate innovation, new ideas, and a vibrant, interactive atmosphere.

About NiCE

NICE Ltd. (NASDAQ: NICE) software products are used by 25,000+ global businesses, including 85 of the Fortune 100 corporations, to deliver extraordinary customer experiences, fight financial crime and ensure public safety. Every day, NiCE software manages more than 120 million customer interactions and monitors 3+ billion financial transactions.

Known as an innovation powerhouse that excels in AI, cloud and digital, NiCE is consistently recognized as the market leader in its domains, with over 8,500 employees across 30+ countries.

NiCE is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, age, sex, marital status, ancestry, neurotype, physical or mental disability, veteran status, gender identity, sexual orientation or any other category protected by law.


Skills Required

  • Bachelor's degree in Industrial Engineering, Information Systems or a related field
  • 5+ years of experience as a technical project manager/product manager
  • At least 1 year hands-on with AI projects
  • Familiarity with Anthropic Claude, Microsoft Copilot Studio or similar platforms
  • Solid understanding of AI agents and automation
  • Experience leading complex cross-functional projects
  • Experience leading products that change process dynamics

NICE Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NICE and has not been reviewed or approved by NICE.

  • Healthcare Strength Benefits are described as broad and comprehensive, spanning medical, dental, vision, life, disability, and mental-health support. Added programs like FSA options and fitness stipends contribute to a well-rounded health and wellness offering.
  • Retirement Support A 401(k) is part of the package, sometimes paired with match details that are described as typical to stronger depending on role and time period. Employee stock participation is also positioned as an additional long-term wealth-building component for eligible roles.
  • Flexible Benefits Flexible work arrangements are emphasized, including hybrid setups and remote options for some roles. Flex scheduling, paid holidays, and paid sick time add to the perceived flexibility of the overall rewards package.

NICE Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Hoboken, NJ
10,130 Employees
Year Founded: 1986

What We Do

NICE (Nasdaq: NICE) is the worldwide leading provider of both cloud and on-premises enterprise software solutions that empower organizations to make smarter decisions based on advanced analytics of structured and unstructured data. NICE helps organizations of all sizes deliver better customer service, ensure compliance, combat fraud and safeguard citizens. Over 25,000 organizations in more than 150 countries, including over 85 of the Fortune 100 companies, are using NICE solutions. www.nice.com.

Similar Jobs

Optum Logo Optum

Senior Quality Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Draper, UT, USA
160000 Employees
92K-164K Annually

Pluralsight Logo Pluralsight

Senior Manager, Marketing Operations

Edtech • Information Technology • Software
Remote or Hybrid
USA
1000 Employees
122K-160K Annually

Pluralsight Logo Pluralsight

VP, Marketing Operations & Digital Platform

Edtech • Information Technology • Software
Remote or Hybrid
USA
1000 Employees
227K-270K Annually

Pluralsight Logo Pluralsight

Principal Product Designer

Edtech • Information Technology • Software
Remote or Hybrid
USA
1000 Employees
148K-195K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account