Remote position with the ability to travel to our NJ and NY locations up to 25% of the time.
Position Summary: The position is responsible for designing, building, deploying, and maintaining enterprise-grade Agentic AI solutions under the direction of an Sr. AI Engineer. This role focuses on implementing autonomous and semi-autonomous AI agents using large language models (LLMs), orchestration frameworks, and Azure-native AI services.
The position supports intelligent automation initiatives across Insurance business domains by translating product requirements into scalable, secure, and observable AI systems.
Essential Duties and Responsibilities:
- Design, develop, and deploy Agentic AI systems based on product requirements defined by the Business SMEs.
- Implement agent workflows including:
- Planning, execution, validation, and retry logic
- Tool and API invocation
- Context and memory management
- Build and maintain LLM-powered pipelines, including RAG-based architectures.
- Integrate AI agents with enterprise systems using APIs, event-driven workflows, and automation services.
- Develop and manage data ingestion and enrichment pipelines for structured and unstructured data.
- Monitor AI system performance, accuracy, latency, and cost; implement optimizations and improvements.
- Implement guardrails, safety mechanisms, and human-in-the-loop controls.
- Support production deployment using Azure-native services and CI/CD pipelines.
- Document system architecture, workflows, prompts, and operational runbooks.
- Collaborate with product managers, architects, and data teams to iterate on AI solutions.
- Participate in special projects and perform additional duties as required.
QualificationsEducation and Experience:
- Bachelor’s Degree in Computer Science, Engineering, or related field required.
- 1–3 years of experience in AI/ML engineering, data engineering, or software engineering required.
- Hands-on experience with LLMs, GenAI, or intelligent automation systems required.
- Experience building AI solutions on cloud platforms, preferably Microsoft Azure required.
- Exposure to Agentic AI, workflow orchestration, or multi-agent systems preferred.
- Strong proficiency in Python and AI/ML libraries.
- Hands-on experience with:
- LLMs, prompt engineering, and RAG architectures
- Vector databases and semantic search
- Agent orchestration frameworks
- Experience with Microsoft Azure, including:
- Azure OpenAI
- Azure Functions, Logic Apps, AKS
- Knowledge of API development and system integration.
- Familiarity with CI/CD pipelines, Git-based version control, and Agile delivery.
- Strong analytical, troubleshooting, and communication skills.
- Azure AI Fundamentals or equivalent certification preferred.
- Familiarity with data privacy, security, and compliance in AI development.
- Exposure to prompt engineering and GenAI tools a plus.
- Insurance domain exposure preferred.
The salary range for this role is $69,100-$124,400. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs. Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.
Skills Required
- Bachelor's Degree in Computer Science, Engineering, or related field
- 1-3 years experience in AI/ML engineering, data engineering, or software engineering
- Hands-on experience with LLMs, Generative AI, or intelligent automation systems
- Experience building AI solutions on cloud platforms (preferably Microsoft Azure)
- Proficiency in Python and AI/ML libraries
- Experience with RAG architectures, prompt engineering, vector databases, and semantic search
- Experience with agent orchestration frameworks and implementing agent workflows
- Experience with Microsoft Azure services including Azure OpenAI, Azure Functions, Logic Apps, AKS
- Knowledge of API development and system integration
- Familiarity with CI/CD pipelines and Git-based version control
- Familiarity with data privacy, security, and compliance in AI development
- Strong analytical, troubleshooting, and communication skills
- Exposure to Agentic AI, workflow orchestration, or multi-agent systems
- Azure AI Fundamentals or equivalent certification
- Insurance domain exposure
- Exposure to prompt engineering and GenAI tools (a plus)
What We Do
Greater New York Insurance Companies are leading providers of middle market property and casualty insurance focusing on commercial real estate, including condominiums, co-op apartment buildings, office buildings, restaurants, light manufacturing, and other small to mid-size commercial establishments. The lead company was formed as a mutual insurance company in 1914 as an outgrowth of a real estate trade association servicing New York City property owners. Now, over 100 years after its founding, GNY writes business in 15 states primarily in the Northeast, Mid-Atlantic and Midwest regions of the United States.







