Senior AI Governance Java Engineer

Posted Yesterday
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Information Technology • Consulting
The Role
Design and build Java/Spring Boot cloud-native services for AI governance, observability, and compliance. Integrate with major AI platforms, implement telemetry and evaluation pipelines, develop orchestration/schedulers, event-driven connectors, dashboards, and CI/CD practices while collaborating across engineering teams.
Summary Generated by Built In

About the Role: 

We are seeking strong Senior Java + AI Platform Engineers to work on strategic enterprise initiatives focused on building scalable AI Governance, observability, and Compliance platforms.

The ideal candidate will have strong expertise in Java backend engineering, distributed systems, AI integrations, telemetry pipelines, and cloud-native architectures. This role involves designing scalable enterprise-grade platforms capable of monitoring, governing, and securing AI interactions across large-scale enterprise environments. 

Key Responsibilities:

  • Design and build pluggable evaluator services using Java and Spring Boot 
  • Develop scalable SaaS/cloud-native backend services and microservices 
  • Integrate with AI platforms including AWS Bedrock, Azure AI Foundry, Google Vertex AI, OpenAI, and Anthropic APIs 
  • Build orchestration frameworks and schedulers for evaluation execution workflows
  • Develop AI risk scoring systems and evaluation pipelines 
  • Design and implement telemetry, monitoring, and observability solutions 
  • Build dashboards and reporting systems for evaluation results and governance insights 
  • Develop integrations/connectors for cloud-native event streams and event-driven architectures 
  • Collaborate with cross-functional engineering teams in an Agile sprint environment 
  • Participate in code reviews, CI/CD setup, and quality engineering practices 
  • Ensure adherence to software development lifecycle and engineering best practices


Requirements

Required Skills & Qualifications

  • 4–7 years of strong backend engineering experience using Java and Spring Boot 
  • Proven expertise in SaaS application development and cloud-native architecture 
  • Strong understanding of REST APIs and microservices architecture 
  • Hands-on experience with at least one AI platform: 
    - AWS Bedrock 
    - Azure OpenAI 
    - Google Vertex AI 
    -OpenAI APIs 
  • Experience with cloud SDKs such as AWS SDK for Java, Azure SDK, or Google Cloud Java libraries 
  • Strong knowledge of CI/CD tools like GitHub Actions, Jenkins, or similar 
  • Experience with testing frameworks including unit, integration, and contract testing 
  • Understanding of orchestration/scheduler frameworks such as Quartz or Spring Batch 
  • Experience with event streaming platforms such as Kafka, AWS Kinesis, Azure Event Hub, or GCP Pub/Sub 
  • Knowledge of ETL/ELT pipelines and stream processing technologies like Flink or Spark Streaming 
  • Experience designing schemas and data models for high-volume telemetry/time-series data 
  • Strong understanding of event-driven architecture and connector development 

Preferred Skills

  • Familiarity with LLM evaluation frameworks such as: 
    -RAGAS 
    -TruLens 
    -DeepEval 

  • Knowledge of AI governance standards and EU AI Act requirements 
  • Experience with workflow orchestration frameworks 
  • Cloud certifications in AWS, Azure, or GCP 
  • Exposure to AI risk assessment and governance tooling 

Must-Have Skills (Non-Negotiable)

  • Strong production-grade experience in Java + Spring Boot 
  • Experience building multi-tenant SaaS/cloud-ntive applications 
  • Strong software development lifecycle discipline 
  • Hands-on exposure to at least one AI platform 
  • REST API and Microservices architecture expertise 
  • Experience with AI evaluation/testing frameworks
  • Telemetry and observability engineering expertise


Benefits

Employee Benefits

  1. Culture:

  • Open Door Policy: Encourages open communication and accessibility to management.
  • Open Office Floor Plan: Fosters a collaborative and interactive work environment.
  • Flexible Working Hours: Allows employees to have flexibility in their work schedules.
  • Employee Referral Bonus: Rewards employees for referring qualified candidates.
  • Appraisal Process Twice a Year: Provides regular performance evaluations and feedback. 

  1. Inclusivity and Diversity:

  • Hiring practices that promote diversity: Ensures a diverse and inclusive workforce.
  • Mandatory POSH training: Promotes a safe and respectful work environment. 

  1. Health Insurance and Wellness Benefits:

  • GMC and Term Insurance: Offers medical coverage and financial protection.
  • Health Insurance: Provides coverage for medical expenses.
  • Disability Insurance: Offers financial support in case of disability. 

  1. Child Care & Parental Leave Benefits:

  • Company-sponsored family events: Creates opportunities for employees and their families to bond.
  • Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child.
  • Family Medical Leave: Offers leave for employees to take care of family members' medical needs. 

  1. Perks and Time-Off Benefits:

  • Company-sponsored outings: Organizes recreational activities for employees.
  • Gratuity: Provides a monetary benefit as a token of appreciation.
  • Provident Fund: Helps employees save for retirement.
  • Generous PTO: Offers more than the industry standard for paid time off.
  • Paid sick days: Allows employees to take paid time off when they are unwell.
  • Paid holidays: Gives employees paid time off for designated holidays.
  • Bereavement Leave: Provides time off for employees to grieve the loss of a loved one. 

  1. Professional Development Benefits:

  • L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development.
  • Mentorship Program: Offers guidance and support from experienced professionals.
  • Job Training: Provides training to enhance job-related skills.
  • Professional Certification Reimbursements: Assists employees in obtaining professional certifications.


Skills Required

  • 4-7 years backend engineering experience using Java and Spring Boot
  • Proven expertise in SaaS application development and cloud-native architecture
  • Experience building multi-tenant SaaS/cloud-native applications
  • Strong understanding of REST APIs and microservices architecture
  • Hands-on experience with at least one AI platform (AWS Bedrock, Azure OpenAI/AI Foundry, Google Vertex AI, OpenAI, Anthropic)
  • Experience with cloud SDKs such as AWS SDK for Java, Azure SDK, or Google Cloud Java libraries
  • Strong software development lifecycle discipline and CI/CD experience (GitHub Actions, Jenkins or similar)
  • Experience with testing frameworks including unit, integration, and contract testing
  • Understanding of orchestration/scheduler frameworks such as Quartz or Spring Batch
  • Experience with event streaming platforms such as Kafka, AWS Kinesis, Azure Event Hub, or GCP Pub/Sub
  • Knowledge of ETL/ELT pipelines and stream processing technologies like Flink or Spark Streaming
  • Experience designing schemas and data models for high-volume telemetry/time-series data
  • Strong understanding of event-driven architecture and connector development
  • Telemetry and observability engineering expertise
  • Experience with AI evaluation/testing frameworks
  • Familiarity with LLM evaluation frameworks such as RAGAS, TruLens, DeepEval
  • Knowledge of AI governance standards and EU AI Act requirements
  • Experience with workflow orchestration frameworks
  • Cloud certifications in AWS, Azure, or GCP
  • Exposure to AI risk assessment and governance tooling
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Hyderabad, Telangana
239 Employees
Year Founded: 2015

What We Do

Established in 2015, we started by recognizing the gap when we identified crucial implementation gaps in the market. While working with a leading technology company, the core team discovered opportunities where our expertise could bridge these gaps, laying the foundation for Kanerika. Dedicated to empowering businesses with cutting-edge technology solutions, we've been on a relentless pursuit to craft efficient, future-ready enterprises, marking our journey with growth and transformative impact milestones About us: - 9+ Years in Business - 6 Offices Across the Globe - 300+ Consultants Worldwide Our Specialization: - Data Analytics - Data Integration - Data Governance - Robotic Process Automation - Generative AI Credentials: - SOC II Compliant - ISO 27001 and ISO 27701 Certified - Microsoft Partner Numbers that Matter: - 99% Client Retention - 95% Customer Satisfaction Rate - 45% YoY Growth Ready to unleash the power of tech in your business? Let's connect! Book a time that works for you here: https://www.kanerika.com/meet

Similar Jobs

Optum Logo Optum

Associate Director - RCM Operations

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Senior Product Manager

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Senior Manager AI/ML Engineering

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Optum Logo Optum

Manager Software Engineering - ReactJS and NextJS

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Hyderabad, Telangana, IND
160000 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account