Role: Lead AI Software Engineer (507554)
Location: Chicago,
IL (Hybrid – 2 Days a week onsite)
Duration: 12 Month
Contract
Must Have
Skills/Attributes: AI, API, AWS, Java, LLM (Large
Language Model), Microservices, RAG (Retrieval-Augmented Generation)
Experience Desired:
· Java
Backend Development
· Microservices
& API Architecture (10+ Years)
· Software
Architecture & Large-Scale Distributed Systems (8+ Years)
· AWS
Cloud, Docker & Kubernetes (Cloud-Native Development) (8+ Years)
· Generative
AI, LLMs, AI Agents, Prompt Engineering & RAG
(LangChain/LangGraph/AutoGen/CrewAI) (3+ Years)
· Technical
Leadership, Engineering Governance & Mentoring Multiple Teams (2+ Years)
Required Minimum
Education: Bachelor’s Degree
Job Description
Required
Education/Experience:
· Bachelor’s degree in Computer science or
Electrical engineering or related field
Required Technical
Skills:
· 8+ years of professional software engineering
experience and 2+ years in a technical leadership role.
· Proven experience designing and delivering
large-scale distributed systems.
· Strong expertise in software architecture,
APIs, microservices, cloud-native applications, and modern engineering
practices.
· Experience influencing multiple engineering
teams and leading organization-wide technical initiatives.
· Strong communication, collaboration, and
stakeholder management skills.
· Demonstrated ability to mentor engineers and
drive technical excellence.
· Experience with Generative AI, AI agents,
LLM-powered applications, or intelligent automation platforms.
· Experience with AI development tools, coding
assistants, and modern developer productivity platforms.
· Knowledge of security architecture,
application security, and cloud security best practices.
· Experience establishing technical governance
and engineering standards across multiple teams.
Required Soft Skills:
· Ability to work under pressure and within
time constraints
· Passion for technology and an eagerness to
contribute to a team-oriented environment
· Lead architectural designs and able to work
across teams to come up with solutions.
Summary of Role:
· Design and orchestrate multi-agent workflows
and stateful AI systems using modern frameworks like LangChain, LangGraph,
AutoGen, or CrewAI.
· Integrate foundation models (e.g., Anthropic
Claude, OpenAI GPT, Google Gemini) via secure API gateways, managing token
limits, costs, and rate-limiting.
· Architect data models optimized for AI-native
structures, integrating relational databases with vector databases for semantic
search and Retrieval-Augmented Generation (RAG).
· Implement robust white-box testing and
continuous evaluation metrics to monitor AI outputs for factual correctness,
hallucinations, and safety compliance.
· Champion secure, reliable, and scalable
software solutions through architectural leadership, risk management, and
continuous improvement of engineering practices.
Technical Leadership
& Workflow Optimization:
· Mentor and scale an engineering team,
establishing engineering standards, best practices and architectural governance
for secure coding, continuous integration, and cloud-native deployment.
· Drive AI-assisted engineering velocity by
integrating next-gen development tools (e.g., Cursor, Claude Code, Windsurf)
into the team's daily Software Development Life Cycle (SDLC).
· Establish governance policies and coach
developers on the responsible use of AI, focusing on input data sensitivity,
license compliance, and security guardrails.
· Evaluate existing systems, services, APIs,
and data models to identify opportunities for modernization, scalability, and
performance improvements.
Influence Across Teams
& Champion Developer Experience:
· Facilitate technical leadership forums with
Product Owners, Technical Leads, Architects, and Engineering Managers.
· Drive conversations around architecture,
engineering health, technical debt, AI adoption, and continuous improvement.
· Mentor engineers and technical leaders on
system design, software architecture, and engineering excellence.
· Foster collaborative decision-making through
architecture reviews, RFCs, and technical discussions.
· Promote self-service engineering capabilities
and platform enablement.
· Drive automation initiatives that improve
productivity and software quality.
Interaction with team:
· Significant interaction required with Scrum
team. Interaction during all scrum ceremonies such as Daily Standups, Sprint
Planning, Grooming, Retro, Demo etc
· Also need to interact with team for PR
Reviews, also need to engage with other teams as needed.
Core Software
Engineering:
· Backend Systems: Deep proficiency in backend
environments, microservices architectures, and API design using Java.
· Cloud & DevOps: Extensive experience with
containerization (Docker, Kubernetes) and public cloud infrastructure like AWS
AI & LLM Infrastructure
· Orchestration & Tooling: Hands-on experience
with production-level AI agents, prompt engineering, and advanced Agentic PDLC
patterns.
· Vector Databases: Practical knowledge of
vector technologies such as Pinecone, Milvus, Chroma, or pgvector.
· AI Tool Fluency: Demonstrated mastery of AI
coding assistants and a firm understanding of Model Context Protocol (MCP) to
mediate agent connections with external databases.
Skills Required
- Bachelor's degree in Computer Science, Electrical Engineering, or a related field
- 8+ years of professional software engineering experience
- 2+ years in a technical leadership role
- 10+ years of microservices and API architecture experience
- 8+ years of software architecture and large-scale distributed systems experience
- 8+ years of AWS cloud, Docker, Kubernetes, and cloud-native development experience
- 3+ years of Generative AI, LLMs, AI agents, prompt engineering, and RAG experience
- Experience designing and delivering large-scale distributed systems
- Experience with software architecture, APIs, microservices, cloud-native applications, and modern engineering practices
- Experience influencing multiple engineering teams and leading organization-wide technical initiatives
- Experience mentoring engineers and driving technical excellence
- Experience with Generative AI, AI agents, LLM-powered applications, or intelligent automation platforms
- Experience with AI development tools, coding assistants, and developer productivity platforms
- Knowledge of security architecture, application security, and cloud security best practices
- Experience establishing technical governance and engineering standards across multiple teams
- Strong communication, collaboration, and stakeholder management skills
- Experience with production-level AI agents, prompt engineering, and agentic development lifecycle patterns
- Practical knowledge of vector databases such as Pinecone, Milvus, Chroma, or pgvector
- Understanding of Model Context Protocol
Similar Jobs
What We Do
Established in 2004, 3Core System is a certified small minority owned business providing ERP Systems Integration, AMS, IT Consulting and Staff Augmentation Services to Fortune 1000, SMB, and State, Local and Education (SLED) customers. While our System Integration services help organizations achieve digital and cloud transformation objectives, AMS Services help increase the availability of critical services of end user applications. On the other hand, our IT Consulting Services would provide subject matter experts to help you assist with specific project needs and the Staff Augmentation services help you balance workload and achieve budget parameters. >ERP System Integration Services: 3Core Systems is an SAP Silver Partner and authorized service provider offering technical architecture, application design and configuration, integration, testing, data migration and solution adoption services for solutions including SAP SuccessFactors, SAP HCM On-Premises and SAP Business Intelligence >Application Management Services (AMS): We offer post go-live, System Health Check and Optimization, Function Enhancements, Integration Monitoring, Release, and patch services. Our AMS services span across SAP Solutions including ERP (S/4 HANA), Financial Management, Human Capital Management, Data and Analytics, Supply Chain, CRM, and Customer Experince. >IT Consulting and Staffing Augmentation Services: Ever since its inception, 3Core Systems has been offering IT Consulting and Staff Augmentation solutions including temporary, long-term, project based and contract staffing services that could be personalized based on your needs. Our staffing services span across emerging technologies and legacy solutions including but not limited to Artificial Intelligence, Machine Learning, Data Science, Cloud, ERP, CRM, BI/BW/ETL, Database, Web & E-Commerce, UI/UX, Network & Security and Mobile.







