Senior Software Engineer - Generative AI

Posted Yesterday
Be an Early Applicant
Hyderabad, Telangana, IND
In-Office
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Your talent powers our future.
The Role
Build and productionize enterprise-grade Generative AI applications on AWS: design RAG pipelines, agentic workflows, embeddings and vector search, backend services and APIs, monitoring and evaluation pipelines, ensure security and responsible AI, and scale reusable frameworks while mentoring engineers.
Summary Generated by Built In
Our vision is to transform how the world uses information to enrich life for all .
Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.
Our vision is to transform how the world uses information to enrich life for all.
Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.
About the Role
We are looking for a hands-on Senior Software Engineer - Generative AI to compose, build, and productionize enterprise-grade GenAI applications on AWS. This role is ideal for an engineer who combines strong software engineering fundamentals with real-world experience delivering LLM-powered solutions in production. You will operate in a forward-deployed engineering model-working closely with business and product teams to understand workflows, rapidly prototype solutions, and drive them to full-scale production.
Responsibilities:
  • Develop, build, and productionize GenAI applications on AWS, using services such as Amazon Bedrock and core cloud infrastructure.
  • Build RAG pipelines, agentic workflows, tool/function-calling systems, and AI-powered enterprise assistants.
  • Work directly with business collaborators to understand workflows, find opportunities, and deliver impactful AI solutions.
  • Build backend services, APIs, and orchestration layers for GenAI systems, including vector search, embeddings, and model integration.
  • Own end-to-end lifecycle from prototype to production: architecture, development, deployment, monitoring, and optimization.
  • Build and implement evaluation pipelines (accuracy, groundedness, latency, cost, safety) for GenAI systems.
  • Ensure enterprise-grade security and responsible AI practices, including access control, PII handling, guardrails, and prompt-injection mitigation.
  • Build reusable frameworks, templates, and playbooks to scale GenAI adoption across teams.
  • Stay hands-on with the codebase, participate in build reviews, and mentor engineers on GenAI guidelines.

Minimum Qualifications:
  • 6-9 years of professional software engineering experience.
  • Minimum 2+ years of production experience with Generative AI / LLM-based systems.
  • Strong backend engineering expertise in Python with experience in APIs, microservices, and distributed systems.
  • Hands-on experience building production GenAI applications using RAG, agents/tool calling/orchestration, embeddings, and vector databases.
  • Strong experience with AWS cloud ecosystem, preferably including Amazon Bedrock, S3, Lambda, ECS/EKS, API Gateway, OpenSearch/vector search, RDS/Postgres, IAM, KMS, Secrets Manager, and CloudWatch.
  • Experience crafting scalable, secure, and reliable systems in production.
  • Strong problem-solving skills with the ability to translate ambiguous business problems into technical solutions.
  • Excellent communication and collaborator management skills.

Preferred Qualifications:
  • Experience with frameworks such as LangChain, LangGraph, LlamaIndex, DSPy, Semantic Kernel, CrewAI, AutoGen.
  • Experience building multi-agent systems, enterprise copilots, document intelligence, or search systems.
  • Knowledge of LLMOps / MLOps practices (model versioning, A/B testing, evaluation pipelines).
  • Experience in customer-facing or forward-deployed engineering roles.
  • Exposure to frontend frameworks (React / Angular).
  • Experience with Kubernetes, Docker, Terraform/CDK.

Who Will Succeed in This Role
You are a hands-on builder who enjoys solving real business problems using AI-not just crafting demos. You are comfortable working across ambiguity, writing production-grade code, and collaborating closely with partners. If you enjoy owning solutions end-to-end-from problem discovery to production deployment-and want to develop how GenAI is applied in real enterprise systems, this role is for you!
At Micron we take pride in empowering our employees and their families to stay happy, healthy, and financially well. Micron is proud to be an equal opportunity workplace and is an affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state, or local laws.
To learn more about Micron, please visit micron.com/careers
Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.
Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron
About Micron Technology, Inc.
We are an industry leader in innovative memory and storage solutions transforming how the world uses information to enrich life for all . With a relentless focus on our customers, technology leadership, and manufacturing and operational excellence, Micron delivers a rich portfolio of high-performance DRAM, NAND, and NOR memory and storage products through our Micron® and Crucial® brands. Every day, the innovations that our people create fuel the data economy, enabling advances in artificial intelligence and 5G applications that unleash opportunities - from the data center to the intelligent edge and across the client and mobile user experience.
To learn more, please visit micron.com/careers
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
To request assistance with the application process and/or for reasonable accommodations, please contact [email protected]
Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.
Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.
AI alert: Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.
Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.

Skills Required

  • 6-9 years of professional software engineering experience
  • Minimum 2+ years of production experience with Generative AI / LLM-based systems
  • Strong backend engineering expertise in Python with experience in APIs, microservices, and distributed systems
  • Hands-on experience building production GenAI applications using RAG, agents/tool calling/orchestration, embeddings, and vector databases
  • Strong experience with AWS cloud ecosystem
  • Experience with AWS services (Amazon Bedrock, S3, Lambda, ECS/EKS, API Gateway, OpenSearch/vector search, RDS/Postgres, IAM, KMS, Secrets Manager, CloudWatch)
  • Experience crafting scalable, secure, and reliable systems in production
  • Strong problem-solving skills and ability to translate ambiguous business problems into technical solutions
  • Excellent communication and collaborator management skills
  • Experience with frameworks such as LangChain, LangGraph, LlamaIndex, DSPy, Semantic Kernel, CrewAI, AutoGen
  • Experience building multi-agent systems, enterprise copilots, document intelligence, or search systems
  • Knowledge of LLMOps / MLOps practices (model versioning, A/B testing, evaluation pipelines)
  • Experience in customer-facing or forward-deployed engineering roles
  • Exposure to frontend frameworks (React / Angular)
  • Experience with Kubernetes, Docker, Terraform/CDK

Micron Technology Compensation & Benefits Highlights

  • Retirement Support The RAM 401(k) plan provides a dollar‑for‑dollar company match up to 5% of eligible pay with automatic enrollment and escalation. After‑tax contributions and in‑plan Roth conversions add flexibility for additional savings.
  • Healthcare Strength Multiple medical plan options with HSA/FSA support, mental‑health resources, and wellness programs are documented. Access to the Micron Family Health Center at Boise for enrollees adds onsite care in certain locations.
  • Equity Value & Accessibility An Employee Stock Purchase Plan enables purchases of company stock at a 15% discount in multiple regions. Company materials also reference equity participation, reinforcing employee ownership opportunities.

Micron Technology Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Boise, ID
45,000 Employees
Year Founded: 1978

What We Do

We are a world leader in innovative memory solutions that transform how the world uses information to enrich life for all. For over 45 years, our company has been instrumental to the world’s most significant technology advancements, delivering optimal memory and storage systems for a broad range of applications.

Why Work With Us

Global opportunities, team member development, and career advancement—Micron invests in you and celebrates your skills, a growth mindset, and the tenacity to strive. At Micron, everyone innovates.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery

Micron Technology Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Micron recognizes the importance of maintaining a healthy work-life balance to foster a culture of collaboration, innovation and meet the needs of the business. In alignment with these values, we offer four flexible work arrangement options

Typical time on-site: Flexible
HQBoise, ID
Bengaluru, Karnataka
Folsom, CA
Hyderabad, Telangana
Longmont, CO
Madhapur, Telangana
Manassas, VA
Milpitas, CA
Singapore, SG
Singapore, SG
Sydney, AU
Ulsoor, Bengaluru
Learn more

Similar Jobs

Micron Technology Logo Micron Technology

Embedded Software Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Micron Technology Logo Micron Technology

Senior Data Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Micron Technology Logo Micron Technology

Senior Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Micron Technology Logo Micron Technology

Senior Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account