AI Engineer

Reposted Yesterday
San Jose, CA, USA
In-Office
133K-193K Annually
Mid level
Artificial Intelligence • Internet of Things • Machine Learning
The Role
Design and ship LLM-powered agentic AI systems and RAG pipelines, build multi-step reasoning workflows, improve model behavior (accuracy, latency, cost), integrate tools and knowledge retrieval, and collaborate on hardware-aware AI optimizations with FPGA/ASIC teams for production platforms.
Summary Generated by Built In
Job Details:

Job Description:

AI Engineer – Agentic AI Systems

Why This Role Matters

AI is shifting from models to autonomous systems. At Altera, we are building agentic AI platforms tightly coupled with FPGA acceleration, enabling intelligent systems that can reason, act, and scale in real-world environments.

This role is designed for high-potential engineers early in their careers who want to:

  • work on cutting-edge AI (LLMs + agents + RAG)

  • gain exposure to hardware-software co-design

  • and grow quickly into technical leaders in AI systems

What You’ll Work On

Build Real Agentic AI Systems

  • Develop LLM-powered agents that use tools, APIs, and data to complete complex tasks

  • Implement RAG pipelines for large-scale knowledge integration

  • Ship end-to-end systems from data ingestion → reasoning → action

Go Beyond “Model Usage”

  • Design multi-step reasoning workflows, not just prompt calls

  • Evaluate and improve model behavior (accuracy, latency, cost)

  • Work with both open-source and frontier models

AI Meets Hardware (Differentiator)

  • Collaborate with FPGA/ASIC teams on hardware-aware AI design

  • Learn how AI systems are optimized across CPU / GPU / FPGA

  • Explore efficient inference and system-level performance tradeoffs

Build Platforms, Not Just Features

  • Develop reusable components for:

    • memory and context management

    • tool integration

    • knowledge retrieval

  • Contribute to internal AI platforms used across teams

The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance.  

 

$133.2K - $192.8K USD 

 

We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations. 

Qualifications:

What We’re Looking For

Background

  • Master’s (or exceptional Bachelor’s) in CS, EE, or related field

  • 3+ years experience (internships, research, or industry)

Technical Strength

  • Strong coding skills in Python (C++ is a plus)

  • Hands-on experience building:

    • AI/ML projects, OR

    • backend / distributed systems

  • Solid fundamentals in:

    • data structures

    • system design basics

Signal of Excellence (What Sets You Apart)

  • You’ve built something non-trivial:

    • AI project, open-source contribution, or research prototype

  • You learn new frameworks quickly and ship working systems

  • You’re curious about how systems work end-to-end, not just models

Bonus Points

  • Experience with:

    • LangChain, LlamaIndex, or similar

    • vector databases (FAISS, Milvus, etc.)

  • Exposure to:

    • RAG, prompt engineering, or agent workflows

    • hardware acceleration or performance optimization

What You’ll Get

Fast Growth

  • Work directly with senior architects and domain experts

  • Clear path toward Senior Engineer → Architect roles

High Learning Density

  • Exposure to both:

    • modern AI systems (LLMs, agents)

    • hardware acceleration (FPGA/ASIC)

Real Ownership

  • Build production systems—not demos

  • Your work will be used in real engineering workflows

Unique Positioning

  • Few roles combine:

    • Agentic AI systems

    • EDA / semiconductor domain

    • hardware-aware AI optimization

Job Type: Regular

Shift:Shift 1 (United States of America)

Primary Location:San Jose, California, United States

Additional Locations:

Posting Statement:All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Skills Required

  • Master's in Computer Science, Electrical Engineering, or related field (or exceptional Bachelor's)
  • 3+ years experience (internships, research, or industry)
  • Strong coding skills in Python
  • Experience with C++
  • Hands-on experience building AI/ML projects or backend/distributed systems
  • Solid fundamentals in data structures
  • Solid fundamentals in system design basics
  • Built non-trivial projects (AI project, open-source contribution, or research prototype)
  • Experience with LangChain, LlamaIndex, or similar frameworks
  • Experience with vector databases (FAISS, Milvus, etc.)
  • Exposure to RAG, prompt engineering, or agent workflows
  • Exposure to hardware acceleration or performance optimization (FPGA/ASIC/CPU/GPU)

Altera (altera.com) Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Altera (altera.com) and has not been reviewed or approved by Altera (altera.com).

  • Retirement Support Feedback suggests retirement programs are robust, with offerings such as a 401(k) and a pension. This breadth supports long-term financial security.
  • Leave & Time Off Breadth Feedback suggests time-off policies are generous, including PTO, paid sick days, and paid holidays. Wellness initiatives like gym memberships further support balance.
  • Parental & Family Support Feedback suggests parental leave is generous. Family-building support, including fertility benefits and adoption reimbursement, is highlighted as part of the package.

Altera (altera.com) Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Jose, California
1,612 Employees
Year Founded: 1983

What We Do

Altera: Accelerating Innovators Altera provides leadership programmable solutions that are easy-to-use and deploy in applications from cloud to edge, offering limitless AI possibilities. Our end-to-end broad portfolio of products including FPGAs, CPLDs, Intellectual Property, development tools, System on Modules, SmartNICs and IPUs provide the flexibility to accelerate innovation. Altera is helping to shape the future through pioneering innovation that unlocks extraordinary possibilities for everyone on the planet.

Similar Jobs

PwC Logo PwC

Artificial Intelligence Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
16 Locations
370000 Employees
63K-142K Annually

PwC Logo PwC

Artificial Intelligence Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
16 Locations
370000 Employees
72K-212K Annually

Zscaler Logo Zscaler

Artificial Intelligence Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees
186K-265K Annually

EchoStar Logo EchoStar

Artificial Intelligence Engineer

Aerospace • Cloud • Digital Media • Information Technology • Mobile • News + Entertainment • Generative AI
In-Office
San Mateo, CA, USA
14500 Employees
134K-182K Annually

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
New York, New York
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account