Staff/Principal Software Engineer (AI Agents)

Reposted 10 Days Ago
Easy Apply
Be an Early Applicant
San Francisco, CA, USA
In-Office
300K-350K Annually
Senior level
Software
The Role
The Technical Director, MLE will lead AI projects, enforce MLOps practices, mentor teams, and architect scalable cloud solutions to enhance data integrations.
Summary Generated by Built In

About Prophecy 

The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. 

Don’t miss the rocket ship—join Prophecy and build the next data revolution.
Great candidates will demonstrate:

Agentic Systems

  • Shipped production single or multi-agent systems (code generation, workflow orchestration, or chatbots)
  • Hands-on with agentic frameworks (LangChain, LlamaIndex, CrewAI, or custom)
  • Prompt engineering and evaluation harness implementation

Technical Depth

  • Strong backend engineering: microservices, high-throughput/low-latency systems, async processing, API design, cloud deployment (k8s, AWS)
  • Fluent in several of programming languages: Python, Go, Java, or Scala
  • Shipped features in large codebases (>500k LOC)

Leadership & Delivery

  • Led 2+ user-facing AI projects from ambiguity to production impact
  • Active hands-on coder: prototypes weekly, debugs production, unblocks teams
  • Daily user of AI coding agents (Cursor, Claude Code, etc.)
  • Enforces MLOps rigor: CI/CD, observability, A/B testing, on-call culture
  • Partnered cross-functionally with PMs/execs on roadmap and metrics
  • Showed Extreme Ownership & Startup Mentality – build and ship fast, fix things themselves, and care deeply about user impact.
What Will Make You Stand Out:
  • Code generation models and agents (Codex, text-to-SQL), semantic extraction, or knowledge graphs (Neo4j, Neptune)
  • Compiler development (SQL, Python, Scala) or tooling (VSCode extensions, LSP, debuggers)
  • ML/LLM experience with fine-tuning (SFT, DPO, RLHF), distillation, quantization
  • RAG systems and vector databases (Pinecone, Weaviate, pgvector)
  • ETL pipelines with Spark or data processing at scale
  • Open-source AI/ML contributions (Hugging Face, PyTorch, etc.)
  • Track record driving technical strategy and build/buy decisions
At Prophecy, you will:
  • Own coding-agent services and architecture end-to-end
  • Mentor engineers and lead on the toughest technical problems
  • Design, code and ship state-of-the-art coding agents for ETL and data analysis
  • Drive both early exploration / prototyping and expanding our production platform
  • Build evaluation frameworks, testing harnesses, and observability/governance
  • Optimize prompts, context engineering, model selection, fine-tuning, and cost/performance

Seniority: Staff to Principal 

Experience: 5+ years in industry

Compensation:  $300,000 - $500,000

Reflected is the base pay range and equity offered for this position. Pay may vary depending on factors including but not limited to achievements, skills, experience, or work location. The range listed is just one component of the compensation package offered to candidates. 

Benefits and Perks

  • Prophecy covers 99% of employee health insurance premiums and 75% for dependents
  • We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!
  • Flexible PTO
  • Professional development allowance
  • Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more
  • Ability to have your fingerprint on an innovative platform
  • End-to-end ownership of your projects.

*Benefits and perks may vary per country

Our Commitment to Diversity and Inclusion

At Prophecy, we hire for merit and foster an inclusive culture where people from diverse backgrounds can excel and do their best work. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Prophecy are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and any other protected characteristics under applicable laws.

Top Skills

AWS
Crewai
GCP
Go
Huggingface
Java
Kubernetes
Langchain
Llamaindex
Python
PyTorch
Scala
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
94 Employees
Year Founded: 2017

What We Do

Prophecy.io is the only low-code data engineering platform. Prophecy democratizes the development and deployment of high-quality data pipelines, uniquely combining visual development with agile software engineering best practices. The developed code is open source and is targeted at Apache Spark & Apache Airflow. Prophecy is headquartered in Silicon Valley.

Similar Jobs

BlackLine Logo BlackLine

Consultant

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Remote or Hybrid
Los Angeles, CA, USA
1810 Employees
108K-135K Annually

ServiceNow Logo ServiceNow

Senior Manager - US International Tax

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
28000 Employees
166K-290K Annually

ServiceNow Logo ServiceNow

AI Product Portfolio Director

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
28000 Employees
192K-264K Annually

ServiceNow Logo ServiceNow

Associate Manager, AMS Media

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Santa Clara, CA, USA
28000 Employees
104K-172K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account