Staff AI/ML Engineer

Reposted 14 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
250K-350K Annually
Senior level
Software
The Role
The role involves building and deploying AI-native data solutions, focusing on LLM and agent development, automation workflows, and data analysis, while leveraging cloud technologies.
Summary Generated by Built In

About Prophecy 

The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. 

Don’t miss the rocket ship—join Prophecy and build the next data revolution.

Must-Have Skills:

  • Hands-on LLM/agent building (e.g., LangChain/Graph, CrewAI) and tuning to quality benchmarks.
  • Experience with semantic search, RAG, and vector databases.
  • Experience with prompt engineering and optimization
  • Agentic Use Cases: Hands-on experience building and deploying agents in at least one of the following scenarios:
    • Workflow Orchestration: Automating multi-step processes (e.g., ETL pipelines, supply chain optimization, or CRM workflows like Salesforce Agentforce).
    • Code Generation/Assistance: Developing or debugging code autonomously (e.g., similar to Devin AI or GitHub Copilot extensions).
    • Data Analysis/Transformation: Querying, manipulating, or analyzing data across sources (e.g., topic extraction, document analytics in vector DBs like Weaviate).
    • Personalized Assistance: Tailoring recommendations or plans (e.g., e-commerce, education, or finance agents).
    • Autonomous Decision-Making: Real-time decisions in domains like trading or healthcare (e.g., crypto trading, medical workflow optimization).
    • Content Creation: Generating text, art, or media (e.g., social media automation, presentation creation).
    • Multi-Agent Systems: Collaborative agents for simulations or transactions (e.g., policy-constrained evaluation, machine-to-machine commerce).
  • Versatile software developer: fluency in Python, REST APIs, microservices in public cloud; some experience with Go, AWS, k8s, java, Scala.
  • Builder mentality: Demonstrated experience taking ideas to production.

What Will Make You Stand Out

  • Expertise in building and managing Knowledge Graphs, including entity extraction, linkage, and ontology design.
  • Experience integrating Knowledge Graph with AI systems for retrieval, reasoning, and agent context (e.g., enriching with LLM).
  • ML/LLM work in code generation (e.g., Codex, text-to-SQL), semantic extraction, or knowledge graphs (e.g., Neo4j, Neptune).
  • Experience with big-data engines like Spark.
  • Compiler development for languages like SQL, Python, or Scala.
  • Optimization of ML models for low-latency, high-throughput production use.
  • Contributions to open-source AI/ML projects (e.g., Hugging Face, PyTorch).
  • Expertise in retrieval systems or vector databases (e.g., Pinecone, Weaviate).
  • Skill in evaluating tech and driving build/buy decisions

Seniority: Staff or Principal 

Location: This is a Hybrid role with 2-3 days a week in office. However, this can vary week to week. 

Experience: 6+ years of Software Engineering experience minimum with 2+ of these being in AI/ML

Compensation:  $250,000–$350,000 + Additional Equity

Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to achievements, skills, experience, or work location. The range listed is just one component of the compensation package offered to candidates. 

Benefits and Perks

  • Prophecy covers 99% of employee health insurance premiums and 75% for dependents
  • We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!
  • Flexible PTO
  • Professional development allowance
  • Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more
  • Ability to have your fingerprint on an innovative platform
  • End-to-end ownership of your projects. 

*Benefits and perks may vary per country

Prophecy is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, age, disability, or veteran status.

Skills Required

  • Hands-on LLM/agent building and tuning to quality benchmarks
  • Experience with semantic search, RAG, and vector databases
  • Experience with prompt engineering and optimization
  • Fluency in Python, REST APIs, and microservices in public cloud
  • 6+ years of Software Engineering experience minimum, with 2+ in AI/ML
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
94 Employees
Year Founded: 2017

What We Do

Prophecy.io is the only low-code data engineering platform. Prophecy democratizes the development and deployment of high-quality data pipelines, uniquely combining visual development with agile software engineering best practices. The developed code is open source and is targeted at Apache Spark & Apache Airflow. Prophecy is headquartered in Silicon Valley.

Similar Jobs

General Motors Logo General Motors

Machine Learning Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
4 Locations
165000 Employees

General Motors Logo General Motors

Machine Learning Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
Sunnyvale, CA, USA
165000 Employees
189K-321K Annually

GlobalFoundries Logo GlobalFoundries

Staff Engineer

Semiconductor • Manufacturing
In-Office
3 Locations
12676 Employees
106K-205K Annually

GlobalFoundries Logo GlobalFoundries

Staff Software Engineer

Semiconductor • Manufacturing
In-Office
3 Locations
12676 Employees
106K-184K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account