The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale.
Prophecy is a Core Technology and Deep-IP company with engineering centered in India. Prophecy engineers often say that they have never worked in a more productive, higher horsepower organization in their careers. The engineers love their work, are being challenged, and are doing the best work of their careers.
Don’t miss the rocket ship, join Prophecy and build the next data revolution.
The Principal AI Engineer (Technical Lead), will have the following:
- Technical Depth (one of the below)
- ML/LLM: Led fine-tuning (SFT, DPO, RLHF), distillation, quantization with PyTorch/HuggingFace
- Shipped production agents (LangChain, LlamaIndex, CrewAI)
- Expert in RAG, vector DBs, prompt orchestration.
- Hands-On Leadership Codes weekly prototypes, debugs, unblocks.
- Mentors staff; remains top expert on toughest problems.
- End-to-End Delivery
- Led 2+ open-ended, user-facing AI projects from ambiguity to impact.
- Owned vision, roadmap, MVPs.
- Cross-Functional Leadership
- Partnered with PMs/execs on metrics, priorities, trade-offs
- Presented to C-suite/board.
- Disciplined Process
- Enforced MLOps/DevOps for agents: CI/CD, canaries, observability,
- A/B prompt testing.
- Championed reproducibility, governance, code reviews, on-call culture.
- Agentic Specialization
- Built multi-agent systems (e.g., ETL automation, code-gen loops).
- Created eval harnesses
- Beat reliability/latency benchmarks.
- Cloud & Scale
- Architected 10k+ RPS backends (AWS/GCP, k8s, serverless).
- Fluent in Python, Go, Java, Scala.
- Owns APIs, async, optimization.
- Builder at Scale
- 0→1 and 1→10: shipped greenfield, scaled 100x.Drives rapid prototyping with production rigor.
What Will Make You Stand Out
- ML/LLM work in code generation (e.g., Codex, text-to-SQL), semantic extraction, or knowledge graphs (e.g., Neo4j, Neptune).
- Experience with big-data engines like Spark.
- Compiler development for languages like SQL, Python, or Scala.
- Optimization of ML models for low-latency, high-throughput production use.
- Contributions to open-source AI/ML projects (e.g., Hugging Face, PyTorch).
- Expertise in retrieval systems or vector databases (e.g., Pinecone, Weaviate).
- Skill in evaluating tech and driving build/buy decisions
Seniority: Mid to Staff Level
Experience: 7+ years in industry
What You'll Have At Prophecy- Great culture
- Very competitive compensation. Paymaster in India
- Fair and Open Equity awards for everyone
- Amazing work
- Private medical insurance
- Employee's Provident Fund
- Flexible time off
- Manage your own growth and career
- Experience building a transformative product
- High learning opportunity
- End-to-end ownership of your projects
Our Commitment to Diversity and Inclusion
At Prophecy, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Prophecy are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, political affiliation, race, religion, sexual orientation, socio-economic status, and any other protected characteristics.
Top Skills
What We Do
Prophecy.io is the only low-code data engineering platform. Prophecy democratizes the development and deployment of high-quality data pipelines, uniquely combining visual development with agile software engineering best practices. The developed code is open source and is targeted at Apache Spark & Apache Airflow. Prophecy is headquartered in Silicon Valley.
