About Prophecy
The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale.
Don’t miss the rocket ship—join Prophecy and build the next data revolution.
Must-Have Skills:
- Advanced ML/LLM knowledge: hands-on fine-tuning (SFT, DPO, RLHF), distillation, quantization/pruning for model optimization.
- Full ML lifecycle: from data acquisition to training to productization with PyTorch and open-source transformers (e.g., HuggingFace).
- Fluency in Python for dataset/model processing.
- Experience with backend pipelines/microservices software development in public cloud: AWS, k8s, java, scala.
- Builder mentality: Experience taking ideas to production.
What Will Make You Stand Out
- ML/LLM work in code generation (e.g., Codex, text-to-SQL), semantic extraction, or knowledge graphs (e.g., Neo4j, Neptune).
- Experience with big-data engines like Spark.
- Compiler development for languages like SQL, Python, or Scala.
- Optimization of ML models for low-latency, high-throughput production use.
- Contributions to open-source AI/ML projects (e.g., Hugging Face, PyTorch).
- Expertise in retrieval systems or vector databases (e.g., Pinecone, Weaviate).
- Skill in evaluating tech and driving build/buy decisions.
Seniority: Jr to Staff Level
Experience: 1+ years in industry
Compensation: $250,000–$350,000
Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to achievements, skills, experience, or work location. The range listed is just one component of the compensation package offered to candidates.
Benefits and Perks
- Prophecy covers 99% of employee health insurance premiums and 75% for dependents
- We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!
- Flexible PTO
- Professional development allowance
- Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more
- Ability to have your fingerprint on an innovative platform
- End-to-end ownership of your projects.
*Benefits and perks may vary per country
Our Commitment to Diversity and Inclusion
At Prophecy, we hire for merit and foster an inclusive culture where people from diverse backgrounds can excel and do their best work. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Prophecy are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and any other protected characteristics under applicable laws.
Top Skills
What We Do
Prophecy.io is the only low-code data engineering platform. Prophecy democratizes the development and deployment of high-quality data pipelines, uniquely combining visual development with agile software engineering best practices. The developed code is open source and is targeted at Apache Spark & Apache Airflow. Prophecy is headquartered in Silicon Valley.
