The Role
Who You Are:
Polly is looking for a skilled and enthusiastic software engineer to join our collaborative engineering team and drive game-changing initiatives across Large Language Model (LLM) technologies and prompt-based AI solutions. With 6+ years of software development experience, including mentoring others and working with distributed systems and relational databases, you’re eager for your next challenge at a hyper-growth SaaS company. In this role, you’ll design and test prompts for diverse use cases, ensuring high-quality output that reaches thousands of end users and plays a key role in our forward-looking innovation strategy.
Does this sound like you? If so, keep reading and apply today!
What you’ll do:
- Lead and contribute to the system design for our AI/ML-based services
- Develop, implement, and test prompts, fine tuned models, and agentic systems integrating with a variety of products.
- Analyze internal and external feedback and behaviors to continuously improve the output quality of LLMs and Agentic Systems.
- Research and adopt best practices based on experience, analysis, and input from the broader software team.
- Develop code that is highly readable, maintainable, and testable including documentation, excellent architecture, and automated testing
- Actively participate in interviewing and evaluating new team members
- Mentor junior members of the software engineering team in all aspects of software development across multiple projects with multiple customers
- Prioritize your work and the work of others with a sense of urgency to ship products in time to have the desired business impact while balancing a quality mindset
- Review code, help drive technical excellence through best practices and latest tools
What you have:
- Bachelor's degree in Computer Science or a related field
- 6+ years of professional experience
- Applied AI Engineering experience integrating LLMs or other ML models into modern web applications.
- Senior level experience working with Large Language Models such as GPT-3/4, ChatGPT, Claude, or CoHere
- Proficiency in Python, Javascript, SQL, C#
- Knowledge of cloud computing platforms and AI deployment tools
- A strong background in AI product development
- Ability to define and execute on strategic and visionary goals
- Excellent communication skills
- Ability to work in a team environment
- Strong Backend Experience working on customer facing features/teams
- Some experience with modern frontend technologies (Vue, React, etc.)
Extras you bring to the table:
- Foundational knowledge of Natural Language Processing (NLP) and Machine Learning tailored to a specific business need
- Deploying into a public cloud service (AWS, GCP, etc.)
- Experience with containerization (Docker/Kubernetes)
- Experience in deploying AI tools
- Ability to gather and preprocess data for use in ML and AI
- Experience with service monitoring, metrics, alerting, log aggregation, and tracing
- Experience with functional/acceptance testing
- Experience with popular AI frameworks and libraries such as TensorFlow, PyTorch, huggingface, Amazon Bedrock, or Anthropic
Why join Polly?
- High Bar of Talent: Polly consistently performs in the top quartile of start-up companies, and we consider the people of Polly the engine helping us achieve success. Many candidates choose Polly because of the collaborative, smart, and fun people that work here. We strive to hire the best to continue to raise that bar, and <5% of those that enter the interview process are presented with an offer.
- Disruptive Mission: Mortgage capital markets is historically an under-innovated space; Polly is committed to changing that. Our purpose-built platform has reimagined and reinvented the way that our lender customers operate. We are seeking passionate and driven builders who are not interested in accepting the status quo.
- Individual Impact & Growth: Every day, the Polly team doesn’t just work—they contribute to our overarching mission. Individual impact is highly visible and everyone’s voice matters. You will have exposure to every level of leadership, cross-functional teams, and impactful projects, giving you a unique opportunity to build and hone your skills.
- Hybrid Workplace with Innovation at the Core: Here at Polly, we believe in blending flexibility with in-person collaboration. With a hybrid model, our employees work on site three days a week (Tues./Wed./Thurs.) at our Innovation Hubs, located in Dallas-Fort Worth and San Francisco, driving forward-thinking solutions and fostering teamwork.
Employee Benefits:
- Competitive Compensation: Polly offers competitive salaries designed to reward your expertise and direct impact/contributions.
- Comprehensive Health Coverage: Enjoy 100% company-paid medical, vision, dental, disability, and life insurance, granting peace of mind.
- Flexible Vacation, Done Right: Take time off to recharge when you need it with Polly’s flexible, non-accrued vacation policy—because we trust you to balance work and life.
- Hybrid Environment: Polly employees work on site three days a week (Tues./Wed./Thurs.) at our Innovation Hubs, located in Dallas-Fort Worth and San Francisco.
Interview Process:
- Round 1 - 30 minute 1:1 with a Polly Talent Team Member
- Round 2 - 30 minute 1:1 with Polly’s Staff AI Engineers
- Round 3 - Take Home Assessment
- Round 4 - 30 minute 1:1 with a Polly's Principal Software Engineer + a Senior Software Engineer
- Round 5 - 30 minute 1:1 with a Polly Senior Product Manager
- Round 6 - 45 minute 1:1 with a Polly's CTO
Let's get to know each other.
Polly has pioneered the next generation of mortgage capital markets technology with its cutting-edge, data-driven platform. Its enterprise-grade solutions, including the industry's only cloud-native, commercially scalable product, pricing, and eligibility (PPE) engine and first-of-its-kind Polly/™ AI platform, empower the nation's top banks, credit unions, and mortgage lenders to increase profitability, automate workflows, and revolutionize the loan officer and broker experiences. As a mortgage technology trailblazer, Polly is committed to driving meaningful value and ROI through best-in-class innovation that enables unlimited configurability, flexibility, granularity, and scalability. Polly was founded by a seasoned team of mortgage capital markets and technology experts and is headquartered in San Francisco, California. Recognized as a pioneer in mortgage capital markets, as well as in culture and career development, Polly was named to Forbes' America's Best Startup Employers in 2025. This evaluation was based on three key criteria: Employer Reputation, Employee Satisfaction, and Company Growth.
To learn more, follow Polly on LinkedIn or visit www.polly.io. Polly is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, age, color, national origin, religion, sex, gender identity, sexual orientation, marital status, pregnancy status, disability status, veteran status, or any other legally protected status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Beware of recruitment scams impersonating the Polly brand or our employees. Our team communicates only through official Polly channels, and we will never ask for sensitive information over text or conduct text-only interviews. If you are ever suspicious or in doubt, reach out to us directly at [email protected]. We care deeply about this network and your experience.
Similar Jobs
.png)
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
The secondary market for mortgages accounts for over $1T in annual volume and impacts 20% of GDP. Yet, the pricing and loan trading of mortgages is still often done with antiquated technology, excel spreadsheets, phone calls, and physical paper. Billions of dollars are lost to inefficiency and mistakes.
Polly is transforming the mortgage industry with its modern, data-driven capital markets ecosystem that includes an advanced Product & Pricing Engine (PPE), Loan Trading Exchange, Analytics Platform, and Partner Platform. Our mission is to help capital markets and secondary teams operate smarter, more efficiently, and more profitably with best-in-class, end-to-end technology that is configured for each of our customers’ unique workflows and business needs.
Polly is based in San Francisco, California. Please visit www.polly.io to learn more.
