Senior Applied Scientist

About the teamAre you interested in innovating new multimodal technologies to power experiences that change how millions of people using Zillow experience and find their next home? Zillow’s AI Team plays an important part in delivering unique AI-powered experiences for the hundreds of millions of customers that visit Zillow websites each month. The AI Media Insights team focuses on multimodal foundational models (CV, NLP, 3D) to develop next-generation indoor and outdoor understanding and reasoning capabilities that enable Zillow's customers to make sense of homes in order to find their dream home. Our team includes research, product, and engineering. We empower the next generation of home shopping by crafting new innovative technologies that deliver unrivaled insights and interactive AI-fueled experiences to our customers.

About the role

As a Senior Applied Scientist on the AI Media Insights team, you’ll be researching and developing state-of-the-art multimodal foundational technologies. This role also requires an entrepreneurial approach to bridge the gap between research and production in the constantly evolving field of Multimodal Foundation Models. You will build algorithms and deep learning models that power a wide range of experiences for buyers, agents and renters. We are seeking an innovative, collaborative and customer-focused applied scientist with deep expertise in Multimodal Machine Learning and Computer Vision.

This role is encouraged to:

• Challenge established assumptions and expectations by coming up with new ideas that fuel innovation and creativity.

• Apply a growth-mindset, proficiency with modern frameworks, and first principles to ambiguous customer problems to rapidly iterate on novel solutions and ways of working in this space.

• Collaborate closely with other applied scientists, engineering, design and user research to understand, scope, design, prototype, implement and iterate on internal- and external-facing systems supporting and implementing next generation AI applications.

• Cultivate connections with other teams for critical dependencies and infrastructure.

• Contribute to carrying and growing our team culture of rapid innovation and creative frugality.

This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions.

In California, Colorado, Connecticut, Hawaii, Illinois, Maryland, Minnesota, Nevada, New York, Washington state, and Washington DC the standard base pay range for this role is $158,200.00 - $252,800.00 Annually. This base pay range is specific to California, Colorado, Connecticut, Hawaii, Illinois, Maryland, Minnesota, Nevada, New York, Washington state, and Washington DC and may not be applicable to other locations.

In addition to a competitive base salary this position is also eligible for equity awards based on factors such as experience, performance and location. Actual amounts will vary depending on experience, performance and location.

Who you are

You are a roll-up-the-sleeves and get-it-done researcher with a deep understanding of metrics, applied research, and supporting and iterating on models at scale. You have:

• 3-5 years of experience in computer vision, with a focus on vision and language, multimodal generation, image, video. A Ph.D. in Computer Science or Engineering, Machine Learning, Computer Vision, or related domain. (Or an MSc in a relevant field with 5+ years of R&D experience)

• A basic understanding of geometry and 3D.

• Solid background in Multi-task, Multimodal (Vision + Language) research, building models & algorithms with a proven track record of publication at top tier Computer Vision and/or Machine Learning venues (e.g., CVPR, ICCV, ECCV, ICML and NeurIPS).

• Proficiency with a high-level programming language (Python is preferred)

• Experience training machine learning models in frameworks like Tensorflow and PyTorch

• Familiarity with the latest advancements in Multimodal Foundational Models

• The communication skills to influence, collaborate with, and educate others (whom you may need to educate on methods and requirements in experimentation and statistics).

• Experience prototyping, developing, and implementing algorithmic solutions and new technologies with diverse analytics and data.

• Tenacity to embrace and solve complicated problems.

• Practiced technical ability and passion for both owning implementation and contributing technical/thought leadership for a team of elite scientists and engineers.

Bonus Qualifications:

• Understanding of 2D/3D geometry and experience framing geometrical problems within modern differentiable frameworks like PyTorch and Tensorflow

• Experience with generative AI or large language models and related technologies (knowledge retrieval solutions, for example).

• Experience with productionizing Machine Learning models at scale

Get to know us

Zillow is reimagining real estate to make home a reality for more and more people.

As the most-visited real estate website in the United States, Zillow® and its affiliates help movers find and win their home through digital solutions, first class partners, and easier buying, selling, financing and renting experiences. Millions of people visit Zillow Group sites every month to start their home search, and now they can rely on Zillow to help make it easier to move. The work we do helps people get home and no matter what job you're in, you will play a critical role in making home a reality for more and more people.

Our efforts to streamline the real estate transaction are supported by a deep-rooted culture of innovation, our passion to redefine the employee experience, a fundamental commitment to Equity and Belonging, and world-class benefits. These benefits include comprehensive medical, dental, vision, life, and disability coverages as well as parental leave, family benefits, retirement contributions, and paid time off. We’re also setting the standard for work experiences of the future, where our employees are supported in doing their best work and living a flexible, well-balanced life. But don’t just take our word for it. Read recent reviews on Glassdoor and recent recognition from multiple organizations, including: the 100 Best Companies to Work For, Glassdoor Employees’ Choice Award, Bloomberg Gender-Equality Index, Human Rights Campaign (HRC) Corporate Equity Index, and TIME 100 Most Influential Companies list.

Zillow Group is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please contact your recruiter directly.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state and local law.

Applicants who receive job offers from Zillow Group will be asked to sign a Proprietary Rights Agreement which includes confidentiality, intellectual property assignment, customer and employee non-solicitation, and non-competition provisions. If you are contacted for a role at Zillow Group and wish to review a copy of the Proprietary Rights Agreement prior to receiving an offer, you may request a copy from your Recruiter.