Senior Data Engineer

Posted 3 Days Ago
Boston, MA
Senior level
Real Estate • Software • PropTech
At Compass, our mission is to help everyone find their place in the world.
The Role
Compass is seeking a Senior Data Engineer to lead key data initiatives, collaborate with various teams, develop scalable data pipelines, and optimize data systems. Responsibilities include operationalizing data pipelines, managing database techniques, ensuring data quality, and providing on-call support. Qualifications include 7+ years of experience in data pipeline engineering, expertise in Python, PySpark, SQL, and AWS, and experience with tools like Databricks and Airflow.
Summary Generated by Built In

At Compass, our mission is to help everyone find their place in the world. Founded in 2012, we’re revolutionizing the real estate industry with our end-to-end platform that empowers residential real estate agents to deliver exceptional service to seller and buyer clients.

Data is the foundation of Compass. Our Org is responsible for evaluating, accelerating, building, and maintaining a unified, scalable and cost effective data ecosystem including infrastructure, data lake, data warehouse and tooling. We are a horizontal org within Compass handling data related to subject areas such as Agent, Listings, Segment, Finance etc.

We are looking for a self-driven Senior Data Engineer who can lead key initiatives and help us achieve more with the data. You will collaborate with multiple stakeholders from partner teams such as Analytics, Growth, Finance, Product etc to understand their business needs and recommend an optimal solution. The ideal candidate is an experienced data wrangler who can understand and optimize data systems from the ground up. We are looking for someone who stays on top of the things and effectively communicates on the progress/blockers to the leadership team.

Responsibilities

  • Develop & Operationalize scalable and reliable data pipelines.
  • Assemble large, complex data sets that meet functional/non-functional business requirements.
  • Experience in database management techniques including logical data modeling, physical database optimization and security.
  • Keep improving the integrity of data pipelines by setting up Data Quality checks to provide a comprehensive data service.
  • Work with Data and Analytics experts to strive for greater functionality in our data systems.
  • Experience with On-Call support and unblock users based on severity of the issue.

Qualification

  • 7+ Years of experience in Engineering and Operationalizing Data Pipelines with large and complex dataset.
  • 3+ Years of experience working with Unstructured data (JSON).
  • Experience working with batch and stream processing.
  • Extensive experience in Advanced SQL.
  • 3+ Years of experience in Python/PySpark.
  • 3+ Years of experience with transforming data using Databricks.
  • 3+ Years of experience with AWS.
  • 2+ Years of experience in orchestrating data pipelines using Airflow.
  • Experience with GIT (CI/CD).
  • Good to have DBT experience.
  • Good to have Tableau experience.

Compensation: The base pay range for this position is $140k-$170k annually; however, base pay offered may vary depending on job-related knowledge, skills, and experience. Bonuses and restricted stock units may be provided as part of the compensation package, in addition to a full range of benefits. Base pay is based on market location. Minimum wage for the position will always be met

Perks that You Need to Know About:

Participation in our incentive programs (which may include where eligible cash, equity, or commissions). Plus paid vacation, holidays, sick time, parental leave, marriage leave, and recharge leave; medical, tele-health, dental and vision benefits; 401(k) plan; flexible spending accounts (FSAs); commuter program; life and disability insurance; Maven (a support system for new parents); Carrot (fertility benefits); UrbanSitter (caregiver referral network); Employee Assistance Program; and pet insurance.

 

Do your best work, be your authentic self.

At Compass, we believe that everyone deserves to find their place in the world — a place where they feel like they belong, where they can be their authentic selves, where they can thrive.  Our collaborative, energetic culture is grounded in our Compass Entrepreneurship Principles and our commitment to diversity, equity, inclusion, growth and mobility. As an equal opportunity employer, we offer competitive compensation packages, robust benefits and professional growth opportunities aimed at helping to improve our employees' lives and careers.

Notice for California Applicants

Los Angeles County Fair Chance Notice

Top Skills

JSON
Pyspark
Python
SQL
The Company
HQ: New York, NY
4,000 Employees
On-site Workplace
Year Founded: 2012

What We Do

A real estate company with a purpose; we are building the first modern real estate platform, pairing the industry’s top talent with technology to make the search and sell experience intelligent and seamless.

Why Work With Us

We are a tech company reinventing the space.

To lead the industry requires the smartest tools built by the brightest minds across engineering, design, and strategy. Through our proprietary platform, Compass is changing how agents and clients navigate the process of finding or selling a home. Join our team today!

Similar Jobs

Magnite Logo Magnite

Senior Data Engineer, Java

AdTech • Big Data • Digital Media • Software
2 Locations
915 Employees
150K-170K Annually

ezCater Logo ezCater

Senior Data Engineer (Remote)

Consumer Web • Food • Software
Remote
Boston, MA, USA
996 Employees

Takeda Logo Takeda

Senior Data Engineer/Manager

Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Hybrid
Cambridge, MA, USA
50000 Employees
133K-209K Annually

DraftKings Logo DraftKings

Senior Data Engineer, Snowflake Administration

Digital Media • Gaming • Information Technology • Software • Sports • eSports • Big Data Analytics
Boston, MA, USA
5300 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account