Senior Data Engineer

Posted 9 Days Ago
Easy Apply
Bengaluru, Karnataka
Senior level
Artificial Intelligence • Computer Vision • Machine Learning • Payments • Real Estate • PropTech
Metropolis is an artificial intelligence company for the real world.
The Role
As a Senior Data Engineer, you will design and build data pipelines and architecture, collaborate with teams to meet data needs, ensure data security, optimize data processes, and mentor team members while maintaining flexibility for evening hours.
Summary Generated by Built In

The Company 

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time. 

The Role 

As a Senior Data Engineer at Metropolis, you will play a key role in shaping both customer-facing and business-facing data products that align with our mission. Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impacts thousands of internal users and millions of members. Join a world-class data engineering team dedicated to advancing your skills and career in data engineering and beyond. 

Responsibilities 

  • Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets. 
  • Design and own the data architecture for large-scale projects, making informed decisions about design and operational trade-offs. 
  • Build, launch, and optimize sophisticated data pipelines, data models, and visualizations that support diverse use cases across multiple products or domains. 
  • Define and manage Service Level Agreements (SLAs) for all data sets within areas of ownership. 
  • Implement data security models based on privacy requirements, ensure compliance with safeguards, address data quality issues, and evolve data governance processes. 
  • Solve complex data integration challenges using optimal ETL/ELT patterns, frameworks, and query techniques for both structured and unstructured data sources. 
  • Maintain and enhance existing production processes by optimizing complex code using advanced algorithmic concepts. 
  • Optimize pipelines, dashboards, frameworks, and systems to streamline data artifact development. 
  • Mentor team members, providing and receiving actionable feedback to foster skill growth and collaboration. 
  • Ensure flexibility with availability during evening hours. 

Requirements and Qualifications: 

  • Bachelor's degree in computer science, Computer Engineering, or a relevant technical field; a master's degree is preferred. 
  • 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud. 
  • Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt as a plus. 
  • 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems. 
  • Hands-on experience with RDBMS such as MySQL, MS SQL Server, and Postgres. 
  • Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines. 
  • Ability to deliver high standards of code quality, system reliability, and performance. 
  • Experience with Spark and PySpark to handle large-scale data processing and enhance data pipeline efficiency. 

#LI-AR1 #LI-Hybrid 

Join us in making a difference as we build our future. Metropolis is an equal opportunity employer, dedicated to diversity, equality, and inclusion, and provides equal employment opportunities to all employees and applicants for employment. Metropolis prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.


Top Skills

Python
SQL

What the Team is Saying

Lesley
Sofia
Max
Jamie
Bryant
Courtney
The Company
HQ: Santa Monica, CA
23,100 Employees
Hybrid Workplace
Year Founded: 2017

What We Do

Metropolis Technologies, Inc. is an artificial intelligence company whose computer vision platform enables checkout-free payment experiences for the real world. Its proprietary AI-driven technology reaches more than 50 million customers while reducing costs, increasing transparency and capturing additional revenue for real estate partners. Following its take-private acquisition of SP+, Metropolis is now the largest parking network in North America with more than 4,000 locations. To learn more about Metropolis, please visit www.metropolis.io.

Why Work With Us

We’re not your typical technology company. We’re world-class software and hardware engineers, we’re neighborhood urbanists and operators, we’re caring customer support specialists, we’re nerdy data scientists and machine learning engineers, we’re designers and architects… and many things in-between and beyond.

Gallery

Gallery
Gallery
Gallery

Metropolis Technologies Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

The best ideas often come from face-to-face interactions! Our flexible work model includes three office days (Tuesdays, Wednesdays, plus one) and two remote days. We'll specify which roles are eligible for remote work based on responsibilities.

Typical time on-site: Flexible
HQSanta Monica, CA
Chicago, IL
Manhattan, NY
Nashville, TN
Seattle, WA
Learn more

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account