Principal Engineer, Data
Our platform has robust analytics tools that can tell video creators where people are from, where they click, and even track where in a video someone stopped watching—giving you insight into creating engaging content in the future.
As a Principal Data Engineer on the Data team, you will create infrastructure and services that provide access to real-time event streams. You will work with our product and engineering teams to help define data access and help implement systems to give deeper insightful data
metrics to video creators.
What You’ll Do:
- Work with stakeholders to define new events streamed through our pipeline
- Create, manage and maintain real-time ETL pipelines for streaming events
- Help design and build a system for data discoverability and quality framework
- Review Kafka and Spark specific metrics and key indicators for pipeline monitoring and system performance management
- Mentor engineers, encourage innovation and implementation of cutting-edge technologies
- Self organized, independent team player and thinks outside-of-the-box
Skills and knowledge you should possess:
- 5+ years’ experience working with scalable data architecture, fault-tolerant ETL, and monitoring of data quality in the cloud
- Expertise in Java/Scala and at least one other backend programming language
- Hadoop, Kafka, KSP, Spark, Flink, or similar data streaming and processing framework experience
- Kubernetes/Docker container orchestration systems
- CI/CD pipelines for automated software development and delivery
- Working experience with SQL, NoSQL (HBase/BigTable/Cassandra/MongoDB)
- Experience and/or working knowledge of developing Restful web APIs
- Airflow, Celery, or any other Open Source Data task processing system
Bonus Points (Nice Skills to Have, but Not Needed):
- Experience with Apache Phoenix
- Python or other scripting language experience a plus
- Cloud Provider experience (AWS tools, Google Cloud tools, Azure tools)
- Real-time analytics databases (Druid, Clickhouse, Snowflake, BigQuery/Spanner)
#LI-HS1
About us:
Vimeo (NASDAQ: VMEO) is the world’s leading all-in-one video software solution. Our platform enables any professional, team, and organization to unlock the power of video to create, collaborate and communicate. We proudly serve our growing community of over 230 million users — from creatives to entrepreneurs to the world’s largest companies.
Vimeo is headquartered in New York City with offices around the world. At Vimeo, we believe our impact is greatest when our workforce of passionate, dedicated people, represents our diverse and global community. We’re proud to be an equal opportunity employer where diversity, equity and inclusion is championed in how we build our products, develop our leaders, and strengthen our culture.
Learn more at www.vimeo.com
Learn more at www.vimeo.com/jobs