Please note this is a 12-month fixed term contract to backfill a maternity leave.
What You'll Do:
Coordinate with data scientists, data analysts, software engineers and product managers to design and evolve our existing architecture, improving the reliability and performance of our data infrastructure
Build, maintain and scale our ETL pipelines to help power data science, data products and analytical needs
Design, build, and maintain data infrastructure systems such as but not limited to AWS DMS, HBase, EMR, Redshift, S3, Kafka, Airflow while ensuring scalability, reliability, and security
Write new tools, services, and platforms in Python
Research new technologies to solve tomorrow’s data infrastructure needs
Advocate for the adoption of tools in the data engineering team
Required Qualifications:
4+ years of data engineering experience
Ability to write high-quality code in Python and PySpark
Strong understanding of database fundamentals and software engineering principles
Strong understanding of Data Contracts, microservices principles, and treating datasets/platforms as API-driven products
Deep understanding of two or more of these technologies: Spark, Airflow, AWS EMR, AWS Glue, Sagemaker and Redshift
Experience with batch processing and streaming systems
Exposure and/or strong interest in Kafka or other queuing technologies
A critical thinker and possess creative problem solving skills
Quantitative skills, ability to think analytically, and strong attention to details
A desire to contribute to the broader development community
Skills Required
- 4+ years of data engineering experience
- Ability to write high-quality code in Python and PySpark
- Strong understanding of database fundamentals and software engineering principles
- Strong understanding of data contracts and microservices principles
- Experience treating datasets and platforms as API-driven products
- Deep understanding of at least two of Spark, Airflow, AWS EMR, AWS Glue, SageMaker, and Redshift
- Experience with batch processing and streaming systems
- Exposure to or strong interest in Kafka or other queuing technologies
- Critical thinking and creative problem-solving skills
- Quantitative and analytical skills with strong attention to detail
- Desire to contribute to the broader development community
What We Do
Wattpad. Where Stories Live. Wattpad’s vision is to entertain and connect the world through stories. The global multi-platform entertainment company uses the power of community and technology to enable the creation and distribution of content across a variety of formats. Its flagship app, Wattpad, is home to a community of more than 90 million people who spend over 23 billion minutes a month engaged in original stories. Tap by Wattpad, the company’s second storytelling product, offers short, chat-based stories in over a dozen languages. Wattpad Studios co-produces stories for film, television, digital and print, together with industry partners. Wattpad Brand Partnerships offers a full suite of advertising products to help brands build deep engagement with Gen Z consumers. The company is proudly based in Toronto, Canada.
