Lead Data Engineer
Getting together with real people in real life makes powerful things happen. Side hustles become careers, ideas become movements, and chance encounters become lifelong connections. Meetup brings people together to create thriving communities. Show up. Change lives.
Every year, millions of people RSVP to an eclectic variety of Meetups around the world. Activity on Meetup is growing faster than ever and by studying it, we’re learning how to help members discover the groups and events that are right for them -- sparking new ways to make their worlds come alive than ever before. We are a collaborative and dedicated team seeking a Lead Data Engineer to join us in designing and building the future vision of Meetup.
What you’ll get to do:
- Lead a team of Data and Machine Learning engineers to design, implement and operate a platform that supports low latency processing and transformation of data at scale
- Build tooling to allow fast development and deployment of machine learning models to production
- Lead projects with other engineering, product and design teams to create simple & meaningful data-driven experiences for our members and organizers (recommendations, search)
- Build on your leadership skills by mentoring other engineers
- Recruit and present on behalf of Meetup at technical conferences and Meetups
You're our ideal team member if you have:
- BS+ degree in Computer Science, Engineering, Statistics or related technical field
- 5+ years of work experience designing and operating data intensive distributed systems (experience with recommendations, search or data warehousing is ideal)
- 2+ years in a Data or Software Engineering Tech Lead role or similar position
- Lead projects for a large, multiuser Scala, Java, or Python codebase (we use Java/Scala and Python)
- Extensive experience with technologies in the Hadoop ecosystem such as Flink, Mapreduce, Spark, Scalding, Avro, Parquet (we use Spark and Avro).
- Extensive experience with AWS services such as EMR, S3, Kinesis, and Lambda as well as infra as code tooling (Terraform, Cloudformation)
- Experience with ETL Pipeline technologies such as Airflow, Oozie, StreamSets, or Kafka (we use Airflow)
- Extensive experience with search technologies such as Elasticsearch, Sphinx, or Solr
- Experience with both relational and NoSQL (DynamoDB, Redis, MongoDB) databases and RESTful and GraphQL APIs
- Experience in data modeling, data access, and data storage best practices
- Knowledgeable in Machine Learning frameworks with a strong willingness to learn and contribute to Machine Learning projects
Meetup employees are bold, supportive, and passionate about enabling people coming together and creating the future of real community; a future where people embrace their differences and similarities, show up, do things, and turn to each other to improve their lives. We care about moving fast, real-world change, and proud to be an equal opportunity employer committed to hiring and developing diverse, dynamic teams in a safe and inclusive environment. You in?
The pay range for this position in Colorado is $120,000 - $140,000/yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. This role can be located anywhere in the US.