Lead Data Engineer
As an engineer on the Events Team, that focuses on streaming and aggregation tech, you will be responsible for the design, implementation, and tuning of highly visible mission critical stream processing systems. Our stream processing stack includes Kafka, Flink, and Cassandra as well as tooling to support these systems.
We rely heavily on exactly-once processing semantics in order to provide data to our users that is unmatched in both latency and quality. Our flink clusters manage large amounts of state in order to keep latency low. You will be constantly challenged to improve these systems from every angle, such as monitoring, failure recovery, data quality, tooling, and much more.
We love tackling tough engineering problems and look for engineers who specialize in certain areas but are passionate about building, owning & scaling features end to end from scratch and breaking through any obstacle or technical challenge in their way. We push each other to move out of our comfort zone, learn new technologies and work hard to ensure each day is better than the last.
Lead Data Engineers are expected to bring to Klaviyo subject matter expertise and demonstrate adaptability by continuing to acquire and master new skills, level up all those around them, and research and prototype new technologies and solutions to help scale Klaviyo’s systems and product capabilities. Engineers come to Klaviyo with experience in a variety of languages and from a number of disciplines. All engineers are expected to become extremely proficient in the technologies we use (not exhaustive):
Python, Django, Java, Celery
MySQL, Cassandra, Kafka, Flink, RabbitMQ, Redis
HTML, JavaScript, LESS, React
Amazon Web Services (EC2, RDS, Aurora, etc.)
Terraform, Ansible, Packer, and other DevOps tools
- Wholly owning features that 50,000+ customers rely on daily to reach 4B+ consumers to drive their business forward.
- Working on crafting our highly scalable real-time data pipeline that processes billions of events weekly across data sets growing to petabyte scale.
- Working on deep analytics system that provides insight into hundreds of terabytes of data.
- Be responsible for the mission, technical direction and operations of projects that have immediate impact.
- Helping architect and design robust and high performance data processing and storage systems leveraging new databases to serve different internal and external use cases. Contribute to open source data processing technologies.
- Contributing to the company as a subject matter expert in multiple areas, constantly pushing yourself to be a better engineer and to level up all of your peers within your team and within Klaviyo.
- Have 5-7+ years of experience building products that matter and pushing yourself and your team to be better engineers and build a product with passionate advocates
- Enjoy working with new technologies ranging from the frontend to backend, and are particularly passionate and an expert in multiple stack areas. You show this by having strong and opinionated experience with various technologies and know how to pick the right tool for any job
- Love digging into performance and scalability issues to drive breakthrough solutions-- whether it's a slow loading UI or too many clicks in a workflow, a database query timing out, or a queue that just won’t drain. You recognize all problems can be solved
- Enjoy shipping code early & often in an agile fashion, pairing with product management to craft better software by soliciting feedback from thousands of end users
- Like working on small, autonomous agile teams. At Klaviyo, you will have ownership of features, but you'll collaborate with everyone to make sure we produce the right solution
At Klaviyo we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day. We believe everyone deserves a fair shot at success and appreciate the experiences each person brings beyond the traditional job requirements. If you’re a close but not exact match with the description, we hope you’ll still consider applying.
Get to Know Klaviyo
Klaviyo is a world-leading marketing automation platform dedicated to accelerating revenue and customer connection for online businesses. Klaviyo makes it easy to store, access, analyze and use transactional and behavioral data to power highly-targeted customer and prospect communications. The company's hybrid customer-data and marketing-platform model allows companies to grow by fostering direct relationships with customers, without giving up their valuable data to popular big-tech ad platforms. Over 265,000 innovative companies like Unilever, Custom Ink, Living Proof and Huckberry sell more with Klaviyo. Learn more at www.klaviyo.com.
Klaviyo is committed to diversity and to a policy of equal employment opportunity and non-discrimination. We do not discriminate on the basis of race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation or any other characteristic protected by applicable law.