Staff, Data Engineer - Messaging Data Platform

Posted Yesterday
Be an Early Applicant
Hiring Remotely in Ireland
Remote
Senior level
Productivity • Software • Conversational AI
The Role
The Staff Data Engineer will design, build, and maintain scalable data architectures and pipelines to support messaging platforms and other engineering solutions, enhance performance, and ensure compliance with best practices. They will also lead cross-functional projects and mentor junior engineers.
Summary Generated by Built In

See yourself at Twilio

Join the team as Twilio’s next Staff Data Engineer, Messaging Data Platform team.

Who we are 

At Twilio, we’re shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences.


Our dedication to remote-first work, and strong culture of connection and global inclusion mean that no matter your location, you’re part of a vibrant, diverse team making a global impact each day. As we continue to revolutionize how the world interacts, we’re acquiring new skills and experiences that make work feel truly rewarding. Your career at Twilio is in your hands. 

About the job

This position is needed to build and maintain highly scalable, reliable, and efficient data pipelines that will empower both inbound and outbound messaging stacks, not to mention other internal engineering solutions, with its data insights interfaces for real-time decision-making.

Responsibilities

In this role, you’ll:

  • Oversee the design, construction, testing, and maintenance of advanced, scalable data architectures and pipelines.
  • Drive the development of innovative data solutions that meet complex business requirements.
  • Create and enforce best practices for data architecture, ensuring scalability, reliability, and performance.
  • Provide architectural guidance and mentorship to junior engineers.
  • Tackle the most challenging technical issues and provide advanced troubleshooting support.
  • Collaborate with senior leadership to align data engineering strategies with organizational goals.
  • Participate in long-term planning for data infrastructure and analytics initiatives.
  • Lead cross-functional projects, ensuring timely delivery and alignment with business objectives.
  • Coordinate with product managers, analysts, and other stakeholders to define project requirements and scope.
  • Continuously monitor and enhance the performance of data systems and pipelines.

Qualifications 

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

Required:

  • 3+ years of Java development experience.
  • 5+ years of experience with Big Data processing tools and frameworks such as Apache Spark, SparkSQL.
  • Experience with Lakehouse technologies, such as Apache Hudi, Apache Iceberg, Databricks Delta Lake.
  • Experience in building AI/ML pipelines.
  • Deep technical understanding of ETL tools, low-latency data stores, multiple data warehouses and data catalogs.
  • Familiarity with data testing and verification tooling and best practices.
  • Experience with cloud services (AWS preferred, Google, Azure etc.)
  • Proficient in working with Key-Value, Streaming, and Search Database technologies, including AWS DynamoDB, Apache Kafka, and ElasticSearch.
  • Readiness to participate in the on-call rotation.

Desired:

  • Demonstrated technical breadth and depth as evidenced by papers, code, and/or presentations.
  • Exposure to service-oriented architectures, microservices and REST APIs.
  • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Bachelor's degree in Computer Science, Engineering or a related field, or equivalent training, fellowship, or work experience.

Location 

This role will be based remotely in Ireland.

What We Offer

There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic. Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now! If this role isn't what you're looking for, please consider other open positions.

Twilio is proud to be an equal opportunity employer. Twilio is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Qualified Applicants with arrest or conviction records will be considered for Employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Additionally, Twilio participates in the E-Verify program in certain locations, as required by law.

Twilio is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at [email protected].

Top Skills

Java
The Company
Atlanta, GA
6,355 Employees
On-site Workplace
Year Founded: 2008

What We Do

Millions of developers around the world have used Twilio to unlock the magic of communications to improve any human experience.

Twilio has democratized communications channels like voice, text, chat, video, and email by virtualizing the world’s communications infrastructure through APIs that are simple enough for any developer to use, yet robust enough to power the world’s most demanding applications.

By making communications a part of every software developer’s toolkit, Twilio is enabling innovators across every industry — from emerging leaders to the world’s largest organizations — to reinvent how companies engage with their customers.

Jobs at Similar Companies

bet365 Logo bet365

Human Resources Administrator

Digital Media • Gaming • Software • eSports • Automation
Denver, CO, USA
6100 Employees
57K-64K Annually

Jobba Trade Technologies, Inc. Logo Jobba Trade Technologies, Inc.

Senior Back End Developer

Cloud • Information Technology • Productivity • Professional Services • Software
Remote
Hybrid
Chicago, IL, USA
45 Employees
Louisville, CO, USA
69 Employees
111K-185K Annually

Similar Companies Hiring

TrainingPeaks (A Peaksware Company) Thumbnail
Software • Fitness
Louisville, CO
69 Employees
bet365 Thumbnail
Software • Gaming • eSports • Digital Media • Automation
Denver, Colorado
6100 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account