Senior Data Engineer

Posted 11 Days Ago
Be an Early Applicant
Singapore, SGP
In-Office
Senior level
Cloud • Information Technology • Software • Analytics
Global tech consultancy blending design, engineering and AI to help businesses thrive through innovation.
The Role
The Senior Data Engineer develops and maintains data architecture, builds data processing pipelines, collaborates with data scientists, and ensures data governance, quality, and privacy.
Summary Generated by Built In

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy.

*Due to the nature of the projects and specific client security clearance, this role requires the successful candidate to be a Singapore Citizen or Permanent Resident (PR)*

Job responsibilities
  • You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
  • You will develop intricate data processing pipelines, addressing clients' most challenging problems.
  • You will collaborate with data scientists to design scalable implementations of their models.
  • You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines.
  • You will use different distributed storage and computing technologies from the plethora of options available.
  • You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack.
  • You will collaborate with the team on the areas of data governance, data security and data privacy.
  • You will incorporate data quality into your day-to-day work.
Job qualifications
Technical Skills
  • You have 7+ years of experience in writing clean, high-quality code using Python.
  • You have a solid experience of Cloud services (AWS, GCP, or Azure). Experience with Databricks is a plus.
  • You possess solid knowledge/ experience of DevOps tools and practices, including CI/CD (GitLab/GitHub) and Infrastructure as Code (Terraform).
  • Working with data excites you; You can build and operate data pipelines, and maintain data storage, all within distributed systems.
  • You have hands-on experience of data modeling and modern data engineering tools and platforms.
  • You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting.
  • You have experience with data visualization techniques and can communicate the insights as per the audience.
  • You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems.
  • You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.).
  • You are familiar with Agile, Lean and/or Continuous Delivery.
Professional Skills
  • You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way.
  • You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives.
  • You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them.
  • You are eager to coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work.
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed.
Other things to know
Learning & Development

There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.

Responsible Use of AI in Recruitment

At Thoughtworks, we use AI tools to support our recruitment team with administrative tasks such as drafting communications, scheduling interviews and writing job descriptions.
Crucially, our AI tools do not screen, assess, rank or make hiring decisions. Every application is reviewed by our team and all selection decisions are made exclusively by our interviewers and hiring managers.
We are committed to fairness and responsible AI. We actively manage our AI systems by testing, monitoring for biased outcomes and implementing mitigation measures. We hold our third-party vendors to these same high standards through a rigorous governance process. For additional information, please see our full Thoughtworks AI Policy for Recruitment.

About Thoughtworks

Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary.

#LI-Onsite

See here our AI policy.

Skills Required

  • 7+ years of experience in writing clean, high-quality code using Python.
  • Experience with Cloud services (AWS, GCP, or Azure), experience with Databricks is a plus.
  • Knowledge/experience of DevOps tools and practices, including CI/CD and Infrastructure as Code.
  • Experience with data modeling and modern data engineering tools and platforms.
  • Experience with different types of databases (SQL, NoSQL, data lake, data schemas).

Thoughtworks Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Thoughtworks and has not been reviewed or approved by Thoughtworks.

  • Leave & Time Off Breadth Paid time off includes vacation accrual from day one with rollover, personal/sick days, development and service days, and a long‑tenure paid sabbatical. Policies also emphasize comprehensive leave for rest, illness, and rejuvenation.
  • Healthcare Strength Health coverage spans medical, dental, and vision and often extends to families, complemented by mental‑health support through Lyra and Headspace. In some regions, private providers and wellness rewards further bolster healthcare access.
  • Parental & Family Support Parental leave is positioned as generous across regions, with fully paid options in some markets and a comprehensive fertility policy. Adoption and broader family supports are also highlighted.

Thoughtworks Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, IL
7,674 Employees
Year Founded: 1993

What We Do

We are a global technology consultancy that delivers extraordinary impact by blending design, engineering and AI expertise. For 30 years, our commitment to design-led thinking, engineering excellence and innovation means we prioritize people, build teams with strong technical foundations and embed AI into every step of the process – not just as a tool but as a mindset. It’s this approach that sets us apart, sparks bold ideas and empowers us to drive real, lasting innovation. We’re not preparing for the future – we’re defining it.

Why Work With Us

As technologists, we have a unique role to play in how technology should benefit all of society, pursuing a more equitable future. Part of that role is to continuously educate ourselves on the issues that matter to the causes we believe in. We recognize our privilege and strive to see the world from the perspective of the most vulnerable.

Gallery

Gallery

Similar Jobs

Micron Technology Logo Micron Technology

Product Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Singapore, SGP
45000 Employees
In-Office
Singapore, SGP

Micron Technology Logo Micron Technology

Staff Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Singapore, SGP
45000 Employees

Micron Technology Logo Micron Technology

Staff Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Singapore, SGP
45000 Employees
3-3 Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account