Senior Data Platform Engineer

Posted Yesterday
Be an Early Applicant
3 Locations
Remote
Senior level
Information Technology • Software • Consulting
The Role
Build and deploy Databricks Lakehouse pipelines on AWS to ingest, parse, and harmonize scientific instrument data for biopharma research. Prototype data acquisition, implement file parsers, design data models, develop Python ETL/ELT pipelines and tests, and work directly with customers to validate solutions.
Summary Generated by Built In

Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.

Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.

We are looking for a Senior Data Platform Engineer to join an engagement building data pipelines and lakehouse architecture for a scientific data cloud platform — purpose-built for biopharma. You'll be working at the intersection of data engineering and life sciences, turning raw instrument output from lab equipment into harmonized, actionable scientific data that accelerates research outcomes.

This is hands-on, end-to-end engineering work: prototyping pipelines, parsing proprietary instrument file formats, designing data models, and shipping production-grade solutions directly with the customer.


What you'll do
  • Own, prototype, implement, and deploy DataBricks Lakehouse pipelines on AWS.

  • Research and prototype data acquisition strategies for scientific lab instrumentation.

  • Build file parsers for instrument output files across a wide range of formats — .xlsx, .pdf, .txt, .raw, .fid, and vendor-specific binaries.

  • Design and build data models, Python data pipelines, unit tests, integration tests, and utility functions.

  • Work directly with customers to validate that solutions meet their requirements and solve real scientific needs.

  • Facilitate internal project post-mortems to identify and apply improvements across engagements.


What you bring
  • 5+ years of professional experience in Python and SQL.

  • Hands-on experience with Databricks Lakehouse architecture on AWS.

  • Strong working knowledge of AWS Redshift — hands-on experience required.

  • Experience across the AWS data stack: ECS, S3, Athena, RDS.

  • Proficiency with ETL/ELT pipeline development using Airflow and Python.

  • Experience with relational databases — MySQL, MariaDB, Aurora, PostgreSQL, MS SQL Server.

  • Familiarity with key-value and non-relational databases.

  • Excellent communication skills and the confidence to take ownership of project delivery end-to-end.

  • Able to manage multiple simultaneous projects without losing quality or attention to detail.

  • Genuine curiosity — this role requires learning new scientific domains and instrument ecosystems continuously.


Nice to have
  • Elasticsearch experience.

  • Background in or exposure to scientific instrumentation, lab workflows, or biopharma data.

  • Graduate degree in Chemistry, Biology, Computer Science, Statistics, Public Health, or a related field.

  • Experience parsing proprietary binary file formats from lab instruments.

When you join Solvd, you'll…

  • Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.

  • Be part of a global team with equal opportunities for collaboration across continents and cultures.

  • Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.

Ready to make an impact?

If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.

Solvd is an equal opportunity employer.

Skills Required

  • 5+ years of professional experience in Python and SQL
  • Hands-on experience with Databricks Lakehouse architecture on AWS
  • Strong working knowledge of AWS Redshift (hands-on experience required)
  • Experience across the AWS data stack: ECS, S3, Athena, RDS
  • Proficiency with ETL/ELT pipeline development using Airflow and Python
  • Experience with relational databases: MySQL, MariaDB, Aurora, PostgreSQL, MS SQL Server
  • Familiarity with key-value and non-relational databases
  • Excellent communication skills and ownership of project delivery end-to-end
  • Ability to manage multiple simultaneous projects without loss of quality
  • Genuine curiosity and willingness to learn new scientific domains and instrument ecosystems
  • Elasticsearch experience
  • Background in or exposure to scientific instrumentation, lab workflows, or biopharma data
  • Experience parsing proprietary binary file formats from lab instruments
  • Graduate degree in Chemistry, Biology, Computer Science, Statistics, Public Health, or related field
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
708 Employees
Year Founded: 2011

What We Do

Solvd is an end-to-end software engineering and consulting company with over 800 employees located across eight countries in Latin America, North America, and Europe. The company is headquartered in California and has 7 development centers in Ukraine, Poland, Georgia, Argentina, Brazil, and Mexico, as well as a sales office in Hungary. Solvd is partnering with leading technology companies such as Amazon and Adobe. It delivers exceptional engineering and digital solutions to Fortune 500 clients across high-growth industries including financial services, retail & e-commerce, healthcare & life sciences, social media, software & Hi-Tech, etc. The services list covers all aspects and needs of modern businesses, including software product development, digital experience and design, DevOps and cloud, data, and AI/ML services. Moreover, Solvd transformed its deep expertise in QA into a rich intellectual property library, which includes Zebrunner, an innovative proprietary quality management platform. To get more information about Solvd and Zebrunner, please visit https://www.solvd.com and https://zebrunner.com.

Similar Jobs

Avra Logo Avra

Senior Software Engineer

Artificial Intelligence • Fintech • Professional Services • Software
In-Office or Remote
São Paulo, BRA
70 Employees

Glacier Logo Glacier

Senior Software Engineer

Artificial Intelligence • Greentech • Robotics
Remote
10 Locations
93 Employees
4K-7K Hourly

MINDBODY Logo MINDBODY

Platform Engineer

Marketing Tech • Software
Remote
Brazil
1648 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account