We are seeking a Data Engineer to design, build, and maintain scalable data pipelines, datasets, and automation systems that support cloud cost visibility, attribution, and performance insights.
This role will work with large-scale telemetry, usage, and financial data to help Product, Engineering, and Finance stakeholders make informed, cost-aware decisions. The ideal candidate has strong hands-on experience with cloud data engineering, AWS, Snowflake, production pipeline ownership, data quality, and performance and cost optimization.
Key Responsibilities
* Design, build, and maintain reliable end-to-end ELT and ETL pipelines in cloud environments.
* Build scalable datasets that support cloud cost visibility, attribution, usage analysis, and performance insights.
* Design and implement data models and ingestion frameworks for large-scale telemetry and usage data.
* Develop automation and tooling that enable cost-aware decision-making across Product, Engineering, and Finance teams.
* Optimize data pipelines and systems for performance, reliability, and cost efficiency.
* Perform query tuning and improve storage and compute strategies.
* Build and maintain integrations with REST APIs and other data sources.
* Implement and support CI/CD processes and Infrastructure as Code.
* Ensure data quality, validation, auditability, and consistency across end-to-end data workflows.
* Monitor, troubleshoot, and resolve production pipeline failures, data inconsistencies, and performance issues.
* Partner with Engineering and Finance stakeholders on cloud cost optimization and usage-based insights.
QualificationsMust-Have Skills
* Strong data engineering foundation with proven experience building and maintaining end-to-end ELT or ETL pipelines in cloud environments.
* Strong SQL and Python skills.
* Experience with data workflow and orchestration tools such as dbt, Airflow, or Dagster.
* Hands-on experience with the AWS data ecosystem, including AWS Glue, Amazon Athena, and Amazon Aurora.
* Experience with Snowflake.
* Strong data modeling experience.
* Experience processing data at scale.
* Experience with CI/CD and version control.
* Hands-on Infrastructure as Code experience using Terraform.
* Experience building or maintaining REST API integrations.
* Demonstrated ability to optimize data pipelines for performance and cost.
* Strong analytical and troubleshooting skills.
* Experience with data validation, auditing, and production pipeline support.
* Enterprise experience strongly preferred.
Nice-to-Have Skills
* Scala experience.
* FinOps Certified Practitioner or FinOps Certified Engineer certification.
* Experience with cloud cost optimization, tagging strategies, or cost-monitoring systems.
* Experience working across both AWS and GCP.
* Experience with Datadog.
* Background in data platform engineering or shared infrastructure engineering.
Additional Information
Required Tools & Platforms
* Python
* SQL
* AWS Glue
* Amazon Athena
* Amazon Aurora
* Snowflake
* dbt, Airflow, or Dagster
* Terraform
* CI/CD tooling
* Git or another version-control platform
* REST APIs
Location, Time & Engagement
* Remote contract opportunity.
* Candidates must be located in LATAM.
* Full-time allocation of approximately 40 hours per week.
* Candidates must be available to work a U.S.-based EST or CST schedule.
* Contract expected to continue through March 31, 2027.
Skills Required
- Experience building and maintaining end-to-end ELT or ETL pipelines in cloud environments
- Strong SQL skills
- Strong Python skills
- Experience with dbt, Airflow, or Dagster
- Hands-on experience with AWS Glue, Amazon Athena, and Amazon Aurora
- Experience with Snowflake
- Strong data modeling experience
- Experience processing data at scale
- Experience with CI/CD and version control
- Hands-on Infrastructure as Code experience using Terraform
- Experience building or maintaining REST API integrations
- Experience optimizing data pipelines for performance and cost
- Strong analytical and troubleshooting skills
- Experience with data validation, auditing, and production pipeline support
- Enterprise experience
- Scala experience
- FinOps Certified Practitioner or FinOps Certified Engineer certification
- Experience with cloud cost optimization, tagging strategies, or cost-monitoring systems
- Experience working across AWS and GCP
- Experience with Datadog
- Background in data platform engineering or shared infrastructure engineering
- Located in LATAM
- Availability for approximately 40 hours per week on a U.S.-based EST or CST schedule
What We Do
Lifted, an Upwork Company, is a B2B SaaS platform that helps enterprise organizations source, contract, manage, and pay contingent talent globally and compliantly. It supports multiple engagement models, including independent contractors, staff augmentation, and employer-of-record, while integrating with MSPs and VMSs to provide centralized visibility, spend control, and audit-ready compliance, delivering a white-labeled talent experience for hiring managers and contingent workforce programs.
.png)
