Top Data Engineer Jobs in Portugal

6 Days AgoSaved
In-Office
Houston, TX, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouses. Implement Python ETL/ELT pipelines and Airflow orchestration, ingest from third-party APIs, optimize Parquet/Avro/ORC columnar storage, and work with Spark, Snowflake, and cloud platforms. Act as technical consultant to translate business goals into data architecture roadmaps, use Terraform for infra, and support AI/ML initiatives while ensuring data integrity and pipeline performance.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Irving, TX, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest data from third-party APIs, optimize columnar formats and SQL, support ML initiatives, consult with stakeholders, and provision infrastructure using AWS and Terraform.
Top Skills: AirflowAvroAWSDuckdbElasticsearchGCPJupyterOpensearchOrcPandasParquetPolarsPysparkPythonSagemaker StudioScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Fort Lauderdale, FL, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures; implement Python ETL/ELT pipelines and Airflow orchestration; ingest data from third-party APIs; manage columnar file formats (Parquet/Avro/ORC); optimize pipelines for Snowflake, Spark, and AWS; consult stakeholders to translate business goals into technical roadmaps; use Terraform for infrastructure.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterLakehouseMedallion ArchitectureNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Richmond, VA, USA
Senior level
Senior level
Software
Design and implement scalable data lakes, warehouses, and lakehouses; build Python ETL/ELT pipelines and Airflow orchestration; ingest from third-party APIs; optimize columnar formats (Parquet/Avro/ORC) and SQL/NoSQL; support ML initiatives; consult with stakeholders and build AWS/on-prem infrastructure using Terraform.
Top Skills: AirflowAvroAWSAws Sagemaker StudioData LakehouseDuckdbElasticsearchEtl/EltGCPJupyterMedallion ArchitectureNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
West Palm Beach, FL, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest data from third-party APIs, optimize columnar file formats and SQL, support ML initiatives, consult stakeholders, and provision AWS/on-prem infrastructure using Terraform.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterLakehouseMedallion ArchitectureNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
New York, NY, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouses; implement Python ETL/ELT pipelines; orchestrate workflows with Airflow; ingest data from third-party APIs; optimize Parquet/Avro/ORC storage; work with Spark, Snowflake, and AWS/GCP; consult stakeholders and build infrastructure with Terraform.
Top Skills: AirflowAvroAWSDuckdbGCPNoSQLOrcPandasParquetPolarsPysparkPythonSnowflakeSparkSQL
6 Days AgoSaved
In-Office
Chicago, IL, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest from third-party APIs, optimize columnar formats, support ML/AI initiatives, and consult with stakeholders to translate business needs into technical roadmaps using cloud and infrastructure tools.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Port Charlotte, FL, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest from third-party APIs, optimize columnar formats, support ML initiatives, consult with stakeholders, and provision AWS/on-prem infrastructure with Terraform.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Dallas, TX, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest from 3rd-party APIs, optimize columnar file formats, support ML initiatives, and consult with stakeholders to translate business goals into data architecture roadmaps using Snowflake, Spark, and cloud infrastructure.
Top Skills: AirflowAvroAWSDuckdbGCPNoSQLOrcPandasParquetPolarsPysparkPythonSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Los Angeles, CA, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouses. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest from third-party APIs, optimize columnar formats and SQL, support ML initiatives, and consult stakeholders to translate business goals into technical roadmaps using cloud and infrastructure-as-code tools.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Atlanta, GA, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest third-party APIs, optimize columnar formats, and support ML initiatives using Spark, Snowflake, and AWS. Act as technical consultant translating business needs into data architecture roadmaps.
Top Skills: AirflowAvroAWSDuckdbGCPMedallion ArchitectureNoSQLOrcPandasParquetPolarsPysparkPythonSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Jacksonville, FL, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouses. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest from third-party APIs, optimize file formats and columnar storage, work with Spark/Snowflake and cloud (AWS/GCP), support ML initiatives, consult with stakeholders, and provision infrastructure via Terraform.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
New

Cut your apply time in half.

Use ourAI Assistantto automatically fill your job applications.

Use For Free
Application Tracker Preview
6 Days AgoSaved
In-Office
Austin, TX, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest data from third-party APIs, optimize columnar storage and query performance, and consult stakeholders to translate business goals into data architecture roadmaps using Spark, Snowflake, and cloud infrastructure.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Orlando, FL, USA
Senior level
Senior level
Software
Design and build scalable data lakes/warehouses/lakehouses and Python ETL/ELT pipelines. Orchestrate workflows with Airflow, ingest from 3rd-party APIs, optimize columnar formats and SQL, support ML initiatives, consult with stakeholders, and build cloud/on-prem infrastructure.
Top Skills: AirflowAvroAWSDuckdbGCPLakehouseNoSQLOrcPandasParquetPolarsPysparkPythonSnowflakeSparkSQL
6 Days AgoSaved
In-Office
Tampa, FL, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouses. Implement Python ETL/ELT pipelines and Airflow orchestration, ingest from third-party APIs, optimize columnar formats (Parquet/Avro/ORC), and work with Snowflake, Spark, and cloud (AWS/GCP). Serve as technical consultant translating business goals into data architecture and use Terraform for infrastructure.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Jersey City, NJ, USA
Senior level
Senior level
Software
Design and implement scalable data lakes, warehouses, and lakehouse architectures. Build Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest data from third-party APIs, optimize columnar file formats and SQL, and support ML initiatives. Act as technical consultant to translate business goals into data architecture roadmaps and build cloud/on-prem infrastructure.
Top Skills: AirflowAvroAWSDuckdbGCPNoSQLOrcPandasParquetPolarsPysparkPythonSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
San Francisco, CA, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouses. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest data from third-party APIs, optimize columnar file formats and SQL, support ML initiatives, consult with stakeholders to translate business requirements into data architecture roadmaps, and build AWS/on-prem infrastructure using Terraform and related tools.
Top Skills: AirflowAvroAWSAws Sagemaker StudioColumnar StorageDuckdbElasticsearchGCPJupyterLakehouseMedallion ArchitectureNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Boston, MA, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines and Airflow orchestration, ingest data from third-party APIs, optimize columnar formats and SQL, support ML initiatives, and consult with stakeholders to translate business goals into data architecture roadmaps using cloud and infrastructure tools.
Top Skills: AirflowAvroAWSAws Sagemaker StudioDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office
Miami, FL, USA
Senior level
Senior level
Software
Design and build scalable data lakes, warehouses, and lakehouse architectures. Implement Python ETL/ELT pipelines, orchestrate workflows with Airflow, ingest from third-party APIs, optimize columnar file formats, support ML initiatives, and consult stakeholders to translate business goals into data architecture roadmaps.
Top Skills: AirflowAvroAWSAws SagemakerDuckdbElasticsearchGCPJupyterNoSQLOpensearchOrcPandasParquetPolarsPysparkPythonScalaSnowflakeSparkSQLTerraform
6 Days AgoSaved
In-Office or Remote
Latham, NY, USA
Mid level
Mid level
Information Technology • Software
Validate ETL/ELT pipelines and data migrations, test database objects, write complex SQL for verification, automate database regression tests, assess query performance, and validate BI reports in Tableau/Power BI while tracking defects in JIRA/TestRail.
Top Skills: Apache JmeterEltETLJIRAPower BIPythonSeleniumSQLStored ProceduresTableauTestrailTriggersViews
6 Days AgoSaved
In-Office
Apex, NC, USA
100K-150K Annually
Senior level
100K-150K Annually
Senior level
Artificial Intelligence • Information Technology • Software • Consulting
Design, build, and operate large-scale Hadoop-based data pipelines and analytics platforms. Ingest, transform, and analyze structured and unstructured data to support enterprise analytics, machine learning, and reporting. Ensure reliability, performance, and cost-effective production operations; troubleshoot, debug, and document platform components.
Top Skills: AirflowSparkFlinkHadoopHbaseHdfsHiveJavaKafkaNoSQLOoziePythonScalaShellSpark StreamingSQLSqoop
6 Days AgoSaved
In-Office
San Jose, CA, USA
156K-186K Annually
Mid level
156K-186K Annually
Mid level
Aerospace • Defense
Build and operate production pipelines that convert raw infrared satellite frames into calibrated, orthorectified, analysis-ready products. Optimize pipeline latency and scale, implement workflow orchestration, build monitoring and operational tooling, collaborate with remote sensing scientists to productionize algorithms, participate in on-call rotations, and diagnose and fix data quality and processing failures.
Top Skills: AirflowAWSCogContainersFlyteGdalGeotiffNetcdfPythonTerraformXarrayZarr
6 Days AgoSaved
Remote or Hybrid
Blacksburg, VA, USA
139K-167K Annually
Mid level
139K-167K Annually
Mid level
Artificial Intelligence • Automotive • Robotics • Software • Transportation
Design, build, and operate data infrastructure and pipelines that ingest large-scale vehicle sensor logs into cloud storage, curate datasets and labeling workflows for ML training, deploy visualization tooling for log review and QA, implement validation/monitoring and data lifecycle policies, and collaborate with autonomy teams to define data contracts and support model training and evaluation.
Top Skills: Amazon RedshiftAws AthenaAws GlueAws S3CloudFormationOrcParquetPythonSQLTerraform
Reposted 6 Days AgoSaved
Remote or Hybrid
2 Locations
232K-386K Annually
Senior level
232K-386K Annually
Senior level
Consumer Web • Mobile
Design and implement scalable backend systems for Patreon's platform. Collaborate with engineers and product managers to maintain and optimize performance.
Top Skills: MySQLNoSQLPythonRestful Apis
6 Days AgoSaved
In-Office
2 Locations
164K-282K Annually
Senior level
164K-282K Annually
Senior level
eCommerce
Lead design and scale of Coupang's data platform for petabyte-scale ingestion, storage, and processing. Build and manage ETL/ELT pipelines, ensure data quality, observability, SLAs, security/compliance, and optimize cost and performance. Mentor engineers and drive platform automation and resiliency.
Top Skills: AirflowDagsterDbtHdfsPythonS3SQL
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account