Top Data Engineer Jobs in Portugal

Lead design and build of a cloud-based big data analytics platform: implement analytics infrastructure, integrate streaming and batch data, develop distributed processing pipelines, manage predictive analytics models, and apply machine learning and Bayesian methods. Work involves Scala on OS X and AWS, Java and Clojure, Kafka/Samza, NoSQL, and following TDD, Agile, CI/CD practices.

Design and build IBM DataStage ETL jobs to extract, transform, and load data into 3NF and star schemas. Implement Slowly Changing Dimensions and Change Data Capture, write strong Oracle SQL, use QualityStage and parallel processing, create source-to-target mappings, write/execute test cases, and use Unix shell scripting. Collaborate with stakeholders and maintain data warehouse ETL processes.

Design, build and deliver SAP-originated and non‑SAP data in formats consumable by non‑SAP tools and external B2B partners using SAP BO/Data Services, BW/BI. Support ETL, integration and data delivery processes.

Seeking four DataStage ETL developers with 2-5 years experience for a long-term (2-3 year) contract. Candidates will be screened via phone or Skype; internal candidates preferred.

Develop, deploy, and support large-scale distributed Big Data applications. Design multi-tier software, participate across the SDLC, perform database design and performance tuning, troubleshoot production issues, and collaborate with internal clients. Work primarily with Hadoop, Spark, Impala, Hive in Unix/Linux and Windows environments within financial/consumer banking contexts.

Develop, deploy, and support large-scale distributed Big Data applications. Design multi-tier software across the full SDLC, perform problem investigation and performance tuning, work in Unix/Windows environments, and collaborate with finance domain teams. Use Hadoop, Spark, Impala, Hive, batch and online processing, shell/Perl scripting, and ETL/job-scheduling tools as needed.

Senior UI/Data Visualization developer building interactive data visualizations using D3 and HTML5. Apply data visualization best practices, handle large-volume/big-data backends, and integrate with tools like R, Tableau, and Excel. Work includes mobile-friendly visualization development and requires retail domain knowledge.

Develop and maintain big data solutions using Hadoop, HBase, MongoDB and Core Java on Linux. Implement and support scalable data processing pipelines; contribute to big data architecture and platform tasks.

Senior UI/Data Visualization Developer building interactive visualizations using D3 and HTML5. Works with large datasets and big-data backends, applies visualization best practices, and integrates with R, Tableau, Excel and mobile platforms. Requires retail domain experience and US work authorization.

Design and build the data/product layer that converts external sources (filings, regulations, feeds) into trusted signals. Own end-to-end pipelines from raw source through agent-based reasoning to product surfaces, focusing on scale, reliability, verification-first AI, and operationalizing multi-agent runtimes.

Remote entry-level data science engineer role building end-to-end data science applications: data preparation, exploration, feature engineering, modeling, automation, and distributed model implementations using Python, SQL and scalable paradigms (MapReduce/PySpark). Must show real-world full-cycle project experience and readiness to learn PySpark quickly.

Remote entry-level Big Data Engineer role building data acquisition and munging pipelines. Requires strong Python3 (NumPy, Pandas), advanced SQL, scalable algorithm and data-structure implementation on distributed clusters, converting code to functional paradigms, and the ability to learn PySpark or Kafka quickly. Product-development, startup experience and real-world pipeline projects preferred.

Lead Data Engineer/ETL role requiring 5-10 years of Informatica ETL experience. Responsibilities focus on BDM, TDM, data quality, big data, data warehousing, and star schema design. Strong verbal and written communication and a technical bachelor’s degree required. Unix experience is a plus.

Design, build, and deploy an ETL-based transactional data system to read and manage information state and transmit data via web services. Implement solution from provided design, perform unit testing, deploy to development/test, and collaborate with QA and DPS to resolve defects.

Develop ETL and data visualization solutions for a big data customer and partner experience transformation program. Build native Hadoop and Vertica ETL pipelines, collaborate with stakeholders, and support data integration and visualization deliverables for analytics teams.

Design, develop, and release data ingestion and streaming solutions using Big Data technologies (Flume, NiFi, Kafka, Spark/Storm). Collaborate with stakeholders and distributed teams, follow agile practices, and support data warehousing and reporting efforts.

Design, develop, maintain and test scalable big data solutions. Build preprocessing and reporting pipelines, collect/parse/analyze/visualize large datasets, test and deploy machine-learning models on big data, and work in agile teams to deliver analytics solutions.

Design, build, maintain, and test big data solutions and preprocessing/reporting pipelines. Collect, parse, manage, analyze, and visualize large datasets. Test and deploy machine learning models for scoring and prediction. Collaborate in agile teams to deliver scalable, reusable code and production-ready analytics on cloud platforms.

Design, develop, test and maintain scalable big-data solutions and workflows. Collect, parse, analyze and visualize large datasets; evaluate, test and deploy machine-learning models for scoring and prediction. Work in an agile team, automate tasks using scripting, and leverage Hadoop/Spark and AWS for production pipelines.

Design and develop Big Data solutions using Hadoop ecosystem (Pig, Hive, MapReduce, HBase, YARN, Spark, Impala, Kafka, Oozie). Implement Java and scripting-based pipelines, tune performance on large datasets, participate across SDLC phases, troubleshoot, and collaborate with stakeholders in a global delivery environment.

Design, develop, test and implement IBM InfoSphere MDM solutions (v11.5.0.3) for pharma distribution. Perform architecture and design reviews, build J2EE/Java web services (servlets, EJB, XML), collaborate with global stakeholders, engage client-facing activities, and support deployments; travel as required.

Design and develop Big Data solutions using the Hadoop ecosystem (Pig, Hive, MapReduce, HBase, Spark, Kafka, Oozie). Implement Java-based services and scripting, tune performance for large datasets, participate in full project lifecycle, and collaborate with stakeholders. Role requires extensive travel and strong communication.

Develop and maintain Hadoop-based big data solutions using Pig, Hive, MapReduce, HDFS, HBase, Spark, Kafka and related tools. Implement web services/APIs, performance tune large datasets, script in Java and shells, participate in full project lifecycle, and collaborate with stakeholders. Extensive travel and on-site work required.

Develop and maintain Hadoop/Big Data solutions using Pig, MapReduce, Hive, HBase, Spark, Kafka and related tools. Build Java-based components, scripts, and APIs; tune performance on large datasets; participate in full project lifecycle and collaborate with stakeholders.

Develop and maintain web applications and services using Microsoft .NET stack and JavaScript frameworks. Build solutions with AngularJS, NodeJS, MongoDB; design and implement WCF/SOAP web services, XML/XSLT; participate across SDLC from architecture through maintenance.