Are you an experienced Data Engineer ready to tackle complex, high-load, and data-intensive systems? We are looking for a Senior professional to join our team in Ukraine, Europe, working full-time on a project that will make a real impact in the public sector.
At Sigma Software, we specialize in delivering innovative solutions for enterprise clients and public organizations. In this role, you will contribute to building an integrated platform that collects, processes, and visualizes critical indicators, enabling better decision-making and analytics.
Why join us? You will work with a modern big data stack, have end-to-end involvement from ingestion to machine learning workflows, and be part of a professional team that values ownership, collaboration, and continuous improvement.
PROJECT
You will be involved in developing an integrated platform that processes both batch and streaming data, ensures secure and governed data environments, and supports advanced analytics and machine learning workflows. The solution will leverage modern big data technologies to provide actionable insights for the public sector.
- Design and implement data ingestion pipelines for batch and streaming data
- Configure and maintain data orchestration workflows (Airflow, NiFi) and CI/CD automation for data processes
- Design and organize data layers within Data Lake architecture (HDFS, Iceberg, S3)
- Build and maintain secure and governed data environments using Apache Ranger, Atlas, and SDX
- Develop SQL queries and optimize performance for analytical workloads in Hive/Impala
- Collaborate on data modeling for analytics and BI, ensuring clean schemas and dimensional models
- Support machine learning workflows using Spark MLlib or Cloudera Machine Learning (CML)
- Proven experience in building and maintaining large-scale data pipelines (batch and streaming)
- Strong knowledge of data engineering fundamentals: ETL/ELT, data governance, data warehousing, Medallion architecture
- Strong SQL skills for Data Warehouse data serving
- Minimum 3 years of experience in Python or Scala for data processing
- Hands-on experience with Apache Spark, Kafka, Airflow, and distributed systems optimization
- Experience with Apache Ranger and Atlas for security and metadata management
- Upper-Intermediate English proficiency
WILL BE A PLUS
- Experience with Cloudera Data Platform (CDP)
- Advanced SQL skills and Hive/Impala query optimization
- BS in Computer Science or related field
- Exposure to ML frameworks and predictive modeling
PERSONAL PROFILE
- Ownership mindset and proactive approach
- Ability to drive initiatives forward and suggest improvements
- Team player with shared responsibility for delivery speed, efficiency, and quality
- Excellent written and verbal communication skills
Top Skills
What We Do
Sigma Software Group, an award-winning and trusted IT partner, has been serving customers for over 21 years, providing comprehensive IT solutions to various businesses, ranging from startups to established software product houses. As one of Europe's substantial IT consultancies, it brings together a dedicated workforce of over 2,100 professionals in 40 offices across 19 countries. With a diverse client base, including more than 300 enterprises, including Fortune 500 stalwarts, Sigma Software Group is a preferred choice for developing solutions that help businesses create cutting-edge products while meeting their unique needs.
Sigma Software Group operates as a dynamic ecosystem of tech companies, offering 25 ready-to-implement innovative products and 40+ value-added services. Furthermore, Sigma Software Group is committed to fostering innovation through initiatives such as the Sigma Software Labs business incubator, Sigma Software University, the SID Venture Partners VC Fund, UA Tech Network, Techosystem, the European Business Association, and other collaborative efforts.
Since 2015, Sigma Software Group has consistently earned recognition on the IAOP's prestigious World's Top 100 Outsourcing list. The company's accomplishments have also been acknowledged by prominent global media outlets such as Forbes, CNBC, The Times, and Reuters
