We are seeking a Data Engineer with strong Scala expertise to support and enhance the company’s data infrastructure and machine learning models. The ideal candidate is passionate about building scalable, resilient pipelines and is eager to innovate using cutting-edge technology in a high-impact environment.
You will contribute to the core systems and data services by applying state-of-the-art solutions to solve complex and large-scale engineering challenges.
CUSTOMER
Our client is a fast-growing technology company focused on solving real-world challenges. Since day one, they have been committed to building highly resilient and scalable systems that allow for experimentation and innovation. Their data platform is designed to be both powerful and flexible, offering engineers the freedom to introduce new ideas and experiment with the latest technologies.
PROJECT
The project involves enhancing the client’s large-scale data processing systems and supporting machine learning infrastructure. You’ll be working with a team of experienced engineers to design, build, and maintain core data pipelines and services using Scala and other advanced technologies. Your work will directly impact the efficiency and intelligence of the platform powering.
- Work with Apache Spark batch and real-time streaming to process data at scale
- Work with Scala microservices hosted on K8s (GKE) to support our products
- Work with MLlib and TensorFlow on Vertex AI to solve forecasting and simulations in addition to a variety of machine learning challenges
- Deploy new models and engines for new ideas and analysis
- At least 5 years of commercial experience with Big Data
- Advanced knowledge of different non-relational schema models (Column Family, Graph, Document, Object)
- Experience with advanced topologies and architecture design such as Kappa and Lambda architecture
- Experience with GCP Dataflow
- Experience with Scala
- Experience with Python
- Experience with high-throughput systems
- Experience with LLM
- At least Advanced level of English
PERSONAL PROFILE
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders
- Strong problem-solving and decision-making skills, with a focus on driving results and meeting deadlines
- Self-motivated, adaptable, and eager to learn new technologies and frameworks
Top Skills
What We Do
Sigma Software Group, an award-winning and trusted IT partner, has been serving customers for over 21 years, providing comprehensive IT solutions to various businesses, ranging from startups to established software product houses. As one of Europe's substantial IT consultancies, it brings together a dedicated workforce of over 2,100 professionals in 40 offices across 19 countries. With a diverse client base, including more than 300 enterprises, including Fortune 500 stalwarts, Sigma Software Group is a preferred choice for developing solutions that help businesses create cutting-edge products while meeting their unique needs.
Sigma Software Group operates as a dynamic ecosystem of tech companies, offering 25 ready-to-implement innovative products and 40+ value-added services. Furthermore, Sigma Software Group is committed to fostering innovation through initiatives such as the Sigma Software Labs business incubator, Sigma Software University, the SID Venture Partners VC Fund, UA Tech Network, Techosystem, the European Business Association, and other collaborative efforts.
Since 2015, Sigma Software Group has consistently earned recognition on the IAOP's prestigious World's Top 100 Outsourcing list. The company's accomplishments have also been acknowledged by prominent global media outlets such as Forbes, CNBC, The Times, and Reuters
