Company Description
We’re seeking a Data Engineer to build and maintain our data systems and machine learning models, using Scala to support and enhance our products.
We have primed ourselves since day one to build one of the most resilient and scalable systems to support what we saw as one of the most interesting challenges in our careers. Our system currently processes TBs/s of data with upwards of 2 million writes per second - and as we grow, those numbers are expected to grow with us.
We have also built our infrastructure and systems to allow innovation. If you have an idea to implement, or new technology to try out, this is the right place for you.
As a Data Engineer, you will be working on our core systems, engines, and product services using the most sophisticated cutting-edge technologies to solve challenging problems that are unique to the DEI world.
Job Description
- Work with Apache Spark batch & real-time streaming to process data at scale
- Work with Scala microservices hosted on K8s (GKE) to support our products
- Work with MlLib and TensorFlow on Vertex AI to solve forecasting and simulations in addition to a variety of machine learning challenges
- Deploy new models and engines for new ideas and analyses
Qualifications
- 5+ years of experience
- Advanced knowledge of different non-relational schema models (Column Family, Graph, Document, Object)
- Experience with advanced topologies and architecture design such as KAPPA and LAMBDA architectures
- GCP Dataflow experience
- Experience in Scala
- Experience in Python or Java
- Experience with high throughput systems
- Strong communication skills and at least a C1 level of English
Additional Information
Top Skills
What We Do
Sigma Software Group, an award-winning and trusted IT partner, has been serving customers for over 21 years, providing comprehensive IT solutions to various businesses, ranging from startups to established software product houses. As one of Europe's substantial IT consultancies, it brings together a dedicated workforce of over 2,100 professionals in 40 offices across 19 countries. With a diverse client base, including more than 300 enterprises, including Fortune 500 stalwarts, Sigma Software Group is a preferred choice for developing solutions that help businesses create cutting-edge products while meeting their unique needs.
Sigma Software Group operates as a dynamic ecosystem of tech companies, offering 25 ready-to-implement innovative products and 40+ value-added services. Furthermore, Sigma Software Group is committed to fostering innovation through initiatives such as the Sigma Software Labs business incubator, Sigma Software University, the SID Venture Partners VC Fund, UA Tech Network, Techosystem, the European Business Association, and other collaborative efforts.
Since 2015, Sigma Software Group has consistently earned recognition on the IAOP's prestigious World's Top 100 Outsourcing list. The company's accomplishments have also been acknowledged by prominent global media outlets such as Forbes, CNBC, The Times, and Reuters
.png)
.png)
.png)
