The Role
The Data Engineer will design and manage databases, data processing pipelines, and data streaming solutions. Responsibilities include performance tuning, database modifications, and collaborating with developers to enhance applications. The role demands gathering user requirements, producing technical manuals, and offering data management support.
Summary Generated by Built In
Job Description
Main Resposibilities:
- Design stable, reliable and effective databases, data processing pipelines and data streaming solutions.
- Performance tuning, optimization and maintenance of data systems.
- Modify databases and streaming systems according to specifications and perform tests.
- Solve database usage issues and malfunctions.
- Liaise with other developers to improve applications and establish best practices.
- Gather user requirements and identify new features.
- Develop technical and training manuals.
- Provide data management support to users.
- Ensure all database programs meet company and performance requirements.
- Research and suggest new database products, services and protocols.
Qualifications
Requirements:
- Minimum 4 years’ experience in a similar position within a dynamic and fast paced environment.
- In-depth understanding of data management (e.g. permissions, recovery, security and monitoring).
- Knowledge of software development life cycle.
- Hands on experience with SQL.
- Experience with data processing tools and creation of data pipelines (Spark, Hadoop, cloud native solutions, …).
- Experience with ETL tools (preferably Oracle Data Integrator).
- Familiarity with relational (preferably Oracle) and non-relational databases.
- Experience with one or more of the major cloud providers (AWS preferably), knowledge of SaaS/PaaS futures.
- Experience with CI/CD pipelines (e.g. Jenkins).
- Familiarity with infrastructure as code software tools (e.g. Terraform).
- Familiarity with data modelling concepts (Inmon, Kimball, Data Vault, …).
- Excellent analytical and organization skills.
- An ability to understand front-end users requirements and problem-solving attitude.
- Excellent verbal and written communication skills.
- Very good command of English.
Nice to have:
- Understanding business needs, experience in cooperation with business, gathering business requirements, creating diagrams and documentation of mappings.
- Experience in performance tuning.
- Java/Python experience.
- Knowledge of user interface web applications
Additional Information
- Solid, competitive salary.
- Work in multilingual, multinational and multicultural environment on international projects
Top Skills
SQL
The Company
What We Do
We are an international Innovation, IT and high-tech engineering consulting company that delivers unique value in a wide variety of industries. Our mission is to add value to our customers businesses by providing digital and technological innovation services, delivering disruptive results and making our clients stand out in their market. We are driven by a creative and innovative consulting approach strongly oriented to getting results. We MAKE THE DIFFERENCE. Poland | UK | Switzerland | USA | Norway | Portugal | Spain | France | Singapore Warsaw Prosta 20 Wrocław Rybacka 7 Lublin Grottgera 2