Data Engineer (with Databricks)

Our client is a leading SaaS provider that specializes in developing solutions to help users visualize, navigate, collaborate, and manage digital representations of physical assets. Their platform empowers industries to work efficiently by providing a comprehensive digital workspace for asset management.

Key Responsibilities:

• Design, build, and maintain production-grade data pipelines using Python.
• Collaborate with an international, English-speaking team to develop scalable data solutions.
• Integrate and manage APIs, with a focus on troubleshooting, maintaining, and refining API processes, especially for bug-related issues.
• Conduct in-depth analysis and debugging of system bugs, providing Tier 2 support for complex issues.
• Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists, documentation, and workflows.
• Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding.
• Actively participate in the division of team roles into Build and Run, assessing workflow and process efficiency.
• Write integration tests to ensure the quality and reliability of data services.
• Work with Gitlab or similar version control systems to manage code and collaborate with team members.
• Utilize Databricks for data processing and management.

Requirements:

• Experience: Minimum of 3 years as a data analyst, data engineer, or in a relevant field.
• Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
• API Management: Experience with API integration, troubleshooting, and support.
• Cloud & Containers: Familiarity with cloud platforms (preferably Azure) and container technologies (e.g., Docker).
• Data Platforms: Experience with Apache Spark, Databricks, Snowflake, or similar platforms.
• Database Skills: Knowledge of document, graph, and relational databases, with proficiency in SQL.
• Documentation & Workflow Management: Experience in creating and maintaining structured documentation.
• Testing: Proficient in writing and managing integration tests.
• Version Control: Experience with Gitlab or equivalent tools.
• English Proficiency: B2 level or higher.
• Interpersonal Skills: Strong collaboration and communication abilities, with experience in an international team environment

Nice to have:

• 3D Modeling: Familiarity with 3D matching and model refinement processes is a plus.