Data Engineering Tech Lead (Databricks)

Posted Yesterday
Be an Early Applicant
Poland
Senior level
Information Technology • Consulting
The Role
In this role, you will enhance a robust data pipeline for a SaaS product, ensuring customer data ingestion and validation. You will lead best coding practices, design and maintain data pipelines using Python, and collaborate with a global team to develop scalable data solutions, involving in-depth analysis and debugging of system bugs while ensuring documentation quality.
Summary Generated by Built In

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client’s platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Lead responsibilities:

  • Ensure the team follows best practices in coding, data modeling, and system integration.
  • Act as the primary point of contact for resolving complex technical challenges
  • Onboard new hires by providing hands-on guidance during their initial weeks, ensuring a smooth transition into the team
  • Work with the team of 3-5 engineers
  • You will not act as a line-manager

Key Responsibilities:

  • Design, build, and maintain data pipelines using Python
  • Collaborate with an international team to develop scalable data solutions
  • Conduct in-depth analysis and debugging of system bugs (Tier 2) 
  • Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows
  • Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding
  • Write integration tests to ensure the quality and reliability of data services
  • Work with Gitlab to manage code and collaborate with team members
  • Utilize Databricks for data processing and management

Requirements:

  • Programming: Minimum of 5 years as data engineer, or in a relevant field
  • Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
  • Data Skills: Structured approach to data insights
  • Cloud: Familiarity with cloud platforms (preferably Azure)
  • Data Platforms: Experience with Databricks, Snowflake, or similar data platforms
  • Database Skills: Knowledge of relational databases, with proficiency in SQL
  • Big Data: Experience using Apache Spark 
  • Documentation: Experience in creating and maintaining structured documentation
  • Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability
  • Version Control: Experience with Gitlab or equivalent tools
  • English Proficiency: B2 level or higher
  • Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset 

Nice to have:

  • Experience with Docker and Kubernetes
  • Experience with document and graph databases
  • 3D Modeling: Familiarity with 3D matching and model refinement processes is a plus
  • Ability to travel abroad twice a year for an on-site workshops 

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Top Skills

Python
The Company
HQ: North Miami Beach, Florida
2,135 Employees
On-site Workplace
Year Founded: 2002

What We Do

N-iX is a global software solutions and engineering services company that helps world’s leading organizations turn challenges into lasting business value, operational efficiency, and revenue growth using advanced technology. Whether you need to build a custom solution, modernize your digital product or acquire extra tech expertise - we have the experience and capabilities to ensure your success.

With over 2,000 professionals in 25 countries across Europe and the Americas, N-iX offers expert solutions in cloud, data analytics, embedded software, IoT, AI, machine learning, and other tech domains. Being in business for over two decades, we have worked with dozens of industry-leading enterprises and Fortune 500 companies creating value across a wide variety of sectors, including finance, manufacturing, supply chain, retail, e-commerce, healthcare, and more. Our unique combination of business domain expertise and technical know-how enables us to effectively collaborate with ISVs, tech companies, and enterprises of all sizes. Thanks to the strong tech ecosystem and partnerships with AWS, GCP, Microsoft, SAP, OpenText, Snowflake, and others, we bring extra speed, scale and efficiency to more than 160 organizations across the globe. N-iX is recognized by numerous industry awards, such as CRN Solution Provider 500, Global Outsourcing 100 by IAOP, ISG Provider Lens™, Modern Application Development services providers by Forrester, etc

Similar Jobs

Dynatrace Logo Dynatrace

Test Automation Engineer

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Hybrid
Gdańsk, Pomorskie, POL
4700 Employees

Remitly Logo Remitly

Senior Software Development Engineer

eCommerce • Fintech • Payments • Software • Financial Services
Kraków, Małopolskie, POL
2700 Employees

Remitly Logo Remitly

Software Development Engineer II

eCommerce • Fintech • Payments • Software • Financial Services
Kraków, Małopolskie, POL
2700 Employees

UL Solutions Logo UL Solutions

IT Architect

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Hybrid
Warsaw, Warszawa, Mazowieckie, POL
15000 Employees

Similar Companies Hiring

Silverfort Thumbnail
Security • Sales • Information Technology • Cybersecurity • Automation
GB
357 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account