Senior Data Engineer

Reposted 12 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
In-Office
Senior level
Information Technology • Consulting
The Role
The Senior Data Engineer will design and optimize data pipelines using Databricks and Apache Spark, ensuring data quality and security while collaborating with teams to deploy ML models.
Summary Generated by Built In
Company Description

Version 1 has celebrated over 28 years in Technology Services and continues to be trusted by global brands to deliver solutions that drive customer success. Version 1 has several strategic technology partners including Microsoft, AWS, Oracle, Red Hat, OutSystems and Snowflake. We’re also an award-winning employer reflecting how employees are at the heart of Version 1.

We’ve been awarded: Innovation Partner of the Year Winner 2023 Oracle EMEA Partner Awards, Global Microsoft Modernising Applications Partner of the Year Award 2023, AWS Collaboration Partner of the Year - EMEA 2023 and Best Workplaces for Women by Great Place To Work in UK and Ireland 2023.

As a consultancy and service provider, Version 1 is a digital-first environment and we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of the fastest-growing consultancies globally.

Job Description

This is an exciting opportunity for an experienced Data Engineer of large scale data solutions who will join a team delivering a transformative solutions for a key Version 1 customer. 

We are seeking engineers that can support across multiple initiatives and have the flexibility to move between projects to deal with delivery demands.

Qualifications

Essential:

 

We are seeking a talented and experienced Databricks Engineer to join our innovative team in Bengaluru, India. In this role, you will be responsible for designing, implementing, and optimising data pipelines and analytics solutions using the Databricks platform. You will collaborate closely with cross-functional teams to deliver high-quality, scalable data solutions that drive business insights and decision-making.

  • Develop and optimise ETL processes using Databricks and Apache Spark
  • Design and implement efficient data models and schemas for optimal data storage and retrieval
  • Collaborate with data scientists and analysts to build and deploy machine learning models
  • Ensure data quality, consistency, and reliability across all data pipelines
  • Optimise query performance and troubleshoot data processing issues
  • Implement robust data security and access control measures
  • Stay abreast of the latest Databricks features and best practices
  • Participate in code reviews and contribute to the team's knowledge base
  • Mentor junior team members and share expertise in big data technologies
  • Develop and maintain documentation for data processes and workflows
  • Collaborate with stakeholders to understand business requirements and translate them into technical solutions

Qualifications

  • Bachelor's degree in computer science, Data Science, or a related field
  • 6+ years of experience in data engineering or a related field
  • Strong proficiency in Databricks platform and Apache Spark
  • Excellent SQL skills and experience with Python or Scala
  • Experience with using Databricks Unity Catalog for data governance
  • Proven experience in designing and implementing ETL processes and data pipelines
  • Solid understanding of big data technologies and distributed computing concepts
  • Experience working with cloud platforms such as AWS, Azure, or GCP
  • Familiarity with version control systems, preferably Git
  • Strong analytical and problem-solving skills with keen attention to detail
  • Excellent communication and collaboration skills
  • Experience with data warehousing and analytics concepts
  • Knowledge of data governance and compliance standards
  • Experience with real-time data processing and streaming technologies
  • Ability to work in a fast-paced, dynamic environment and manage multiple priorities
  • Databricks certifications are desirable

Additional Information

At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their well-being, professional growth, and financial stability.

One of our standout advantages is the ability to work with a hybrid schedule along with business travel, allowing our employees to strike a balance between work and life. We also offer a range of tech-related benefits, including an innovative Tech Scheme to help keep our team members up-to-date with the latest technology.

We prioritise the health and safety of our employees, providing private medical and life insurance coverage, as well as free eye tests and contributions towards glasses. Our team members can also stay ahead of the curve with incentivized certifications and accreditations, including AWS, Microsoft, Oracle, and Red Hat.

Our employee-designed Profit Share scheme divides a portion of our company's profits each quarter amongst employees. We are dedicated to helping our employees reach their full potential, offering Pathways Career Development Quarterly, a programme designed to support professional growth.

Top Skills

Spark
AWS
Azure
Databricks
GCP
Git
Python
Scala
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dublin
3,000 Employees
Year Founded: 1996

What We Do

Version 1 proves that IT can make a real difference to our customers'​ businesses. We are trusted by global brands to deliver IT services and solutions which drive customer success. Our 3000+ strong team works closely with our technology partners to provide independent advice that helps our customers navigate the rapidly changing world of IT. Our greatest strength is balance in our efforts to achieve Customer Success, Empowered People and a Strong Organisation, underpinned by the commitment to our values. We believe this is what makes Version 1 different and more importantly, our customers agree.

Similar Jobs

CrowdStrike Logo CrowdStrike

Engineering Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
18 Locations
10000 Employees

CrowdStrike Logo CrowdStrike

Senior Software Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
16 Locations
10000 Employees

CrowdStrike Logo CrowdStrike

Senior Software Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
KA, IND
10000 Employees

Elsevier Logo Elsevier

Account Manager

Artificial Intelligence • Healthtech • Information Technology • Other • Analytics
In-Office or Remote
3 Locations

Similar Companies Hiring

Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
LayerOne Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account