Data Engineer

Reposted 7 Days Ago
India
Mid level
Cloud • Information Technology
The Role
As an Azure Data Engineer, you will build and maintain data platforms, develop data pipelines, manage data lakes, and ensure security and compliance.
Summary Generated by Built In

Overview of 66degrees

66degrees is a leading Google Cloud Premier Partner, though this specific role focuses on our Microsoft Azure projects. We believe that great engineering takes heart, and we are dedicated to building innovative data solutions that guide our clients on their digital transformation journey.

Role Description

As an Azure Data Engineer, you will be responsible for building and maintaining robust, scalable data platforms. You will work with a variety of Azure services to deliver raw data into analytics-ready assets and support a secure, efficient data environment. This role requires strong hands-on engineering skills to implement data pipelines, manage data integrity, and ensure compliance with security and governance standards.

Responsibilities
  • Data Pipeline Development: Design, build, and maintain robust and scalable data pipelines to ingest, transform, and load data from various sources into the Azure data platform. This includes creating and managing jobs, dataflows, and triggers in Azure Data Factory and Azure Synapse Pipelines.
  • Data Modeling and Warehousing: Develop and implement conceptual, logical, and physical data models for data warehouses and data lakes. Work with star schema, snowflake schema, and other data modeling techniques to optimize data for analytics and reporting.
  • Data Lake Management: Manage data storage and organization within Azure Data Lake Storage Gen2. Ensure proper folder structures, security, and data lifecycle management for raw, processed, and curated data zones.
  • Data Transformation: Utilize tools like dbt (data build tool) within the Azure ecosystem to transform raw data into analytics-ready datasets. Write complex SQL queries and stored procedures to cleanse, enrich, and aggregate data.
  • Azure Service Integration: Integrate and work with a variety of Azure services, including Azure Synapse Analytics, Azure Databricks, Azure Functions, and Cosmos DB, to build a comprehensive data solution.
  • ETL/ELT Processes: Implement and optimize Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes to ensure data is moved efficiently and accurately.
  • Security and Governance: Implement and maintain data security best practices. Apply Role-Based Access Control (RBAC), managed identities, and Azure Key Vault to protect sensitive data. Work with Microsoft Purview for data cataloging and governance.
  • Performance Optimization: Monitor and optimize the performance of data pipelines, queries, and data warehouse solutions. Fine-tune data structures and processing logic to improve efficiency and reduce costs.
Qualifications
  • 4+ years of proven  experience with key Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks.
  • Strong proficiency in SQL and at least one programming language such as Python or Spark (PySpark, Scala).
  • Solid understanding of data warehousing principles, data modeling (dimensional modeling, etc.), and ETL/ELT concepts.
  • CI/CD: Experience with version control systems like Git and Continuous Integration/Continuous Deployment (CI/CD) practices using Azure DevOps.
  • Ability to work effectively with cross-functional teams, including data scientists, business analysts, and product owners, to understand requirements and deliver data solutions.
  • Excellent analytical and problem-solving skills with a focus on delivering high-quality, reliable data solutions.
  • Strong verbal and written communication skills to articulate technical concepts to both technical and non-technical stakeholders.

66degrees is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to actual or perceived race, color, religion, sex, gender, gender identity, national origin, age, weight, height, marital status, sexual orientation, veteran status, disability status, or other legally protected class.

Top Skills

Azure Data Factory
Azure Data Lake Storage
Azure Databricks
Azure Devops
Azure Synapse Analytics
Git
Python
Spark
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, Illinois
564 Employees

What We Do

At 66degrees, we specialize in helping businesses across all industries modernize through cloud adoption to achieve data-driven transformation. As a pure play Google Cloud partner, our team of experts leverages the latest Google Cloud technologies and best practices to create customized solutions for each client.

We offer comprehensive advisory, implementation, and managed services to support our clients throughout their cloud journey. Our commitment to excellence is reflected in our partnership with our clients. We prioritize staying up-to-date with the latest cloud technologies and trends through training and certification. By enabling businesses to harness the power of data, we help them make informed decisions, enhance customer experiences, and drive growth.

Similar Jobs

MetLife Logo MetLife

Data Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Hyderabad, Telangana, IND

ZS Logo ZS

Data Engineer

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
Pune, Maharashtra, IND

Rubrik Logo Rubrik

Data Engineer

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
In-Office
Bengaluru, Karnataka, IND

JPMorganChase Logo JPMorganChase

Data Engineer

Financial Services
Hybrid
Mumbai, Maharashtra, IND

Similar Companies Hiring

Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account