The Role
Designs, builds, and maintains Azure-based data solutions and ETL pipelines using Azure Data Factory and Databricks. Manages SQL and MySQL databases, develops data models, optimizes queries, supports data governance and quality, and documents architectures and pipelines. Collaborates with data scientists, analysts, and business stakeholders to deliver reliable data for analysis and reporting. The role also involves security compliance and may include real-time processing, multi-cloud technologies, and machine learning concepts.
Summary Generated by Built In
Job Title: Senior Azure Data Engineer
Location: Hyderabad
Job Type: Full-Time
Job Summary: As an Azure Data Engineer, you will design, build, and maintain data solutions on Microsoft Azure, leveraging your expertise in SQL and MySQL to ensure high-quality data availability for analysis and reporting. You will collaborate closely with cross-functional teams to meet data needs and enhance decision-making capabilities.
Key Responsibilities:
Data Pipeline Development: Design and implement ETL processes using Azure Data Factory and Azure Databricks, ensuring data integration from various sources.
Database Management: Develop and maintain relational databases using SQL and MySQL, ensuring optimal performance and reliability.
Data Modelling: Create and maintain data models to support analytical needs, ensuring data is structured for efficient querying and reporting.
Query Optimization: Write and optimize complex SQL queries for data retrieval and reporting, improving performance and efficiency.
Collaboration: Work with data scientists, analysts, and business stakeholders to understand data requirements and ensure data quality.
Security and Compliance: Implement data governance practices and ensure compliance with data protection regulations.
Documentation: Create and maintain comprehensive documentation for data pipelines, databases, and architectural designs.
Qualifications:
Bachelor’s degree
4+ years of experience in data engineering or related roles.
Strong proficiency in Microsoft Azure services, particularly Azure Data Factory, Azure Databricks, Azure SQL Database.
Familiarity with AWS services will be advantageous in our multi-cloud environment.
Extensive experience with SQL and MySQL, including database design, optimization, and data manipulation.
Familiarity with programming languages such as Python or spark for data processing and analysis.
Understanding of data warehousing concepts and big data technologies (e.g., Hadoop, Spark) is a plus.
Experience with data governance and data quality best practices.
Excellent problem-solving skills and attention to detail.
Strong communication skills and ability to work collaboratively in a team environment.
Preferred Qualifications:
Microsoft Azure Data Engineer certification.
Experience with real-time data processing and stream analytics.
Knowledge of machine learning concepts and tools.
Skills Required
- Bachelor's degree
- 4+ years of experience in data engineering or related roles
- Strong proficiency in Microsoft Azure services, particularly Azure Data Factory, Azure Databricks, and Azure SQL Database
- Extensive experience with SQL and MySQL, including database design, optimization, and data manipulation
- Familiarity with programming languages such as Python or Spark
- Understanding of data warehousing concepts and big data technologies such as Hadoop and Spark
- Experience with data governance and data quality best practices
- Excellent problem-solving skills and attention to detail
- Strong communication skills and ability to work collaboratively in a team environment
- Familiarity with AWS services in a multi-cloud environment
- Microsoft Azure Data Engineer certification
- Experience with real-time data processing and stream analytics
- Knowledge of machine learning concepts and tools
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Proclink is a digital and AI transformation company that helps regulated and operationally intensive enterprises modernize systems, workflows, and decision environments. It combines strategy and consulting, data engineering, artificial intelligence, analytics, implementation and integration, managed services, and technology services. The company serves manufacturing, financial services, life sciences, and other regulated industries, delivering connected enterprise intelligence and measurable operational performance for clients.
