Senior Data Engineer- Tech Lead (immediate role)

Posted 7 Hours Ago
Be an Early Applicant
Kochi, Ernakulam, Kerala
Expert/Leader
Consulting
The Role
The Senior Data Engineer will lead discussions to gather data requirements and address data-related challenges. Responsibilities include writing complex SQL queries, managing data pipelines using Azure Data Factory, optimizing workflows in Databricks, and utilizing Git for version control. The role requires strong analytical skills and the ability to communicate findings effectively.
Summary Generated by Built In

Responsibilities

  • Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges by leading a team
  • Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data. Hands on experience with PySQL/Pyspark etc.
  • Hands on Experience in creating and managing data pipelines using Azure Data Factory. Understanding of data integration, transformation, and workflow orchestration in Azure environments.
  • Knowledge of data engineering workflows and best practices in Databricks. Able to understand existing templates and patterns for development. Hands on experience with Unity Catalog and Databricks workflow.
  • Proficiency in using Git for version control and collaboration in data projects. Ability to work effectively in a team environment, especially in agile or collaborative settings. 
  • Clear and effective communication skills to articulate findings and recommendations for other team members. Ability to document processes, workflows, and data analysis results effectively. 
  • Willingness to learn new tools, technologies, and techniques as the field of data analytics evolves. Being adaptable to changing project requirements and priorities. 

Skills

  • 9+ years of overall experience with more than 5 years of expertise in Azure technologies
  • Ability to envision/lead E2E solution and solve technical issue during offshore.
  • Azure Databricks, Data Lakehouse architectures, and Azure Data Factory.
  • Expertise in optimizing data workflows and predictive modeling.
  • Designing and implementing data pipelines using Databricks, Spark,
  • Expertise in batch and streaming data solutions, automating workflows with CI/CD tools like Jenkins and Azure DevOps, and ensuring data governance with Delta Lake
  • Spark, PySpark, Delta Lake, Azure DevOps, Python.

Top Skills

Pyspark
Python
SQL
The Company
Bridgewater, NJ
93 Employees
On-site Workplace
Year Founded: 2012

What We Do

Zealogics LLC provides a broad range of IT consulting, systems implementation and application outsourcing services through an optimized global delivery model. Zealogics builds deep knowledge of traditional product engineering across mechanical, electronics and software platforms, to enable clients to navigate their digital transformation.
Zealogics values engineering techniques, automation frameworks, and reference models which are refined through engagements with Fortune 500 enterprises and OEMs. We combine customer-centric product strategies through a collaborative approach for execution. We help to harmonize processes, identify bottlenecks, and eliminate non-value tasks to deliver world-class products.
With impeccable focus on client needs we connect specialized resources for the right positions, both for full time and contractual placements. Our long-term relationships with employees and clients have been built in an environment of integrity and commitment, with a shared goal of mutual success. Zealogics hires experienced people to solve a wide array of IT and Engineering challenges that our clients face. Our guarantee - Zealogics provides the best value services in town.

Similar Jobs

Zafin Logo Zafin

SecOps Analyst

Fintech • Payments • Software
Trivandrum, Thiruvananthapuram, Kerala, IND
450 Employees

Zafin Logo Zafin

Market Research Analyst

Fintech • Payments • Software
Trivandrum, Thiruvananthapuram, Kerala, IND
450 Employees

Kantar Logo Kantar

Research Executive

Marketing Tech • Analytics
Technopark Campus, Thiruvananthapuram, Kerala, IND
34629 Employees

Kantar Logo Kantar

Analyst - LIFTROI

Marketing Tech • Analytics
Technopark Campus, Thiruvananthapuram, Kerala, IND
34629 Employees

Similar Companies Hiring

Premier International Thumbnail
Information Technology • Database • Consulting
Chicago, IL
120 Employees
Eastwall Thumbnail
Software • Information Technology • Consulting • Cloud • Big Data Analytics • Artificial Intelligence • App development
Denver, CO
20 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account