The Role
Design, build, and maintain scalable data pipelines and infrastructure (SQL warehouses, data lakes) using Azure and Databricks. Write production-grade PySpark/Python and SQL, consolidate and clean data, implement ETL/ELT, data modeling, orchestration/monitoring, and produce Power BI dashboards. Collaborate with stakeholders on data lineage and document processes for reproducibility.
Summary Generated by Built In
Location:
Chennai, Tamil Nadu, IndiaJob ID:
R0124753Date Posted:
2026-07-01Company Name:
HITACHI ENERGY TECHNOLOGY SERVICES PRIVATE LIMITEDProfession (Job Category):
Engineering & ScienceJob Schedule:
Full timeRemote:
NoJob Description:
Your Responsibilities:
- Display technical expertise in data analytics focusing on a team of diversified technical competencies.
- Build and maintain accurate and scalable data pipeline and infrastructure such as SQL Warehouse, Data Lakes, etc. using Cloud platforms (e.g.: MS Azure, Databricks).
- Proactively work with business stakeholders to understand data lineage, definitions, and methods of data extraction.
- Write production-grade SQL and PySpark code to create data architecture.
- Consolidate SQL databases from multiple sources, data cleaning, and manipulation in preparation for analytics and machine learning.
- Use data visualization tools such as Power BI to create professional quality dashboards and reports.
- Write good quality documentation for data processing for different projects to ensure reproducibility.
- Living Hitachi Energy’s core values safety and integrity, which means taking responsibility for your own actions while caring for your colleagues and the business.
Your Background:
- BE / B.Tech in Computer Science, Data Science, or related discipline and at least 5 years of related working experience.
- 5 years of data engineering experience, with understanding lake house architecture, data integration framework, ETL/ELT pipeline, orchestration/monitoring, star schema data modeling.
- 5 years of experience with Python/PySpark and SQL(Proficient in PySpark, Python, and Spark SQL)
- 2-3 years of hands-on data engineering experience using Databricks as the main tool (meaning >60% of their time is using Databricks instead of just occasionally).
- 2-3 years of hands-on experience with different Databricks components (DLT, workflow, Unity catalog, SQL warehouse, CI/CD) in addition to using notebooks.
- Experience in Microsoft Power BI.
Additional Insights:
- Basic understanding of Machine Learning algorithms.
- Enhanced Data Processing: AI/ML can automate and improve data processing tasks, making them more efficient and accurate.
- Predictive Analytics: Integrating AI/ML can help in building predictive models that can forecast trends and outcomes, providing valuable insights for decision-making.
- Personalization: AI/ML can be used to create personalized experiences for users by analyzing their behavior and preferences.
- Automation: AI/ML can automate repetitive tasks, freeing up time for more complex and creative work.
- Ability to quickly grasp concepts from a field that is not one's core competency; A fast learning generalist capable of solving problems independently and resourceful in a matrixed corporate environment.
- Proficiency in both spoken & written English language is required.
Skills Required
- BE/B.Tech in Computer Science, Data Science, or related discipline with at least 5 years related experience
- 5 years data engineering experience including lake house architecture, ETL/ELT, data integration, orchestration/monitoring, star schema modeling
- 5 years experience with Python, PySpark, and SQL (proficient in PySpark, Python, Spark SQL)
- 2-3 years hands-on Databricks as primary tool (>60% usage)
- 2-3 years hands-on experience with Databricks components (DLT, Workflows, Unity Catalog, SQL Warehouse, CI/CD)
- Experience with Microsoft Power BI
- Proficiency in spoken and written English
- Basic understanding of Machine Learning algorithms
- Ability to quickly learn cross-domain concepts and work independently in a matrixed environment
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Since its founding in 1910, Hitachi has responded to the expectations of society and its customers through technology and innovation. Our mission is to “Contribute to society through the development of superior, original technology and products.” Over the past 100+ years this commitment has led us to work towards creating a more sustainable society through our “Social Innovation Business”. We work to apply our expertise in information technology (IT), operational technology (OT), and a wide variety of products to advance social infrastructure systems and improve quality of life across the world.
