The Role
Build and integrate scalable data pipelines on Azure using Databricks, Data Factory, Synapse, Python, PySpark, and SQL. Analyze structured, semi-structured, and unstructured data for quality and business value; develop prototypes, support solution design, and integrate analytics capabilities into core products. Collaborate across engineering teams and deliver Azure-based data solutions, with automotive domain experience required.
Summary Generated by Built In
- Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform.
- Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value.
- Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
- Required to participate in early state design and feature definition activities.
- Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem.
- Responsible for creating reusable and scalable data pipelines
- Act as a team-player while collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
Requirements
- Advanced working knowledge and experience with relational and non-relational databases
- Experience building and optimizing Big Data pipelines, architectures, and data sets
- Strong analytic skills related to working with unstructured datasets
- Expertise in Azure Data factory, Databricks, EventHub, Python, PySpark ,Azure Synapse and SQL.
- Azure DevOps experience mandatory to deploy the data objects.
- 7+ years of experience in the Azure Domain with minimum 5+ years of relevant experience.
- Minimum 3 implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
- Automotive domain experience is a must.
- Knowledge/Experience with Azure cloud stack.
- Knowledge of SAP IS-Auto, SAP BW/BO, Tableau, PowerBI will be considered as added advantage.
- Certification on Azure platform toolset will be considered as added advantage
- Bachelor’s degree in Computers or allied field of study.
Skills Required
- Advanced working knowledge and experience with relational and non-relational databases
- Experience building and optimizing big data pipelines, architectures, and datasets
- Strong analytical skills working with unstructured datasets
- Expertise with Azure Data Factory, Databricks, Event Hubs, Python, PySpark, Azure Synapse, and SQL
- Azure DevOps experience for deploying data objects
- 7+ years of experience in the Azure domain
- Minimum 5+ years of relevant experience
- At least three implementations from conceptualization through delivery of analytics capabilities on Azure
- Automotive domain experience
- Knowledge or experience with the Azure cloud stack
- Bachelor's degree in Computer Science or an allied field
- Knowledge or experience with SAP IS-Auto, SAP BW/BO, Tableau, or Power BI
- Azure platform toolset certification
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
TechCarrot is a global IT services provider and digital-transformation partner, delivering cost-effective, customer-centric digital solutions to clients worldwide. Its 200-plus technology specialists provide services across multiple industries, aiming to create seamless customer experiences and support client growth. Founded in 2016 and headquartered in Dubai, the company serves the Middle East and Africa through UAE operations, APAC through India, and has also expanded into the United States and the Netherlands.
