The Role
Design, build, and maintain data pipelines and Azure Search indexes to support ingestion of structured and unstructured data. Optimize index parameters for RAG and rank evaluation, leverage Document Intelligence Services and OpenAI API integrations, and use Databricks and Python for data transformation and orchestration. Ensure seamless integration with Azure Data Factory and Azure analytics services, collaborating globally in an agile environment to deliver production-ready AI-driven solutions.
Summary Generated by Built In
As a Senior Data & Analytics Engineer, you will:
- Design, develop, and maintain robust data pipelines to support ingestion and processing of structured and unstructured data into Azure Search Index.
- Optimize index parameters to improve Retrieval-Augmented Generation (RAG) and rank-based evaluation, enhancing the performance and accuracy of AI/ML models.
- Work with Document Intelligence Services to extract relevant information from various document types, supporting data-driven insights and decision-making.
- Collaborate with the OpenAI API to integrate advanced AI functionalities, aiding the development of innovative, production-ready AI solutions.
- Utilize Databricks and Python for advanced data manipulation, analysis, and orchestration.
- Ensure seamless integration with Azure Data Factory, Azure cloud infrastructure, and analytics services.
- Participate in end-to-end solution development within a multicultural, multilingual, and agile environment.
What You Bring to the Table:
- 10+ years of professional experience in Data Engineering and Analytics, with a focus on cloud-native and AI-driven solutions.
- Expertise in Python programming for data processing, analytics, and automation.
- Hands-on experience with Databricks for data transformation, ETL, and orchestration.
- Proven experience designing and implementing data architectures in large-scale enterprise environments.
- In-depth understanding of Microsoft Azure cloud services, preferably holding Azure Infrastructure Associate Certification (Azure IA Engineer Associate).
- Exposure to Document Intelligence Services and OpenAI APIs for building intelligent, AI-powered solutions.
You should possess the ability to:
- Work autonomously, while ensuring technical choices are aligned with broader team strategies.
- Innovate and find efficient solutions when faced with complex technical challenges.
- Collaborate across global teams in a fast-paced, deadline-driven, multicultural setting.
- Translate technical requirements into scalable data solutions that support AI and analytics goals.
- Maintain high standards of data quality, integration, and system performance across platforms.
What We Bring to the Table:
- A forward-thinking environment focused on AI innovation, data intelligence, and cloud-native architectures.
- Opportunities to work with cutting-edge tools and platforms such as OpenAI, Azure AI Services, Databricks, and Azure Data Factory.
- An agile, global team culture that values autonomy, creativity, and continuous improvement.
- Real-world challenges where your contributions directly influence the success of AI-powered business solutions.
Let’s Connect
Want to discuss this opportunity in more detail? Feel free to reach out.
Recruiter: Aswin Dhanvandhar
Phone: +31 20 369 0609 ; Extn :141
Phone: +31 20 369 0609 ; Extn :141
LinkedIn:https://www.linkedin.com/in/aswin-dhanvandhar/
Skills Required
- 10+ years professional experience in Data Engineering and Analytics
- Expertise in Python for data processing, analytics, and automation
- Hands-on experience with Databricks for data transformation, ETL, and orchestration
- Experience designing and implementing data architectures in large-scale enterprise environments
- In-depth understanding of Microsoft Azure cloud services
- Azure Infrastructure Associate Certification (Azure IA Engineer Associate)
- Exposure to Document Intelligence Services and OpenAI APIs
- Experience integrating with Azure Data Factory and Azure analytics services
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
STAFIDE is a Netherlands-based niche technology talent consulting company operating across Europe. It helps organizations identify, recruit, and deploy technology professionals in areas including cybersecurity, cloud engineering, software development, data analytics, ERP, infrastructure, and digital transformation. Its services include recruitment, workforce engagement, secondment, onboarding support, workforce deployment, and workforce analytics that support technology hiring and expansion.
.jpg)
