This is a remote position.
- Data Pipeline Engineering: Architect, build, and maintain complex, real-time, and batch data pipelines using Azure Data Factory, Python/PySpark, and Databricks.
- • Architecture & Modelling: Design and implement modern data warehouse solutions, data models, and data lakes, optimizing for performance and scalability.
- • Data Ingestion & Integration: Ingest, cleanse, and transform data from diverse sources into usable data structures for analytics.
- • Security & Governance: Implement security features, including role-based access control (RBAC), data encryption, and governance via Azure Purview.
Requirements
- • Performance Optimization & Monitoring: Troubleshoot and tune data systems and SQL queries for efficiency; monitor data workflows.
- • Technical Leadership & Mentorship: Lead code reviews, mentor junior engineers, and define technical standards and best practices.
- • Collaboration: Work with data scientists, analysts, and stakeholders to deliver actionable business insights.
- • Azure Services: Azure Data Factory, Databricks, Synapse Analytics, Data Lake Storage.
- • Languages & Tools: Python/PySpark, SQL, Scala, CI/CD (DevOps) tools.
- • Processes: ETL/ELT, Data Modelling, Data processing
Benefits
Diversity Inclusion:
At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, color, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.
Exavalu also promotes flexibility depending on the needs of employees, customers and the business. It might be part-time work, working outside normal 9-5 business hours or working remotely.. We also have a welcome back program to help people get back to mainstream after a long break due to health or family reasons
Skills Required
- Experience with Azure Data Factory
- Experience with Databricks
- Experience with Azure Synapse Analytics
- Experience with Azure Data Lake Storage
- Proficiency in Python or PySpark
- Proficiency in SQL
- Experience with Scala
- Experience with CI/CD and DevOps tools
- Experience with ETL/ELT and data processing
- Experience with data modeling
- Experience implementing RBAC, data encryption, and data governance
- Experience troubleshooting, monitoring, and optimizing data systems and SQL queries
- Technical leadership, code reviews, and mentoring junior engineers
What We Do
Exavalu leads the way in business and technology consulting and solution delivery, focusing on specialized digital transformation across the Insurance, Healthcare & Life Sciences, and Nonprofit industries. As an award-winning digital transformation advisor, we take pride in delivering leading-edge solutions to clients worldwide. Led by industry veterans and technology experts, we bring our deep understanding in customer experience, process automation, digital engineering, cloud, data and AI with a very strong industry core foundation. Drawing on our industry insights and technological acumen, we enable clients to drives growth, profitability, and cost optimization. We mitigate risks and elevate customer experience through our comprehensive suite of services, including strategic advisory, expert-led technology [build and maintenance], and best-in-class products and solutions. Our unwavering focus on understanding the industry's hard problems and finding the right solution has garnered recognition as the preferred ally for organizations seeking transformative growth.
