This is a remote position.
Shuru is an AI-native technology and engineering company that partners with businesses to build and scale high-impact digital products, platforms, and AI-driven solutions. We work with fast-growing organizations across industries, helping them solve complex technology challenges through strong engineering, product, data, and AI capabilities.
We are looking for a Senior Data Engineer to join Shuru and help design and build scalable, reliable, and high-performance data platforms for complex business environments.
- Build, test, and maintain data pipelines on Azure Databricks for the assigned business line, using PySpark and SQL.
- Implement Bronze, Silver, and Gold layer transformations using Delta Lake, following the platform’s established lakehouse standards.
- Ingest structured and semi-structured data from sources such as MariaDB, Azure Event Hubs, APIs, and file systems.
- Design and build data models (dimensional models, Gold-layer tables) for the business line’s use cases, in line with patterns set by the Lead Data Engineer.
- Flag where a business line’s data model needs a shared, cross-line solution rather than a local one, and raise it to the Lead Data Engineer.
- Implement automated testing, data validation, and pipeline monitoring for everything owned.
- Respond to and troubleshoot pipeline incidents and data quality issues for the assigned business line, escalating where needed.
- Follow the platform’s cataloguing, lineage, and metadata practices so the data produced is discoverable and trustworthy.
- Work directly with the Forward Deployed Data Lead to turn scoped business requirements into build plans and delivery timelines.
- Partner with analysts and, where relevant, data scientists and AI engineers consuming the pipelines built, to make sure outputs meet their needs.
- Participate in code reviews and platform standards discussions led by the Lead Data Engineer.
Requirements
- 5–8 years of experience in data engineering, including hands-on work with cloud data platforms.
- Experience building pipelines on Azure Databricks, Delta Lake, or comparable lakehouse/cloud-native tools.
- Exposure to version control (Git), Agile methodologies, and CI/CD practices.
- Experience in fintech, broking, or trading platforms is a plus, not required.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
Benefits
- Work on challenging, large-scale engineering and data problems.
- Build modern platforms using cutting-edge cloud and data technologies.
- Work closely with experienced engineering, product, and technology leaders.
- Opportunity to take ownership of architecture and key technical decisions.
- Remote-first and collaborative work environment.
- Strong opportunities for learning, leadership, and career growth.
Skills Required
- 5-8 years of experience in data engineering, including hands-on work with cloud data platforms
- Experience building pipelines on Azure Databricks, Delta Lake, or comparable lakehouse or cloud-native tools
- Exposure to version control, including Git
- Exposure to Agile methodologies
- Exposure to CI/CD practices
- Bachelor's degree in Computer Science, Engineering, or a related field
- Experience in fintech, broking, or trading platforms
What We Do
Looking for a self-managed professional team to help take your technology and product strategy to the next level? From leadership consulting to hands-on software delivery, we can support you in many ways. 1. Mobile, Web, Backend Software Development 2. Technology Infrastructure Solutions 3. Technology Scaling Solutions 4. Adopting Emerging Tech like Artificial Intelligence 5. Product & Technology Leadership Our custom software development services specialize in end-to-end product development. With a team of experienced professionals, we can help you navigate the complex world of technology and bring your vision to life. We offer on-demand product leadership and strategic guidance to help your business excel without the full-time commitment of a Chief Product Officer. Our team of experienced product experts works closely with you to understand your unique needs and craft tailored product strategies that align with your business objectives. We provide on-demand technical leadership and expertise to help your business scale and innovate without the full-time commitment of a Chief Technology Officer. As your tech leader, we focus on driving your technology strategy, optimizing your software architecture, and fostering a culture of innovation to propel your business forward. Let us be your go-to resource for all things product and technology. Contact us to learn more about how we can help your business succeed.
