DevOps Engineer

About Fusemachines

Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from underserved communities. With a robust presence in four countries and a dedicated team of over 400 full-time employees, we are committed to fostering AI transformation journeys for businesses worldwide. At Fusemachines, we not only bridge the gap between AI advancement and its global impact but also strive to deliver the most advanced technology solutions to the world. 

We are seeking a highly skilled Senior Data Platform / DevOps Engineer to play a crucial role in transforming the organization into a data-driven entity. This role involves designing, building, and maintaining a robust, scalable, and secure cloud-based data and analytics platform. The focus will be on implementing best practices, automating infrastructure, and establishing continuous integration/continuous delivery (CI/CD) pipelines across multiple environments.

• Cloud Infrastructure & Architecture:

  • Design, provision, and configure cloud infrastructure within the Azure tenant using "Infrastructure as Code" (IaC) principles to ensure automation, consistency, and scalability.

  • Conduct thorough reviews of current cloud implementation and design a future-proof architecture for the Data and Analytics platform.

  • Define and implement standardized naming conventions and specific cloud setup configurations for an organized and manageable environment.

• Security and Access Management:

  • Configure and implement robust Identity and Access Management (IAM) and User Access Management (UAM) to ensure secure and controlled access to all data and analytics resources.

• Environment Setup and CI/CD:

  • Establish and configure distinct environments (Development, Testing, Staging, Production) to support a strong CI/CD process and speed up release cycles.

  • Configure and optimize underlying data storage components, such as Data Lake Storage and Data Governance tools (e.g., Unity Catalog configuration), to support the Medallion architecture.

  • Integrate and configure Software Development Life Cycle (SDLC) tools (e.g., source code management, CI/CD pipelines) to manage code repositories and automated deployments.

  • Implement and maintain CI/CD pipelines to automate the deployment of infrastructure, data pipelines, data models, and BI reports across environments.

• Testing Infrastructure:

  • Provide and maintain the necessary infrastructure to facilitate comprehensive testing, including Unit Testing, Regression Testing, System Integration Testing, and User Acceptance Testing (UAT).

• Foundational Stability: Establish a robust, future-proof, and scalable data and analytics platform.

• Documentation Completeness: Deliver comprehensive documentation of the architecture, data flows, governance policies, environment configurations, and IAM/UAM setup.

• Operational Multi-Environment Setup: Fully operational and properly configured development, testing, staging, and production environments are in place, supporting strong CI/CD.

• Access Control: Ensure data security system controls are effectively implemented, including robust UAM and IAM.

• 5+ years of experience in cloud infrastructure provisioning and configuration, ideally with Azure (Databricks, Data Lake Storage, Key Vault).

• Expertise in Infrastructure as Code (IaC) tools and practices.

• Strong experience designing and implementing CI/CD pipelines using tools like Azure Pipelines or GitHub Actions.

• Deep understanding of data storage concepts and data governance, particularly the Medallion architecture.

• Familiarity with setting up and configuring data platforms for multiple Software Development Lifecycle (SDLC) stages.