Azure Sr. Data Engineer

Sr. Data Engineer

Level: Senior
Department: Azure
Location: Anywhere in US or Canada (fully remote)
Type: FTE
 

GENERAL DESCRIPTION & RESPONSIBILITIES 

The Sr. Azure Data Engineer will lead the creation of high-value data driven solutions leveraging Cyclotron’s proven implementation methodology and solutions for enterprise projects, as well as contributing to technical pre-sales activities as required. You will be responsible for designing solution architecture, requirement definition, and leading the project delivery team. You will have the opportunity to work with and learn the latest cloud solutions in an exciting work environment. This position will work collaboratively across all Cyclotron’s sales, service delivery and project management organizations in service to Cyclotron’s clients.

The ideal candidate will have extensive Microsoft Fabric, Azure Intelligent Data Stack, and Databricks experience. Proficiency with the Databricks platform, implementing enterprise Data Lakehouse will be required. Candidates will be expected to contribute to all stages of the data lifecycle including data ingestion, data modeling, data profiling, data quality, data transformation, data movement, and data curation.

Candidate should be familiar with the market challenges in multiple industry verticals and have experience with both traditional and modern across the Microsoft technology stack.

• Strong collaboration skills, embraces change, works well with ambiguity, shifts easily across roles and groups.

• Ability and willingness to take the initiative to serve the client needs first. 

• Ability to engage directly with the client stakeholder, managers, and end users. 

• Ability to interface with clients up to the C-suite, down to the line worker.

• Ability to design and implement Advanced Analytics solutions based on customer needs and knowledge of Microsoft Cloud and related Open-Source (Apache) technologies 

• Ability to triage and self-direct, prioritize and manage time effectively. 

• Ability to collaborate with other members of the Cyclotron team, including Project Managers, Software Engineers, and Business Analysts. 

PLACEMENT CRITERIA & REQUIREMENTS 

• Focus on Azure data engineering solutions
• 8+ years data engineering delivery experience 
• 3+ years of Databricks engineering development experience 
• Microsoft Fabric development experience
• 2+ years technical team leadership or technical management experience 
• 2+ years Microsoft Purview experience
• Current Azure and/or Databricks certifications 

TECHNICAL SKILLS REQUIRED 

General Architecture 

• Designing large-scale modern data platform solutions 

• Being able to interpret business requirements into functional and then technical requirements 

• Design, develop and maintain data pipelines using Databricks, Fabric, and Azure Data tools. 

• Experience solutioning Azure Cloud based enterprise data architectures. 

• Experience with data engineering pipeline automation

Information Architecture 

• Data Modeling principles for relational and dimensional data structures 

• Data Warehouse design principles 

• Data Lake design principles, Data Virtualization 

• Hybrid enterprise data architecture 

Strong knowledge of data lakehouse and medallion architecture concepts and T-SQL relational/non-relational databases for data access and Advanced Analytics 

• Experience with following languages: Python, SQL, DAX, M, Spark

• Experience with reporting and data visualization tools, specifically PowerBI

• Practical knowledge of Microsoft SQL Server, Azure SQL Server, Microsoft Fabric

• Experience in Synapse Analytics, CI/CD

Microsoft Azure Stack 

• RDBMS: Azure SQL / SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning) 

• ETL/ELT, (ADF, SSIS) 

• Data governance – (Purview, Unity Catalogue) 

• Microsoft Fabric, Synapse Analytics, Spark Engine Optimization

• Databricks Delta Lake Storage 

• Azure Dev OPS 

DESIRED SKILLS 

Advanced Analytics Data Technologies 

• Databricks, Delta Lake, Synapse 

• Spark SQL, Pyspark 

• Azure Data Explorer 

• Logic Apps, Key Vault 

• Semi structured data processing

• Integration Runtime 

• Coding experience: Python, C#, Java for Data analysis purpose 

• One of the following certifications: Microsoft Certified - Data Analyst Associate, MCSA - BI Reporting

• Knowledge of some of the main components of Azure Analytics: Azure Data Processing Technologies (DataFactory, Databricks), Azure Big Data Technologies, Databricks, Synapse 

Information Architecture 

• Data Stewardship, Ownership and Quality Management principles 

• Data Governance, Data Catalog, Enterprise Information Management 

NON-TECHNICAL SKILLS 

Business Engagement 

• Demonstrated Experience 

• Providing thought leadership and business strategy acumen around advanced analytics and business information lifecycle 

• Leading customers through a value-based decision-making cycle 

• Developing functional, non-functional and technical requirements based on business imperatives 

• Presenting to customer executive teams with authority and purpose 

Project and Team Delivery Leadership 

• Demonstrated Experience 

• Directing business analysts and developers in the execution of project tasks 

• Leading consultants in various project work streams

• Estimating, planning and executing advanced analytics solutions 

• Managing geographically distributed project teams 

CYCLOTRON EXPECTATIONS 

These are the traits that we hold in the same regard for all employees, also viewed as performance indicators. Each employee should uphold these attributes.

• Communication and Interpersonal Skills – verbal and written, professional, concise, and effective. 

• Collaboration and Teamwork - share knowledge, build alliances, show respect. 

• Personal Ownership and Responsibility – take initiative, solve problems, be fully present. 

• Customer Focus – Proactive management or Client expectations and needs. 

• Time Management and Productivity – Set Goals, Commit, Record, Communicate 

Cyclotron is an equal opportunity employer; we encourage diversity and promote an inclusive environment where everyone feels respected and valued. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, gender expression, age, marital status, religion, national origin, veteran, or disability status. We would love to learn about what you can add to our diverse team.