When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.
- Develop Azure Data Factory pipelines using Linked Services and Datasets to extract, transform and load data from multiple sources such as MS SQL, AWS S3, etc, into Azure Data Lake Storage. Work on creating dependencies of activities in Azure Data factory. Transform data in Azure Data Factory with the ADF Transformations. [15%]
- Utilize Databricks notebooks with PySpark to execute data extraction, implement business logic, and execute data cleansing operations, ensuring data integrity and accuracy. [15%]
- Formulate SQL queries, Stored Procedures, User-Defined Functions (UDFs), and Views to perform data transformations aligned with business specifications. [10%]
- Engineer Azure Functions in C# to enable serverless computing for implementing business logic, with a focus on debugging utilizing Insomnia locally, and automation through Azure Data Factory pipelines. [8%]
- Implement Azure DevOps for source code repository, continuous integration and deployment. Support Data Scientists to provide timely releases to users. [10%]
- Innovate performance enhancements by optimizing existing Databricks notebooks leveraging delta lake optimization methodologies. [10%]
- Implement robust alerting mechanisms for pipeline failure detection and institute proactive monitoring solutions. [6%]
- Devise strategies for cost optimization across the data engineering ecosystem, implementing necessary changes to Azure Data Lake Storage to reduce costs for underutilized resources. [6%]
- Drive cluster optimization initiatives to enhance processing efficiency and scalability within Azure Databricks infrastructure. [5%]
- Leverage Power BI for data visualization and reporting, enabling stakeholders to derive actionable insights. [4%]
- Lead initiatives for code refactoring to enhance maintainability, scalability, and performance of data engineering solutions. [5%]
- Conduct regular performance assessments and provide recommendations for infrastructure enhancements to optimize data processing workflows. [3%]
- Stay updated with emerging technologies and industry best practices to drive continuous improvement and innovation within the data engineering domain. [3%]
- In connection with above duties, utilize experience in Azure Data Factory (ADF); Azure Databricks; PySpark; Python; MS SQL; Azure Devops; Azure Data Lake Storage; GIT; Azure Functions; C#; Insomnia; and Power BI.
Telecommuting (work from home) permitted within metropolitan statistical area.
Requires related degree, experience and skills. Position is part of employee referral program.
Salary: $149,781.00 - $168,800.00
---------------------------------------
This position is also incentive eligible.
Vizient has a comprehensive benefits plan! Please view our benefits here:
http://www.vizientinc.com/about-us/careers
Equal Opportunity Employer: Females/Minorities/Veterans/Individuals with Disabilities
The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.
Similar Jobs
What We Do
Vizient, Inc., the nation’s largest health care performance improvement company, serves more than 50% of the nation’s acute care providers, which includes 97% of the nation’s academic medical centers, and more than 20% of ambulatory care providers. Vizient provides expertise, analytics and advisory services, as well as a contract portfolio that represents more than $130 billion in annual purchasing volume.
Vizient is based in Dallas and has offices in 20 metropolitan areas across the United States. We have 4,000 employees with a breadth of expertise, experience and compassion, who are eager to develop and implement solutions that advance health care for the greater good.
