Lead Master Data Management Data Engineer
Full Time
Way of Work: Remote
Salary: $107,000 - $160,500 plus annual bonus
The Lead Master and Reference Data Engineer will be a member of a dynamic team responsible for leading data engineering efforts to create a proprietary Master and Reference Data system. This person will play a crucial role in creating high-quality data models and structures to support downstream analytics, reporting, and applications. Collaborating with Data Governance Activation Team, Business Analyst and Data Scientist, the Lead MDM Data Engineer will understand data needs and will design optimized structures pertaining to Master Data Management. As a recognized subject matter expert, the Lead Data Engineer tackles complex problems with a broad perspective, while also coaching, reviewing, and delegating tasks to less experienced professionals.
Your responsibilities may include, but are not limited to:
-
Collaborate with Data Governance Activation Team, Business Analyst, Data Scientist, and other Business Partners & stakeholders to align data models and programming development with business needs
-
Implement master data management architecture strategy
-
Create data management policies and best practices to support MDM/RDM data structures
-
Development conceptual, logical, and physical data models for the MDM/RDM architecture
-
Coordinate and develop system integration designs for master data/ reference data within projects, including high-level and detailed system, application, and technology diagrams
-
Design & implement effective database solutions and models for storing and retrieving company data
-
Implement complex and efficient SQL queries to insert data along with data manipulation and retrieval
-
Optimize query performance to ensure scalability and efficiency
-
Create, manage and optimize data pipelines to ensure timely and accurate data processing and delivery
-
Troubleshoot data-related issues, identify variances and recommended improvements
-
Identifies Match & Merge rules, develop & configure trust matrix, match path, match rules
You must possess the below minimum qualifications to be initially considered for this position. Preferred qualifications are in addition to the minimum requirements and are considered a plus factor in identifying top candidates.
Minimum Qualifications
-
Bachelor’s degree or equivalent work experience
-
6+ years recent (conceptual, logical, and physical) modeling
-
6+ years building and optimizing big-data pipelines, architectures and data sets.
-
6+ years Python and related big-data engineering technologies such as Spark, Hadoop, Kafka, etc.
-
6+ years utilizing cloud data products in platforms such as AWS, Azure, Databricks, GCP
Preferred Qualifications
-
Experience with both relational SQL and NoSQL databases
-
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
-
Experience with containerization and microservices (e.g., Docker, Kubernetes)
-
Familiarity with Linux and Unix
-
Experience deploying and maintaining code with version control tools
-
Understanding of best practices in Data Warehousing and Data Lake architectureAdvanced SQL skills and experience working across a variety of database technologies
Disclaimer
The preceding description is not designed to be a complete list of all duties and responsibilities required of the position
Inclusion and Diversity
-
Value inclusion within your day-to-day responsibilities by respecting others' perspectives/convictions, engaging others' opinions, creating a safe environment where people, ideas, and opinions are valued within your Team/Customers and external partners.
-
Respect and take into consideration diversity within your Team/Customers and external work partners by valuing different world views, challenges, and cultures that represent all walks of life and all backgrounds.
-
Treat others with respect and consideration. Actively participate in creating and contributing to a positive work environment.
Safety
-
Promote a safe work environment by actively participating in all aspects of our employee safety program.
-
Report any unsafe conditions and take actions to prevent personal injuries.
-
Support our interdependent safety culture by ensuring the safety of your co-workers.
-
Stay focused on the task at hand and promote productivity through good work habits.
#MDM #DataEngineer #Data #BigData #RemoteJobs #NiSource #WomenInTech #NowHiring #OhioMeansJobs #DataEngineer #MDMEngineer #MasterData #DataGoverance
Work Authorization
Authorized to work in the United States without requiring sponsorship.
Inclusion & Diversity
Value inclusion within your day to day responsibilities by respecting others perspectives/convictions, engaging others opinions, creating a safe environment where people, ideas, and opinions are valued within your Team/Customers and external partners.
Respect and take into consideration diversity within your Team/Customers and external work partners by valuing different world views, challenges, and cultures that represent all walks of life and all backgrounds.
Treat others with respect and consideration. Actively participate in creating and contributing to a positive work environment.
Equal Employment Opportunity
NiSource is committed to providing equal employment opportunities in each of its companies to all employees and applicants for employment without regard to race, color, religion, national origin or ancestry, veteran status, disability, gender, age, marital status, sexual orientation, gender identity, sex (including pregnancy, lactation, childbirth or related medical conditions), genetic information, citizenship status, or any protected group status as defined by law. Each employee is expected to abide by this principle.
By applying, you may be considered for other job opportunities.
Safety Statement
Promote a safe work environment by actively participating in all aspects of our employee safety program. Report any unsafe conditions and take actions to prevent personal injuries. Support our interdependent safety culture by ensuring the safety of your co-workers. Stay focused on the task at hand and promote productivity through good work habits.
Salary Range:
$107,000.00 - $160,500.00
Posting Start Date:
2024-09-16
Posting End Date (if applicable):
2024-10-01Please note that the job posting will close on the day before the posting end date.
Top Skills
What We Do
NiSource (NYSE: NI) helps energize the lives of its nearly 4 million natural gas and electric customers across six states. Our local utilities – Columbia Gas and NIPSCO – ensure that customers receive safe, reliable and affordable natural gas and electric service each and every day. Our business plan is focused on proactively investing in our energy infrastructure – approximately $1.4 billion a year – to ensure we meet and improve upon our customer commitments for the next 100 years.
We employ more than 7,000 of our neighbors who are actively engaged in the communities we’re privileged to serve, making them great places to live and call home. NiSource is headquartered in Merrillville, Indiana – about 35 miles from Chicago – and we maintain a significant corporate presence in Columbus, Ohio. Our utility operations also span Kentucky, Maryland, Pennsylvania and Virginia
