Sr Data Engineer
Full-time | Commack, NY | Hybrid
Position Overview:
Our client, a global haircare company, is seeking a highly skilled and motivated Sr Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other point-of-sale data sources. This role is pivotal in owning the ETL processes, developing Power BI dashboards, and supporting our data analysts in report and dashboard creation. The ideal candidate will be adept at developing architecture such as databases and large-scale processing systems and aligning data projects with organizational goals. This position is also responsible for guiding and managing the third-party resources contracted for data analytics projects.
Essential Job Duties & Responsibilities:
- Design, construct, test, and maintain robust data architectures to align with business requirements.
- Build and manage API’s for data extraction and transformation.
- Develop and optimize ETL processes for efficient data extraction, transformation, and loading from various sources.
- Develop data extracts to feed data warehouse data to other internal and/or external systems.
- Create and manage Power BI dashboards and reports, providing actionable insights to business stakeholders.
- Assist data analysts in the development of reports and dashboards, ensuring data accuracy and relevance.
- Maintain and improve SQL, Power BI, Cognos, and other data engineering tools and practices.
- Collaborate with various departments to understand data needs and provide technical solutions that align with business objectives.
- Ensure data integrity and security, adhering to data governance and compliance standards.
- Continuously evaluate and recommend improvements to existing data systems and processes.
- Conduct research for industry and business questions using large data sets.
- Recommend ways to improve data reliability, efficiency, and quality.
- Deliver Data Analytics using AI.
Required Skills/Qualifications:
- Bachelor’s degree in Computer Science, IT, or related field
- Proven experience in data engineering, especially in a manufacturing/distribution environment.
- Extensive experience in data collection and standardizing database schema to accommodate bespoke data sources
- Proficiency in SQL, JSON, XML. Power BI, Cognos, Python, and other relevant tools.
- Strong understanding of ETL processes and tools (like Fivtran, SSIS, Azure Data Factory Pipelines).
- Experience Building/managing API.
- Experience with data warehouse design and management.
- Experience Building Database Objects (Design and create schemas, tables, views, and indexes)
- Experience Writing Code (complex stored procedures, functions, and triggers)
- Experience Optimizing Performance (Query Optimization, Execution Plans, Index Management)
- Experience with Analysis Services, multi-dimensional databases, parent child dimensions, alternate hierarchies, OLAP/ROLAP cubes.
- Experience deploying database on SQL server with role-based access control (RBAC) for admins and users.
- Prefer experience with Microsoft Fabric, Azure Data Factory, Data Lake)
- Prefer Experience configuring MCP Servers connecting data models to LLMs
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment and communicate effectively with non-technical stakeholders
Benefits
Medical insurance, Vision insurance, Dental insurance, 401(k)
Skills Required
- Bachelor’s degree in Computer Science, Information Technology, or a related field
- Proven data engineering experience, preferably in a manufacturing or distribution environment
- Experience collecting data and standardizing database schemas for bespoke data sources
- Proficiency in SQL, JSON, XML, Power BI, Cognos, and Python
- Strong understanding of ETL processes and tools such as Fivetran, SSIS, and Azure Data Factory Pipelines
- Experience building and managing APIs
- Experience designing and managing data warehouses
- Experience designing database schemas, tables, views, and indexes
- Experience writing complex stored procedures, functions, and triggers
- Experience with query optimization, execution plans, and index management
- Experience with Analysis Services, multidimensional databases, parent-child dimensions, alternate hierarchies, and OLAP or ROLAP cubes
- Experience deploying databases on SQL Server with role-based access control for administrators and users
- Experience with Microsoft Fabric, Azure Data Factory, and Azure Data Lake
- Experience configuring MCP Servers to connect data models to large language models
- Excellent problem-solving skills and attention to detail
- Ability to collaborate effectively and communicate with nontechnical stakeholders
What We Do
SoHo Dragon is a full-service Software Application Development company that focuses on portals, document management, collaboration, business intelligence, CRM tools, cloud technology, and data. Much of the work done for our clients are based in the Microsoft Application stack of business tools. In addition to providing our clients with project-based services, SoHo Dragon Solutions also provides staff augmentation and direct placement services.
