The Role
Designs and develops scalable data pipelines, ETL architectures, data warehouses, and Power BI semantic models and dashboards. Translates business requirements into Azure-based data solutions, integrates legacy and modern systems, writes complex SQL and T-SQL, and supports batch processing. The role also documents architectures, monitors and optimizes data infrastructure, troubleshoots BI solutions, participates in code and design reviews, and contributes to modernization and strategic data initiatives.
Summary Generated by Built In
We are looking for a Data Engineer to join our team. They will be responsible for creating scalable data solutions to support data-intensive applications and analytics. This includes not only the technical development of data pipelines and reports but also overseeing data engineering projects and contributing to the strategic direction of data initiatives within the organization.
RequirementsTechnical Solution Development
- Translate business requirements into technical data solutions.
- Participate in and contribute to architectural forums within the Business Intelligence (BI) team.
- Design and implement ETL/data pipeline architectures using tools like ADF (Azure data factory).
- Automate processes and design system architectures.
- Develop and manage Power BI semantic models, including understanding DAX queries and cubes.
- Visualization and Dash boarding: translate metrics into visual Power BI reports
- Integrate data between legacy and modern systems.
- Create ad-hoc SQL scripts to support user queries.
- Deploy and manage data solutions on cloud platforms like Azure.
- Understanding of Data Warehouse modeling and Techniques: Data schemas, Facts, dimensions and building data warehouses.
- Writing complex SQL queries, joins, views and stored procedures to extract and manipulate data.
- Apply knowledge and practical experience in the Data Warehouse Life Cycle.
- Perform data modeling including dimensional, multi-dimensional, and relational models.
- Utilize TSQL for database management and querying.
- Support batch processing and scheduling tasks.
- Create and maintain technical documentation such as data architecture diagrams, ETL workflows, and system documentation to ensure maintainability.
- Participate in design, peer, and code reviews.
- Provide daily technical, functional, and operational support for existing BI solutions.
- Monitor data pipeline and infrastructure performance.
- Identify bottlenecks and optimize for scalability, reliability, and cost-efficiency.
- Troubleshoot and resolve data-related issues.
- Contribute to evolving the architecture towards modern platforms, whether on-premise or cloud-based.
- Maintain working knowledge of Power BI reporting.
- Ensure technical skills stay relevant to emerging industry trends and organizational strategies, including Azure Cloud Solutions and Artificial Intelligence initiatives.
Desired Experience & Qualification
Qualifications:
- Matric essential
- Degree in Computer Science / Engineering / Mathematics or related discipline (could be replaced with 10+ years relevant experience)
- 4-5 years total experience (some experience may be replaced by post graduate qualifications if the practical component was relevant)
Desired Experience:
Data Engineering
- Data pipeline architecture and development
- ETL architecture and implementation
- Azure Data Factory (ADF)
- Process automation
- Integration between legacy and modern systems
- Batch processing and scheduling
- Data Warehouse lifecycle
SQL / Database Technologies
- Advanced/complex SQL
- T-SQL
- SQL joins
- Views
- Stored procedures
- Database querying and management
- Ad-hoc SQL scripting
Data Warehousing & Data Modeling
- Data Warehouse modelling techniques
- Data schemas
- Facts and dimensions
- Data Warehouse construction
- Dimensional modelling
- Multi-dimensional modelling
- Relational modelling
Power BI / Business Intelligence
- Power BI reporting
- Power BI semantic models
- DAX queries
- Cubes
- Power BI visualization and dashboard development
- Translating business metrics into visual reports
Cloud / Azure
- Deploying data solutions on Azure
- Managing cloud-based data solutions
- Azure Cloud Solutions
- Understanding the evolution from on-premise to modern/cloud-based architectures
Architecture
- Data/system architecture
- Designing scalable data solutions
- Architectural forums within a BI environment
- Modernising architecture
- Architecture diagrams and technical documentation
Benefits
Hybrid working option
Skills Required
- Matric qualification
- Degree in Computer Science, Engineering, Mathematics, or a related discipline, or 10+ years of relevant experience
- 4-5 years of total professional experience
- Experience designing and developing data pipelines and ETL architectures
- Experience with Azure Data Factory
- Experience with process automation, batch processing, and scheduling
- Advanced or complex SQL and T-SQL experience
- Experience with SQL joins, views, stored procedures, database querying, and management
- Experience with data warehouse lifecycle and construction
- Experience with dimensional, multi-dimensional, and relational data modeling
- Experience developing Power BI reports, dashboards, and visualizations
- Experience with Power BI semantic models, DAX queries, and cubes
- Experience deploying and managing data solutions on Azure
- Knowledge of data and system architecture, scalable solutions, and architecture documentation
- Experience integrating legacy and modern systems
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
DLK Group is a 100% black-owned and managed company, with our roots in Cape Town, and projects managed throughout South Africa. Our track record of operational excellence and innovation over 2 decades has made us trusted advisors to our clients. We provide the people, expertise, support, and training required to implement complex IT infrastructure, enterprise architecture and ERP solutions. We partner with our clients to build successful organisations, underpinned by robust technology.
