The Role
Seeking a Data Engineer II to design database systems and implement solutions using Microsoft SQL Server, Databricks, and Azure technologies, while mentoring junior engineers.
Summary Generated by Built In
Valorem Reply is looking for a Data Engineer with experience building and contributing to the design of database systems, both normalized transactional systems and dimensional reporting systems. Strong experience with SQL Server as a database engine, as well as Microsoft and Databricks technology experience implementing Big Data with Advanced Analytics solutions. Successful candidates will have experience and skill in providing solutions for storing, retrieving, transforming and aggregating data to support line of business applications as well as reporting systems. The Data Engineer will work with customers to deliver solutions utilizing strong business, technical and data modelling skills. This position will represent Valorem's approach to data visualization and information delivery solutions and as such must demonstrate proficiency with Power BI and Azure Data Services.
Key Responsibilities
- Design and implement general architecture for complex data systems.
- Translate business requirements into functional and technical specifications.
- Design and implement lakehouse architecture.
- Develop and manage cloud-based data architecture and reporting solutions.
- Apply data modelling principles for relational and dimensional data structures.
- Design Data Warehouses following established principles (e.g.,Kimball, Inmon).
- Create and manage source-to-target mappings for ETL/ELT processes.
- Mentor junior engineers and contribute to architectural decisions and code reviews.
Minimum Qualifications
- Bachelor’s degree in computer science, Computer Engineering, MIS, or related field.
- 5+years of experience with Microsoft SQL Server and strong proficiency in T- SQL, SQL performance tuning (Indexing, Structure, Query Optimization).
- 5+years of experience in Microsoft data platform development and implementation.
- 5+years of experience with PowerBI or other competitive technologies.
- 3+years of experience in consulting, with a focus on analytics and data solutions.
- 2+ years of experience with Databricks, including Unity Catalog, Databricks SQL, Workflows, and Delta Sharing.
- Proficiency in Python and Apache Spark.
- Develop and manage Databricks notebooks for data transformation, exploration, and model deployment.
- Expertise in Microsoft Azure services, including Azure SQL, Azure Data Factory (ADF), Azure Data Warehouse (Synapse Analytics), Azure Data Lake, and Stream Analytics
Preferred Qualifications
- Experience with Microsoft Fabric.
- Familiarity with CI/CD pipelines and infrastructure-as-code tools like Terraform or Azure Resource Manager (ARM).
- Knowledge of taxonomies, metadata management, and masterdata management.
- Familiarity with data stewardship, ownership, and data quality management.
- Expertise in Big Data technologies and tools:
o BigData Platforms: HDFS, MapReduce, Pig, Hive.
o General DBMS experience with Oracle, DB2, MySQL, etc.
o No SQL databases such as HBase, Cassandra, DataStax, MongoDB, CouchDB, etc.
o Experience with non-Microsoft reporting and BI tools, such as Qlik, Cognos, MicroStrategy, Tableau, etc.
About Reply
Reply specializes in the design and implementation of solutions based on new communication channels and digital media. Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things. Reply services include Consulting, System Integration and Digital Services. www.reply.com
Top Skills
Spark
Azure Data Factory
Azure Data Lake
Azure Data Warehouse
Azure Sql
Databricks
Hdfs
Hive
Mapreduce
Azure
Pig
Power BI
Python
SQL Server
Stream Analytics
T-Sql
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Reply [EXM, STAR: REY] specialises in the design and implementation of solutions based on new communication channels and digital media. As a network of highly specialised companies, Reply defines and develops business models enabled by the new models of AI, big data, cloud computing, digital media and the internet of things. Reply delivers consulting, system integration and digital services to organisations across the telecom and media; industry and services; banking and insurance; and public sectors.
