Data Engineer
About the Team:
Capco's Data Team helps our clients transform every aspect of their business. We are highly skilled at formulating data strategy, defining business and technology initiatives across the data management lifecycle, and aligning multi-year strategic roadmaps with client's business goals. As digital technologies advance and regulations tighten, today's consumers - and, therefore, today's businesses - are becoming more aware of the importance of good quality data. We work to establish holistic ways to effectively manage data through the modern data supply chain and facilitate consumption through analytics, modelling, AI, machine learning, dashboarding, and reporting.
About the Job:
As a member of our Data Team, you will work across Capco's different domains and solution offerings to help break down large problems, develop approaches and solutions. As a Data Analyst, you will create analytics reporting and provide data-driven strategic insights, trends, and perspective to help drive transformation for our clients.
What You'll Get to Do:
- Collaborate with and across teams to design, develop, test, implement, and support technical solutions in Microsoft Azure Data Platform
- Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems
- Develop conceptual, logical and physical data models with associated metadata including data lineage and technical data definitions
- Design, develop and maintain ETL workflows and mappings using the appropriate data load techniques
- Provide research, high-level design and estimates for data transformation and data integration from source applications to end-user BI solutions
- Engineer and support robust, scalable, cloud-based data delivery pipelines
- Own the full scope of the assigned projects, including understanding and gathering requirements, designing the solution, and building and delivering completed functionality to production
What You'll Bring with You:
- Bachelor's degree in Computer Science or similar field or equivalent work experience
- 4+ years of experience in a Data Engineering role
- 4+ years of experience with implementing data solutions in cloud-Azure
- Strong development hands on background in creating pipelines, data flows and complex data
- Hands on experience using Apache Airflow, Kafka and REST API (Data as Service)
- Experience with Azure Data Factory in building pipelines
- Experience with Snowflake, SnowSQL, Snowpipe, Javascript UDF & Stored procedures
- Knowledge of Data Ingestion and Engineering Platforms
- Experience with cloud-Azure, including Azure Data Factory, Azure Data Lake Store and other relevant services
- Experience with SQL, Python/Java, and SOAP/REST Web Services
- Experience working in Agile and Extreme Programming methodologies in a continuous deployment environment
- Working knowledge of server configuration/deployment Infrastructure
- Experience using source control and bug tracking systems, writing user stories and technical documentation
Why Capco?
You will join a company that supports and encourages an entrepreneurial outlook and independent thinking. Capco is not about organizational charts and layers - we operate with little hierarchy because we want all employees to feel that Capco is their firm
We offer highly competitive benefits, including medical, dental and vision insurance, a 401(k) plan, tuition reimbursement, and a work culture focused on innovation and creation of lasting value for our customers and employees.
Ready to Take the Next Step?
If this sounds like you, we would love to hear from you. This is an opportunity to make a difference and contribute to a highly successful company with a significant growth trajectory.
