SUMMARY
As a Data Engineer for our Digital Services division, you will drive the evolution of our next generation data infrastructure, which powers a wide range of analytics and software products. You will be responsible for designing, developing, and maintaining advanced data pipelines using the latest technologies in cloud computing and data processing. In this pivotal role, you will collaborate with cross-functional teams including data scientists, software engineers, and business analysts. You will use your excellent soft skills to interface with non-technical stakeholders and ensure that their needs are met in the form of functional and non-functional requirements.
RESPONSIBILITIES:
- Design, build, and maintain our data infrastructure to support analytics and integration into software products and services.
- Partner with data scientists to build processing pipelines that enable them to rapidly create high-quality machine learning models.
- Work with software engineers to develop and maintain pipelines to feed data to our growing software portfolio.
- Manage ETL/ELT processes as code and foster a codebase that is extensible and maintainable by all team members.
- Manage the transition from quick prototype to full scalable solution that supports production products.
- Identify, recommend, and implement innovative approaches and technologies that will evolve our existing processes
- Provide ad hoc support to the engineering team, including POC software development, ML model development, and data analysis, as project needs arise.
Qualifications
Education and experience requirement
- BS/MS Degree in Computer Science, Engineering, Data Analytics, or related field.
- 3+ years’ experience in data engineering, ETL development, or similar role.
- Strong problem-solving skills to discover, address, and resolve issues.
- Demonstrated ability to translate technical concepts into actionable insights for different stakeholders.
Language and technical skills requirement
- Proficient in programming languages such as Python and SQL and development tools such as Git.
- Experience with cloud platforms such as Azure, AWS, or GCP for deploying and managing data infrastructure.
- Skilled with rational database schema design.
- Hands-on experience with data processing tools and platforms such as Snowflake, Azure Synapse, Azure Data Factory, Data Bricks, etc.
- Solid understanding of machine learning models, tools, libraries, and approaches.
- Experience with business intelligence tools such as Power BI, Spotfire, Cognos, Tableau, Qlik.
Physical demands and work environment
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
- Work is usually performed in an office environment with normal noise levels. Involves prolonged sitting and computer usage.
- Work may involve limited travel.
Equal Opportunity Employer
This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.
Skills Required
- BS/MS Degree in Computer Science, Engineering, Data Analytics, or related field.
- 3+ years experience in data engineering, ETL development, or similar role.
- Proficient in Python
- Proficient in SQL
- Experience with Git (version control)
- Experience with cloud platforms (Azure, AWS, or GCP)
- Experience designing relational database schemas
- Hands-on experience with Snowflake
- Hands-on experience with Azure Synapse
- Hands-on experience with Azure Data Factory
- Hands-on experience with Databricks
- Experience building and managing ETL/ELT processes as code
- Solid understanding of machine learning models, tools, and libraries
- Experience with business intelligence tools (Power BI, Spotfire, Cognos, Tableau, Qlik)
- Strong problem-solving skills and ability to translate technical concepts for non-technical stakeholders
What We Do
Armada creates innovative, fully integrated supply chain solutions that improve business performance for our clients, enabling them to best serve their customers. We deliver supply chain solutions with extraordinary Service, powered by Technology, driven by Analytics, operating at Scale. We are revolutionizing the way supply chains are managed by creating resilient and agile networks to manage the challenges of today’s market. Armada believes there’s a better way – a better way rooted in transparency, advocacy, and ingenuity.
