Principal Data Engineer - QuantumBlack
Who You'll Work With
You will be part of our global data engineering community. You will work in cross-functional Agile project teams alongside data scientists, machine learning engineers, other data engineers, project managers, and industry experts. You will work hand-in-hand with our clients, from data owners, users, and fellow engineers to C-level executives
Who you are
You are a highly collaborative individual who wants to solve problems that drive business value. You have a strong sense of ownership and enjoy hands-on technical work. Our values resonate with yours.
What You'll Do
As a Principal Data Engineer, you will:
- Lead several technical teams concurrently and work with our clients, data owners and users to C-level executives to understand their needs and architect impactful analytics solutions
- Provide inspirational apprenticeship and mentorship to junior colleagues
- Communicate progress and engineering complexity to stakeholders across all levels of seniority
- Design and build data pipelines for machine learning that are robust, modular, scalable, deployable, reproducible, and versioned
- Own the technology stack, architecting and building enterprise data and AI platforms while ensuring information security standards are maintained at all times
- Lead and contribute to R&D projects, internal asset development and the QuantumBlack Data Engineering community
Our tech stack:
While we advocate for using the right tech for the right task, we often leverage the following technologies: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, our own open-source data pipelining framework called Kedro, Dask/RAPIDS, container technologies such as Docker and Kubernetes, cloud solutions such as AWS, GCP, and Azure, and more!
What you'll benefit from:
- Real-World Impact- No project is ever the same, we work with top-tier clients across multiple sectors, providing unique learning and development opportunities internationally.
- Fusing Tech & Leadership- We work with the latest technologies and methodologies and offer first-class learning programs at all levels.
- Multidisciplinary Teamwork- Our teams include data scientists, engineers, project managers, UX and visual designers who work collaboratively to enhance performance.
- Innovative Work Culture- Creativity, insight, and passion come from being balanced. We cultivate a modern work environment through an emphasis on wellness, insightful talks, and training sessions.
- Striving for Diversity- With colleagues from over 40 nationalities, we recognize the benefits of working with people from all walks of life.
- Continuous development and progression- We offer an extensive choice of training sessions, ranging from workshops to international conferences, tailored to your needs as well as a personal mentorship system. We have multiple career paths and geographic locations to evolve within the Firm.
- Global community- you'll learn from colleagues around the world by connecting both internally and externally through our various hosted meet-ups.
Visit our Careers site to watch our video and read about our interview processes and benefits.
Qualifications
- Ability to scope projects and define workstreams with clear milestones and deliverables
- Experience translating roadmaps to sprint goals while working in an agile and iterative team set-up to adjust to changes in scope and objectives
- Proven experience architecting and building enterprise data and AI platforms as well as scalable data pipelines for advanced analytics use cases operating in production
- Passion for and track record of effectively leading and mentoring more junior colleagues
- Expertise in implementing software engineering concepts and best practices to drive enterprise-wide improvement, inc. DevOps, DataOps and MLOps.
- Ability to write clean, maintainable, scalable and robust code in an object-oriented language, e.g., Python, Scala, Java, as well as experience helping junior colleagues grow their coding skillset through collaborative code reviews
- Expertise in distributed computing frameworks (e.g. Spark, Dask), cloud platforms (e.g. AWS, Azure, GCP), containerization, and analytics libraries (e.g. pandas, numpy, matplotlib)
- Extensive commercial client-facing or senior stakeholder management experience
- Willingness to travel
- Degree in Computer Science, Engineering, Mathematics (Master's or Bachelor), or equivalent experience