QA Engineer - Data Pipelines

Are you curious, excited by experimentation and always looking for a better way of doing things?

Do you want to keep learning and developing whilst getting hands-on, entrepreneurial, business building experience?

Do you want to make your mark in the future of marketing measurement?

If so, we would love to hear from you!

ABOUT US 

At Blenheim Chalcot, we use our knowledge, expertise and infrastructure to sustain an innovation system that transforms disruptive ideas into innovative businesses. We originate the ideas ourselves, grow them from the ground up and take them through to scaling and ultimately exit.

We typically build enterprise Software as a Service (SaaS) products, powered by Generative AI and target industries which are exposed to market, regulatory or technology discontinuities. We have built businesses across the following sectors:

• Financial Services
• Education
• Media and Marketing
• Public Services and Health
• Sports

Our track record has seen us build more than 60 businesses over the last 25 years. The portfolio has annual revenues of £500m, employs more than 3,000 people, has raised £600m in equity, and secured exists totalling over £1bn.

Blenheim Chalcot has three global locations. Portfolio companies are headquartered from Scale Space, London, our 200,000ft2 collaboration space which was built as a joint venture with Imperial College London. Our Mumbai offices provide unparalleled scaling capability and technical expertise, and our U.S. operation powers the go-to-market activities of the portfolio across North America.

This particular role would be situated within Fospha, one of Blenheim Chalcot's portfolio MarTech businesses. 

Fospha is the marketing measurement platform for eCommerce brands. We have found product/market fit in the last two years and quickly become a market leader for measurement with numerous awards and rocket-ship growth to match. We are the only business of our type to be a certified partner of Meta, TikTok and Snap, and have worked with our customers -some of the best-known eCommerce brands in the world to drive massive growth and value. We are now expanding globally and are looking for excellent candidates to join the next phase of our journey. 

The Role

As a QA Engineer specializing in Data and ML, you'll be responsible for guaranteeing the integrity and accuracy of our product's most critical components. Your work will directly impact the effectiveness of our marketing solutions and the trust our clients place in our data. You'll be a key contributor to two primary areas:

Data Engineering QA
You'll own the quality assurance of our data pipelines. While experience with dbt (data build tool) is a plus, it's not mandatory. We do, however, require a strong understanding of SQL to verify data consistency, accuracy, and ensure product outputs remain correct across different releases and new features. We have established robust practices here, and you'll be key in helping us further refine our processes by developing and implementing even more comprehensive automated QA solutions for our data pipelines. During the initial setup and evolution phases, you'll also perform thorough manual QA to identify and address any discrepancies, helping us to strengthen our quality assurance efforts. You'll be a champion for data integrity, identifying and flagging any anomalies or regressions in our data outputs.

ML Engineering QA
You'll be responsible for rigorously testing the outputs of our machine learning models. This involves ensuring that model predictions and behaviors are accurate and align precisely with the expectations and research conducted by our Data Science team. We're looking for someone to help us enhance our existing testing frameworks for ML models, driving greater confidence in our predictive capabilities. You'll also work to validate the performance and accuracy of our ML models against defined metrics and benchmarks.

Key Responsibilities:

• Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models.
• Implement and maintain automated testing frameworks for data and ML quality assurance, helping us advance our automation efforts.
• Perform thorough manual testing during initial development and complex feature releases, ensuring we maintain a high standard of quality.
• Collaborate closely with Data Engineers, Data Scientists, and Product Managers to gain a deep understanding of features under development, including technical implementation details, to inform effective testing strategies.
• Proactively identify, document, and track bugs and quality issues.
• Communicate and justify changes in data to wider audiences, including non-technical stakeholders, clearly and concisely.
• Contribute to the continuous improvement of our QA processes and methodologies, actively seeking ways to optimize our approach.
• Participate in code reviews and provide constructive feedback from a QA perspective.
• Advocate for quality throughout the software development lifecycle, helping us deepen our commitment to quality.

Skills & Experience:
Essential:

• 4+ years of experience in Quality Assurance, with a strong focus on data-centric products.
• Strong proficiency in SQL is a must.
• Proficiency in Python is essential for test automation and data manipulation.
• Solid understanding of data warehousing concepts.
• Familiarity with machine learning concepts and methodologies.
• Strong analytical and problem-solving skills with a keen eye for detail.
• Excellent communication skills, both written and verbal, with the ability to explain complex technical concepts to diverse audiences.
• Ability to work collaboratively within cross-functional teams (Engineering, Product, Data Science).
• Proactive and self-motivated with a strong sense of ownership.

Desirable:

• Experience in testing data pipelines built with dbt (data build tool).
• A good understanding of PostgreSQL or other relational databases.
• Familiarity with cloud platforms (e.g., AWS, GCP, Azure).
• Experience with version control systems (e.g., Git).
• Understanding of agile development methodologies.
• Previous experience in a marketing technology or ad-tech company.

Benefits & Perks [London]

• Be part of a leading global venture builder, Blenheim Chalcot and learn from the incredible talent in BC
• Be exposed to the right mix of challenges and learning and development opportunities
• Flexible Benefits including Private Medical and Dental, Gym Subsidiaries, Life Assurance, Pension scheme etc
• 25 days of paid holiday + your birthday off! One day extra after 3 years
• Free snacks in the office
• Quarterly team socials

Working location

The Fospha UK team is based at the Scale Space tech campus in West London - where you can partake in a full social calendar of community events & classes.