Director, Experimentation, Decision Science

Posted 2 Days Ago
Be an Early Applicant
Raleigh, NC, USA
Hybrid
114K-145K Annually
Senior level
AdTech • Agency • Artificial Intelligence • Digital Media • Information Technology • Marketing Tech • Analytics
Uniting people and brands for healthier, happier lives!
The Role
Leads client experimentation and personalization programs across web, mobile, and media channels. Designs testing roadmaps, hypotheses, KPIs, audiences, and statistical parameters; oversees test execution, quality assurance, monitoring, and analysis. Translates results into executive recommendations, ROI projections, and strategic action plans. Advises clients on experimentation maturity, governance, prioritization, and best practices while training internal and client teams. Manages stakeholder relationships, concurrent roadmaps, and opportunities for account growth.
Summary Generated by Built In

At MERGE, we are Built Different. We are a marketing and technology agency purpose-built for the intersection of health and wellness—where human impact matters most. By weaving storytelling through technology, we move beyond traditional engagement to Whole Human Marketing. This approach recognizes that humans are multidimensional and complex, and uses AI to ensure every brand interaction feels natural, contextual, and relevant.

This commitment to human-first innovation is what brings us together and propels us forward. We are united by our North Star: to unite people and brands to empower healthier, happier lives.

Emerge to the Top of Your Career

At MERGE, we strive to create a superior work experience where talented and ambitious people grow. An experience that encourages people to think higher and feel deeper. An experience where people engage their minds and hearts to do the best work of their careers.

As our Director, Experimentation, Decision Science, you will…

Play a pivotal role on our consulting team, working directly with clients to design, manage, and scale high-impact experimentation and personalization programs. Serving as a trusted advisor across web, digital, and media channels, you will consult on scaling client experimentation programs and drive hands-on program execution. In this role, you will mature client testing capabilities, maximize ROI, and unlock deeper customer insights to drive business growth.

What You’ll Do

  • Design comprehensive cross-channel experimentation roadmaps and learning agendas aligned with client business goals across web, app, and paid/owned media channels
  • Formulate data-driven hypotheses, determine experiment feasibility, and define primary/secondary KPIs, target audiences, and statistical parameters (sample size, experiment duration, confidence intervals)
  • Drive audience segmentation and personalization strategies to deliver tailored user experiences across key digital touchpoints
  • Oversee and facilitate the complete experimentation workflow—from ideation, targeting setup, and variant build specs to post-launch quality assurance
  • Collaborate closely with engineering, analytics, UX/UI, and media teams to validate tag implementation, audience integration, and parameter tracking prior to test launches.
  • Translate multivariate, A/B, and personalization experiment results and insights, into compelling, executive-ready stories and strategic next steps
  • Work with analysts to communicate program value through performance measurement and insights Act as a strategic consultant to assess client experimentation programs, benchmark maturity against industry standards, and deliver action plans to elevate client capabilities
  • Advise and support clients on maturing their experimentation programs focusing on establishing and/or optimizing experimentation execution processes, governance, documentation, intakes, experimentation methodologies and frameworks and test prioritization.
  • Upskill client and internal agency teams on experimentation best practices, statistical literacy, and testing tool capabilities
  • Cross-pollinate winning experiment concepts across different media formats, site sections, and client portfolios to maximize output efficiency
  • Assist with RFPs, contract renewals, client upsells, and identifying new strategic service opportunities

What You’ll Bring

  • Bachelor’s degree in Marketing, Business, Statistics, Psychology, Human Factors, or equivalent practical experience. 
  • 5+ years of web, digital or media experimentation experience
  • Direct experience running A/B, multivariate, and personalization experimentation programs across web, mobile, or digital media platforms.
  • Proven track record of managing external client relationships, presenting to key stakeholders, and navigating matrixed organizations.
  • Demonstrated history of partnering closely with engineering, UX/UI, analytics, and product teams to execute technical projects. 
  • Ability to manage multiple client accounts and concurrent test roadmaps independently under tight deadlines
  • Hands-on experience with Adobe Target. Experience with other experimentation and personalization platforms, a plus
  • Ability to evaluate client testing maturity, build strategic roadmaps, align testing initiatives with business goals
  • Exemplary written and verbal communication skills to translate complex data into concise, digestible, and executive-ready recommendations
  • Ability to form partnerships with various client-side and agency-side stakeholders 
  • A self-starter mindset with strong problem-solving skills, high attention to detail, and a desire to continuously learn and share industry trends
  • Travel up to 30% (ability and need to travel depends on client needs)

#LI-NT1

#LI-HYBRID

At MERGE, we’re committed to fostering an environment where our team members can thrive in both their careers and personal lives, ensuring they feel supported and empowered to succeed.

MERGE believes in transparency and equity. In accordance with state regulations, we’re proud to include salary ranges in our job postings to ensure fair compensation practices.

The salary range for this role is $114,400 - $145,000, based on the individual’s skills, experience, qualifications, location, and other relevant factors. The salary pay range is subject to change and may be modified at any time.  

MERGE is proud to invest in benefits that include meaningful Medical, Dental, Vision, Life Insurance, 401K, Lifestyle Spending Account, Employer Paid Life & Disability Insurance, Flexible Time off & Holidays plus many other benefits and rewards.

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.

And here’s how we live our values at MERGE

  • Ability. Mastering our craft
  • Agility. Delivering with a growth mindset
  • Humility. Collaborating for shared success

MERGE is proud to be an Equal Opportunity Employer

MERGE welcomes and celebrates diversity regardless of race, religion, color, national origin, gender, sexual orientation, veteran status or people with abilities. We believe that the more diverse we are, the more creative our work will be!

Skills Required

  • Bachelor’s degree in Marketing, Business, Statistics, Psychology, Human Factors, or equivalent practical experience
  • 5+ years of web, digital, or media experimentation experience
  • Direct experience running A/B, multivariate, and personalization experimentation programs across web, mobile, or digital media platforms
  • Experience managing external client relationships and presenting to key stakeholders
  • Experience navigating matrixed organizations
  • Experience partnering with engineering, UX/UI, analytics, and product teams on technical projects
  • Ability to manage multiple client accounts and concurrent test roadmaps independently under tight deadlines
  • Hands-on experience with Adobe Target
  • Experience with other experimentation and personalization platforms
  • Practical knowledge of site optimization, multivariate testing, A/B testing, and user segmentation or personalization
  • Foundational knowledge of statistical concepts relevant to testing
  • Ability to benchmark testing maturity, build strategic roadmaps, and align testing initiatives with business goals
  • Ability to assist with RFPs, contract renewals, client upsells, and new strategic service opportunities
  • Strong organizational ability to manage concurrent testing projects and establish governance, intake, and prioritization processes
  • Excellent written and verbal communication skills for translating complex data into executive-ready recommendations
  • Ability to form partnerships with client-side and agency-side stakeholders
  • Self-starter mindset, strong problem-solving skills, attention to detail, and commitment to continuous learning
  • Ability and willingness to travel up to 30% based on client needs

MERGE Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about MERGE and has not been reviewed or approved by MERGE.

  • Healthcare Strength Core medical, dental, vision, mental‑health, life, and disability coverage are described as comprehensive, with a recent carrier change noted alongside “good options.” Feedback suggests this coverage is broadly solid for a midsize agency.
  • Retirement Support A 401(k) with company match and immediate vesting is frequently highlighted and well regarded. Feedback suggests this program is a reliable cornerstone of the total rewards package.
  • Wellbeing & Lifestyle Benefits The “Benefits Built Different” program adds a Lifestyle Spending Account plus wellness tech access (Oura Ring, Function Health), signaling investment beyond basics. Feedback suggests these perks enhance the perceived value of the package.

MERGE Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, IL
660 Employees
Year Founded: 2018

What We Do

MERGE is a marketing and technology agency built at the intersection of Health & Wellness. We help brands navigate complex consumer journeys and unlock growth through data-driven storytelling, AI-powered personalization, and bold creativity. Decades of experience with health and consumer brands have taught us what truly drives decisions. As a marketing and technology agency, we use these insights to help brands reach the right people, in the right moments, with experiences that drive lasting, scalable growth. We do it by leading with curiosity, practicing with precision, and delivering with integrity.

Why Work With Us

At MERGE, we use storytelling through technology to help brands connect more meaningfully with the people they serve. Powered by human insight, creativity, and AI, we weave storytelling through technology to turn complexity into clarity - strengthening relationships between people and brands.

Gallery

Gallery

Similar Jobs

MetLife Logo MetLife

Customer Care Advocate Disability Intake - Cary, NC 9.21.26 - 18274

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Cary, NC, USA
43000 Employees
42K-42K Annually

MetLife Logo MetLife

Junior Software Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Cary, NC, USA
43000 Employees
56K-74K Annually

Wells Fargo Logo Wells Fargo

Consultant

Fintech • Financial Services
Hybrid
Charlotte, NC, USA
205000 Employees
185K-300K Annually

MetLife Logo MetLife

Infrastructure Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Cary, NC, USA
43000 Employees
70K-87K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software • Productivity
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account