Decision Scientist (Test and learn, Reporting)

Posted 3 Hours Ago
Be an Early Applicant
Hiring Remotely in Texas, USA
Remote
110K-130K Annually
Senior level
Artificial Intelligence • Consulting
The Role
Lead test-and-learn initiatives across insurance products and member experiences. Design experiments, analyze incremental impact using statistical and causal methods, integrate complex data sources, build lifetime value models, and translate findings into actionable business recommendations. Partner with product, marketing, operations, and strategy stakeholders while developing dashboards, documentation, and organizational experimentation capabilities.
Summary Generated by Built In

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner. 

Please visit Fractal | Intelligence for Imagination for more information about Fractal.
Job Title: Decision Scientist

Role Overview
Fractal Analytics is seeking an experienced Decision Scientist to lead test-and-learn initiatives across insurance products and member experiences. This role combines deep statistical rigor with consulting acumen: you will partner with product, marketing, and operations teams to frame business questions, design experiments, measure incremental impact, and translate results into clear, actionable recommendations.

Beyond testing execution, you will leverage data modeling, analytics, and quantitative thinking to solve problems across the full value chain—from member acquisition and onboarding through engagement, retention, and lifetime value. You will understand client requirements, scope problems broadly, integrate disparate data sources, and drive fact-based decision-making across the organization.

This is an analytics consulting role. The ideal candidate combines strong experimental design and statistical skills with business acumen, intellectual curiosity, and the ability to translate complex technical findings into clear recommendations for cross-functional stakeholders.

Location: San Antonio/ Dallas (Texas)

Key Responsibilities
 

PRIMARY FOCUS: TEST-AND-LEARN WITHIN AN ANALYTICS CONSULTING CONTEXT

Core Competencies:

Experimental Design & Incrementality Testing

  • 5+ years designing and executing A/B tests, multivariate tests, and holdout/control experiments
  • 3+ years with Mastercard APT or equivalent incrementality testing platforms

Advanced Statistical Methods

  • Expert-level knowledge of hypothesis testing, power analysis, significance testing, causal inference, regression discontinuity, and other statistical techniques to validate business hypotheses

Data & Analytics Foundation

  • Strong SQL and Python; hands-on experience with data integration, quality assurance, and exploratory analysis
  • Ability to work with complex, multi-source datasets

Adobe Analytics & Digital Funnel Analysis

3+ years with Adobe Analytics for funnel analysis, customer journey mapping, and experiment performance tracking across web and app experiences

Lifetime Value (LTV) & Business Impact Modeling

Experience building and applying LTV models to estimate long-term impact of test-and-learn initiatives on customer retention, profitability, and business value

KEY RESPONSIBILITIES

1. Problem Scoping & Consulting Partnership

  • Work closely with stakeholders across product, marketing, operations, and strategy to understand business objectives and challenges
  • Translate business questions into testable hypotheses; frame problems in statistical and analytical terms
  • Scope test-and-learn initiatives within the broader value chain—understanding how acquisition, engagement, retention, and LTV connect to overall business objectives
  • Identify data requirements and integration needs; partner with data engineering and analytics teams to prepare datasets

2. Test Design & Experimental Methodology

  • Design A/B tests, multivariate tests, and holdout/control experiments; define treatment, control, and sample allocation strategies
  • Apply power analysis and sample size calculations to ensure statistical rigor; document assumptions and methodology
  • Use Mastercard APT to configure, execute, and monitor test cells and measure incremental lift against control groups
  • Design for real-world constraints: seasonality, holdout group limitations, technical feasibility, and compliance requirements.

3. Data Analysis & Insights Extraction

  • Execute SQL and Python queries to extract, validate, and prepare test results and outcome data
  • Apply statistical testing, confidence interval estimation, and causal inference methods to measure incremental lift and validate results
  • Use Adobe Analytics to track experiment performance, segment results by customer cohort, and identify interaction effects
  • Build LTV models to estimate long-term impact of treatments on customer value, retention curves, and profitability
  • Conduct sensitivity analysis and validate findings against alternative model specifications

4. Recommendations & Actionability

  • Translate incremental lift, LTV impact, and statistical findings into clear, business-focused recommendations
  • Quantify business impact: "Implementing this change will lift acquisition by X%, generating $Y in incremental revenue"
  • Design communication materials and visualizations for peer review, leadership, and operational execution teams
  • Prioritize recommendations by impact, feasibility, and alignment with strategic objectives

5. End-to-End Analytics & Data Integration

  • Identify, gather, and integrate disparate data sources: digital (Adobe Analytics, clickstream), transactional, campaign, and third-party data
  • Apply data quality techniques, validation checks, and documentation standards to ensure analytical rigor
  • Build analytical datasets and dashboards to support ongoing monitoring and learning from test initiatives
  • Document data lineage, assumptions, and methodology to support peer review and compliance requirements

6. Thought Partnership & Organization Learning

  • Advocate for test-and-learn as a discipline; educate stakeholders on experimental design, statistical concepts, and best practices
  • Build organizational capabilities: document playbooks, and share learning across teams
  • Collaborate with Fractal partners and subject matter experts to stay current on insurance, customer experience, and analytics best practices

REQUIRED QUALIFICATIONS

Education & Experience

  • Bachelor's degree in Economics, Finance, Statistics, Mathematics, Operations Research, Data Science, or related quantitative field
  • 4+ years of experience in analytics, data science, or quantitative business roles (financial services, insurance, or consumer tech preferred); OR advanced quantitative degree with 3+ years of relevant experience.

Test & Experimentation

  • 5+ years designing and analyzing A/B tests, multivariate tests, and holdout/control experiments
  • 3+ years with Mastercard APT or comparable incrementality testing platforms
  • Deep expertise in experimental design, power analysis, hypothesis testing, and statistical significance.

Data & Analytics Foundations

  • Intermediate to advanced SQL: ability to query databases, build custom datasets, conduct exploratory analysis, and validate data quality
  • Intermediate to advanced Python: data manipulation, statistical analysis, exploratory data analysis, and automation
  • Strong data visualization skills: ability to communicate findings clearly using Tableau, Looker, Power BI, or similar tools
  • Understanding of data quality, validation, and documentation; experience integrating data from multiple sources

Analytics & Statistical Methods

  • Proven competency in statistical techniques: regression analysis, causal inference, cohort analysis, and other quantitative methods
  • Experience building analytical models and applying them to business problems
  • Understanding of how to translate statistical findings into business recommendations

PREFERRED QUALIFICATIONS

  • 3+ years of hands-on experience with Adobe Analytics, including funnel analysis, customer journey mapping, and experiment performance tracking
  • Experience building or applying LTV models to evaluate customer value, retention, and lifetime profitability
  • Track record running test-and-learn programs for insurance products (auto, home, umbrella, or related lines) or financial services products
  • Experience working in consulting or advisory roles; ability to partner with cross-functional teams and translate technical findings for non-technical audiences
  • Familiarity with Financial Services and Insurance, customer acquisition, onboarding, or member experience workflows

Pay

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $110,000 - $130,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits:  

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time.  You will be eligible for benefits on the first day of employment with the Company.  In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms.   The Company provides 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take the time needed for either sick time or vacation.  

  

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.  

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Skills Required

  • Bachelor's degree in Economics, Finance, Statistics, Mathematics, Operations Research, Data Science, or a related quantitative field
  • 4+ years of experience in analytics, data science, or quantitative business roles, or an advanced quantitative degree with 3+ years of relevant experience
  • 5+ years designing and analyzing A/B tests, multivariate tests, and holdout/control experiments
  • 3+ years of experience with Mastercard APT or a comparable incrementality testing platform
  • Expert knowledge of experimental design, power analysis, hypothesis testing, and statistical significance
  • Intermediate to advanced SQL skills
  • Intermediate to advanced Python skills
  • Strong data visualization skills using Tableau, Looker, Power BI, or similar tools
  • Experience with data quality, validation, documentation, and multi-source data integration
  • Competency in regression analysis, causal inference, cohort analysis, and quantitative methods
  • Experience building analytical models and applying them to business problems
  • Ability to translate statistical findings into business recommendations
  • 3+ years of hands-on Adobe Analytics experience
  • Experience building or applying lifetime value models
  • Experience running test-and-learn programs for insurance or financial services products
  • Experience in consulting or advisory roles
  • Familiarity with financial services and insurance workflows

Fractal Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Fractal and has not been reviewed or approved by Fractal.

  • Healthcare Strength Health coverage includes medical, dental, and vision along with tax‑advantaged accounts and EAP in the U.S., indicating a broad core package. Feedback suggests core protections exist across regions, though specifics can vary by location.
  • Leave & Time Off Breadth Time‑off programs include generous PTO, paid holidays and sick time, paid volunteer time, and sabbaticals in some areas. Some accounts also describe manager‑approved or flexible PTO approaches alongside hybrid/WFH latitude.
  • Flexible Benefits Work arrangements commonly include remote/hybrid options and flexible schedules. Flexibility is frequently highlighted as part of the overall value proposition.

Fractal Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
5,262 Employees

What We Do

Fractal is one of the most prominent players in the Artificial Intelligence space. Fractal's mission is to power every human decision in the enterprise and brings AI, engineering, and design to help the world's most admired Fortune 500® companies. Fractal's products include Qure.ai to assist radiologists in making better diagnostic decisions, Crux Intelligence to assists CEOs, and senior executives make better tactical and strategic decisions, Theremin.ai to improve investment decisions, and Eugenie.ai to find anomalies in high-velocity data & Samya.ai to drive next-generation Enterprise Revenue Growth Management. Fractal has more than 3,000 employees across 16 global locations, including the United States, UK, Ukraine, India, Singapore, and Australia. Fractal has consistently been rated as India's best companies to work for, by The Great Place to Work® Institute, featured as a leader in Customer Analytics Service Providers Wave™ 2021, Computer Vision Consultancies Wave™ 2020 & Specialized Insights Service Providers Wave™ 2020 by Forrester Research, and recognized as an "Honorable Vendor" in 2021 Magic Quadrant™ for data & analytics by Gartner.

Similar Jobs

Samsara Logo Samsara

Sales Operations Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
79K-120K Annually

Rubrik Logo Rubrik

Customer Resilience Manager

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Remote
US
3000 Employees
148K-222K Annually

Qualtrics Logo Qualtrics

Head of Public Relations

Artificial Intelligence • HR Tech • Information Technology • Software • Business Intelligence
In-Office or Remote
Dallas, TX, USA
5000 Employees

GitLab Logo GitLab

Customer Success Manager

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
United States
2500 Employees

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
New York, New York
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account