Manage Experiments with AI

Use the Ours Privacy MCP server to create, edit, start, stop, and analyze A/B tests through natural-language prompts in Claude, ChatGPT, and other AI assistants.

Manage Experiments with AI

Use this page to run the full experiment lifecycle — create, edit, start, stop, and read results — through an AI assistant like Claude or ChatGPT, without touching the dashboard.

It pairs the MCP Server with the same experimentation engine documented elsewhere in this section, so anything you can do in the dashboard, you can do through a prompt.

Open Experiments in app

Before You Start

  1. Connect your AI tool to the Ours Privacy MCP server. See MCP Server (platform).
  2. Make sure the API key you used has permission to read and write experiments.
  3. Install the experiment runtime on your site if you haven't already. See Installation.

Create an Experiment

Ask your assistant in plain language. Example prompt:

"Create a draft content experiment named Pricing CTA v2 targeting /pricing. Add two variants: control (no change) and treatment (button text: Try it free)."

Behind the scenes the assistant calls create_experiment, then create_experiment_variant for each variant. The new experiment appears in Experiments in your dashboard as a draft.

A primary metric event and at least two variants are required before the experiment can start, so include the goal event in your prompt — for example, "...with primary metric signup_completed."


Edit an Experiment

Once a draft exists, you can edit it the same way:

"Update the Pricing CTA v2 experiment to target visitors with UTM source google only. Set traffic allocation to 50%."

The assistant updates targeting and allocation through update_experiment_settings and update_experiment.


Start an Experiment

When you're ready to ship:

"Start the Pricing CTA v2 experiment."

The assistant calls start_experiment, which atomically publishes the experiment and makes it live. Assignment begins immediately; impressions and your existing conversion events flow into the same analytics pipeline you already use.


Read Live Results

Ask for the current numbers anytime:

"How is Pricing CTA v2 performing? Which variant is winning?"

The assistant calls get_experiment_results and summarizes the Bayesian probability-to-be-best for each variant. For trends over time, ask for "results over the last 14 days" — that hits get_experiment_results_time_series.


Stop an Experiment

When you've seen enough:

"Stop Pricing CTA v2 and lock in the treatment."

The assistant calls stop_experiment. Apply the winning variant permanently in the dashboard or by editing the experiment definition.


Available Tools

The MCP server exposes tools for:

  • Experiments — list, get, create, update, start, stop, results, results time series
  • Experiment Variants — list, get, create, update
  • Experiment Settings — list, get, create, update
  • Versions — publish, diff

For the full list, prompt your assistant for "what tools are available from oursprivacy?"


Next Steps


Need Help?

Reach out to support@oursprivacy.com if you have questions about running experiments through AI.

How is this guide?

On this page