Skip to content

feat: rerun experiments if API says so#3258

Open
mikewilli wants to merge 4 commits into
mainfrom
holdback-analysis-rerun
Open

feat: rerun experiments if API says so#3258
mikewilli wants to merge 4 commits into
mainfrom
holdback-analysis-rerun

Conversation

@mikewilli

@mikewilli mikewilli commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

For experiments tagged by the Experimenter API with do_rerun:

  • trigger a rerun via rerun_config_changed
  • block the rerun if experiment tables have been updated more recently than do_rerun_timestamp
  • only run overall analysis
  • skip regular runs
@mikewilli mikewilli marked this pull request as ready for review June 17, 2026 18:56
@mikewilli mikewilli requested a review from scholtzan June 17, 2026 18:56
halemu pushed a commit to halemu/experimenter that referenced this pull request Jul 1, 2026
… model and v8 API (mozilla#16096)

Because

- Holdback experiments need to be flagged in Experimenter and re-run by
downstream analysis. Jetstream reads these fields from the v8 API to
decide when to rerun an experiment, and metric-hub uses them for
long-term holdback analysis.

This commit

- Adds `is_holdback`, `do_rerun`, and `do_rerun_timestamp` fields to the
`NimbusExperiment` model and exposes them in the v8 API as `isHoldback`,
`doRerun`, and `doRerunTimestamp`.
- Updates the v8 serializer and changelog serializer test expectations
and regenerates the OpenAPI schema and Swagger docs.

Related

- mozilla/metric-hub#1502
- mozilla/jetstream#3258

fixes mozilla#16087

---------

Co-authored-by: Yashika Khurana <yashikakhurana@Yashikas-MBP.home.local>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant