Sensitivity study
10brands · 3 variant(s) x 1
Stability by metric
Spread across trials, in score points. A pair counts as unstable when its standard deviation across trials exceeds 5 points.
| Metric | Pairs | Mean SD | Median SD | Max SD | Within variant | Between variants | Unstable |
|---|---|---|---|---|---|---|---|
| Cluny Affinity | 45 | 1.207 | 0.919 | 4.621 | — | 1.207 | 0 |
| Brand affinity | 45 | 1.661 | 1.607 | 4.964 | — | 1.661 | 0 |
| Market proximity | 45 | 1.277 | 1.155 | 4.439 | — | 1.277 | 0 |
Against the production matrix
Compared with run 4d388d02 (published, universe brands, 100 brands). Only pairs present in both are counted.
| Metric | Pairs | Mean delta | MAE | RMSE | Max delta | Pearson r | Spearman ρ |
|---|---|---|---|---|---|---|---|
| Cluny Affinity | 45 | 2.905 | 3.452 | 4.032 | 7.717 | 0.98 | 0.984 |
| Brand affinity | 45 | 0.841 | 2.472 | 2.908 | 5.542 | 0.985 | 0.979 |
| Market proximity | 45 | 3.996 | 4.262 | 5.085 | 10.139 | 0.97 | 0.952 |
Trials
Each trial is preserved as its own affinity run and can be exported on its own with brand-map:export.
| Run | Variant | Replicate | Status | Complete pairs |
|---|---|---|---|---|
| e57ca7df | prompt1 8b4598c4b705 | 1 | completed | 45 |
| b92b53da | prompt2 19f20ff184e9 | 1 | completed | 45 |
| 7e566681 | prompt3 9fb2cfab52fb | 1 | completed | 45 |
Least stable pairs
Ranked by spread across trials, worst first, for each metric.
| Pair | Mean | SD | Range | Within variant | Between variants | Production | Delta |
|---|---|---|---|---|---|---|---|
| Aesop · Supergoop! | 59.921 | 4.621 | 8.137 | — | 4.621 | 54.488 | 5.433 |
| Le Labo · Supergoop! | 53.184 | 2.968 | 5.913 | — | 2.968 | 46.45 | 6.734 |
| Merit · Supergoop! | 78.288 | 2.136 | 4.063 | — | 2.136 | 73.238 | 5.05 |
| MALIN+GOETZ · Rare Beauty | 49.538 | 2.008 | 3.613 | — | 2.008 | 49.275 | 0.263 |
| Flamingo Estate · Supergoop! | 52.946 | 1.979 | 3.9 | — | 1.979 | 51.95 | 0.996 |
| Aesop · Oribe | 72.904 | 1.964 | 3.662 | — | 1.964 | 65.825 | 7.079 |
| Aesop · EltaMD | 47.942 | 1.914 | 3.825 | — | 1.914 | 47.275 | 0.667 |
| Flamingo Estate · Rare Beauty | 37.3 | 1.887 | 3.725 | — | 1.887 | 38.613 | -1.313 |
| MALIN+GOETZ · Supergoop! | 68 | 1.883 | 3.638 | — | 1.883 | 63.163 | 4.837 |
| EltaMD · Oribe | 46.771 | 1.841 | 3.463 | — | 1.841 | 42.125 | 4.646 |
| Flamingo Estate · Le Labo | 77.571 | 1.676 | 3.312 | — | 1.676 | 78.2 | -0.629 |
| MALIN+GOETZ · Merit | 68.409 | 1.635 | 3.262 | — | 1.635 | 64.438 | 3.971 |
| EltaMD · Supergoop! | 73.321 | 1.514 | 2.738 | — | 1.514 | 75.888 | -2.567 |
| Aesop · La Mer | 63.95 | 1.483 | 2.725 | — | 1.483 | 61.425 | 2.525 |
| La Mer · Supergoop! | 51.613 | 1.366 | 2.687 | — | 1.366 | 48.875 | 2.738 |
| Flamingo Estate · MALIN+GOETZ | 72.188 | 1.356 | 2.638 | — | 1.356 | 75.45 | -3.262 |
| La Mer · Rare Beauty | 39.634 | 1.353 | 2.512 | — | 1.353 | 35.588 | 4.046 |
| EltaMD · MALIN+GOETZ | 55.567 | 1.332 | 2.6 | — | 1.332 | 53.363 | 2.204 |
| Merit · Oribe | 65.142 | 1.298 | 2.426 | — | 1.298 | 57.425 | 7.717 |
| La Mer · Oribe | 72.817 | 1.288 | 2.5 | — | 1.288 | 67.45 | 5.367 |
| Rare Beauty · Supergoop! | 74.884 | 1.061 | 2 | — | 1.061 | 71.725 | 3.159 |
| Oribe · Supergoop! | 60.104 | 1.049 | 2.025 | — | 1.049 | 52.738 | 7.366 |
| EltaMD · Rare Beauty | 47.917 | 0.919 | 1.738 | — | 0.919 | 49.213 | -1.296 |
| Le Labo · Merit | 64.184 | 0.916 | 1.813 | — | 0.916 | 56.925 | 7.259 |
| Le Labo · Oribe | 74.209 | 0.891 | 1.688 | — | 0.891 | 69.563 | 4.646 |