Fig. 40
From: Cumulative deviation of a subpopulation from the full population
\(n = \) 10,000; \(S_1\), \(S_2\), ..., \(S_n\) are denser near 1; Kuiper’s statistic is \(0.1475 / \sigma = 36.12\), Kolmogorov’s and Smirnov’s is \(0.1089 / \sigma = 26.67\). Figure 41 displays the ground-truth reliability diagram. The cumulative plot captures more of the oscillations in the miscalibration, as do to some extent the reliability diagrams with an equal number of observations per bin; however, the variations in the reliability diagrams could be difficult to interpret without access to the ground-truth exact expectations