We demonstrate the limitations of OOD detection for subgroup shifts, i.e. shifts within the support of the original distribution. We show how such shifts can be detected on a population level instead and establish a baseline on histopathology images.