Cherry pick PR 7097 in release 1.20#7099

yeya24 merged 1 commit into

release-1.20cortexproject/cortex:release-1.20from

patch-1.20-alertmanagercortexproject/cortex:patch-1.20-alertmanagerCopy head branch name to clipboard