[SPARK-56234][CORE] Support disabling log directory scanning by path pattern in SHS#55029

sarutak wants to merge 3 commits into

apache:masterapache/spark:masterfrom

sarutak:disable-event-log-scansarutak/spark:disable-event-log-scanCopy head branch name to clipboard