docs: confirm robots.txt exists for AI bot crawling on docs site#47642

pelikhan with Copilot wants to merge 1 commit into

maingithub/gh-aw:mainfrom

copilot/geo-optimizer-add-robots-txt-one-more-timegithub/gh-aw:copilot/geo-optimizer-add-robots-txt-one-more-timeCopy head branch name to clipboard