What file instructs programs like Web spiders NOT to search certain areas of a site?
Posted: Mon Aug 01, 2022 9:35 am
What file instructs programs like Web spiders NOT to search certain areas of a site?
A. Robots.txt
B. Restricted.txt
C. Spider.txt
D. Search.txt
A. Robots.txt
B. Restricted.txt
C. Spider.txt
D. Search.txt