| French | English |
| exclusion des robots | Robots Exclusion (A feature to manage the content of the Robots.txt file for your Web site) |
| fichier Robots.txt | Robots.txt file (" A file that informs search engines about the pages in a Web site that the owner wants to exclude from, or allow for, indexing. The file contains "allow" rules and "disallow" rules to indicate which portions of a Web site should, or should not be, indexed. If a Web site has subdomains, each subdomain must have its own Robots.txt file.") |
| robot d'indexation | web crawler (An automated program that searches the Internet for new Web documents and places their addresses and content-related information in a database, which can be accessed with a search engine. Generally considered to be a type of bot, or Internet robot) |
| règle d'impact du robot | crawler impact rule (A rule that applies to a specific URL or range of URLs on which you can configure crawling to reduce the resources that are used on the server that is being crawled) |