Overview

This tool retrieves the most recent archived version of a site’s /robots.txt file from the Internet Archive’s Wayback Machine and extracts URI endpoints listed under Disallow or Allow directives. Useful for reconnaissance, endpoint discovery, or assessing previously exposed paths.

Example

{
  "function_call": {
    "name": "GetArchivedRobotsEndpoints",
    "arguments": {
      "Domain": "practicalsecurityanalytics.com"
    }
  }
}