Directory Discovery
Techniques and tools for discovering hidden directories and files on web servers.
§
table of contents
FFUF
See also FFUF for fuzzing-based directory discovery.
Robots.txt
curl -s $url/robots.txt
Sitemap.xml
curl -s $url/sitemap.xml
Dirb
dirb $url
Spider - Katana
A spider is a tool that crawls a website and collects information about its structure and content. It can be used to find hidden directories, files, and parameters.
katana -c 15 -p 15 -u $url > output