~/hadi

Directory Discovery

Techniques and tools for discovering hidden directories and files on web servers.

FFUF

See also FFUF for fuzzing-based directory discovery.

Robots.txt

curl -s $url/robots.txt

Sitemap.xml

curl -s $url/sitemap.xml

Dirb

dirb $url

Spider - Katana

A spider is a tool that crawls a website and collects information about its structure and content. It can be used to find hidden directories, files, and parameters.

katana -c 15 -p 15 -u $url > output