Hierarchy of links

[isapiens]

I thought i ll post this in web development...

Is there a way to find out all the links that a website has? What i mean, is there, for example, a tool to scan the website to get a txt. file with the tree-like diagram of all the links to other websites and so on...

Let me know if this doesn't make sense, i just don't know the official name name for what i wanna do.

[floodhound2]

I think this is possible to program in visual basic. A few years ago I did a text browser in Visual basic and it returned the links on the site. I am not sure if there is any thing already made except a webcrawler that goole or yahoo use.

PEACE

[sternbildchen]

I think the english name for it is "Enumeration".
There are a lot of tools the crawl the webpages.

#Free:
1) BurbSpider (just collect links)

Code: Select all

http://portswigger.net/

#Not-Free:
2)Black Widow (collects links,downloads stuff,makes the page offline useable)

Code: Select all

http://www.softbytelabs.com/us/bw/index.html

[isapiens]

yep thats what i was looking for, tx bunch guys. The burbspider also gave me some basic info on the server type, i tested it out on the wargames website