I'm making a specific development, and I'd like to collect all the URL of any site.
On my site for example I can do this using google analytics , for other sites I can not because I do not have access.
Are there tools that could help me in this case?
After some research I found an alternative. Installed Xenu a free solution that allows you to recover all the URL site and more.
Another method would be to use PHP using the curl of the page!
Good,
It's not quite what you want, but this site, for example, returns you the entire sitemap of any given web address.
The site will generate the sitemap in an xml, you can then use the links in that file.
Cumps,
