Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 4 of 4
  1. #1
    Regular Coder
    Join Date
    Apr 2010
    Posts
    125
    Thanks
    6
    Thanked 0 Times in 0 Posts

    Anyone know of crawler software that extracts web addresses?

    I'm looking for something that will crawl a given website and return all the outbound URls.

    Either anything that is within ahref tags or any text that starts www.

    Thanks
    I've been making animations for my daughter. Tell me what you think!

    Pickles and the Bully
    Where are you Pickles!?!

  • #2
    Regular Coder
    Join Date
    Jun 2002
    Location
    Flint, Michigan, USA
    Posts
    629
    Thanks
    1
    Thanked 20 Times in 20 Posts
    Quote Originally Posted by instaunt View Post
    I'm looking for something that will crawl a given website and return all the outbound URls.
    Either anything that is within ahref tags or any text that starts www.
    Thanks
    What website do you want crawled? Is this your own website or someone elses?

  • #3
    New Coder
    Join Date
    Jun 2013
    Location
    Bhubaneswar, Odisha, India
    Posts
    26
    Thanks
    0
    Thanked 1 Time in 1 Post
    You may use Google webmaster tool for this. Or ping your site in pingomatic.com for easy and faster crawling.

  • #4
    New Coder
    Join Date
    Mar 2014
    Location
    Europe
    Posts
    10
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Google docs are able to crawle websites, google it. You can also try to run simple html dom script.


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •