Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 3 of 3
  1. #1
    New to the CF scene
    Join Date
    Aug 2010
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    How do I perform automated search on a website?

    There is a website where people can check the status of their application for a certain service using a confirmation number. This is a basic website for just this purpose, so it is not keyword-searchable. Is it possible to write some kind of script that will check the status of the application for a range of confirmation codes and report the confirmation codes for which the status page contain a certain keyword?

  • #2
    Regular Coder
    Join Date
    Jul 2010
    Posts
    271
    Thanks
    3
    Thanked 40 Times in 40 Posts
    Would need to look at the site.

  • #3
    New Coder
    Join Date
    Jul 2010
    Posts
    24
    Thanks
    0
    Thanked 2 Times in 2 Posts
    It's possible, but I would not suggest that it would be easy or fast with my skill set.

    Here's the hypothesis I would propose:

    There is a text-only browser called Lynx from the University of Kansas. It's supposed to be scriptable. It would take some doing, but I imagine that one could get Lynx to go to the website and do a search within a specific page.

    This browser cannot read iframes, javascripts, or much of anything besides the strait text on the web page. It's not pretty; designed for HTML 1.1; but, it is stable and useful.

    Idea would be to write one script to control the browser. Get it to search the specific, pre-determined page (you yourself would have to determine the target, instead of the application doing lots of conditional searching). Print the contents of that page to a file in a specific location.

    Meanwhile, another script would run a search on that file, periodically. This search would be for the target string, like a specific confirmation number you knew was coming down.

    In this way, you could search a known target website for an expected string or condition. Idea would be to get the application to do 90% of the waiting for you, with the person minding it either responding to the program's alert, or checking up on the page themselves every so often.

    Lynx's printing options include sending the printed content as an email.
    http://lynx.isc.org/current/lynx2-8-...rint_help.html

    I have never done any of this, but if I had to propose something, that would be it.

    Notice, you would have to have just the right blend of conditions to make this plausible: experience with the browser, some elementary programming, a known set of possible answers, and the presentation of those answers in a convenient form of searchable text. That's a lot conditions.

    Keep in mind, that by the time I got such a thing to work, whatever it was would have already happened.
    Last edited by agxphoto; 08-12-2010 at 04:02 AM.


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •