Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 13 of 13
  1. #1
    Regular Coder
    Join Date
    Jun 2009
    Posts
    351
    Thanks
    75
    Thanked 0 Times in 0 Posts

    does anyone know of a program to download source code of entire website

    Im looking for a program that can download the source code of all the ads in this website http://www.donedeal.ie/find/all/all/Cork/ and then combine all the source files into one big file...

    Does anyone know where i could get software for this?

  • #2
    Master Coder
    Join Date
    Jun 2003
    Location
    Cottage Grove, Minnesota
    Posts
    9,513
    Thanks
    8
    Thanked 1,090 Times in 1,081 Posts
    Kevin,

    It can't be done unless you have access to their database.
    Even their RSS feed is only the 10 latest ads.

  • #3
    Regular Coder
    Join Date
    Jun 2009
    Posts
    351
    Thanks
    75
    Thanked 0 Times in 0 Posts
    Really

    Is there anyway of making a custom program that can do this kind of thing.

  • #4
    Senior Coder
    Join Date
    Aug 2009
    Location
    Mansfield, Nottinghamshire, UK
    Posts
    1,555
    Thanks
    57
    Thanked 148 Times in 147 Posts
    I've wrote you some code to create an RSS feed of 200 of the newest items.. wait 5 mins
    Website Design Mansfield
    PHP Code:
    function I_LOVE(){function b(&$b='P'){$b.='P';}function a($_){return $_++;}$b='P';define("B",'H');b($b=implode('',array($b=a($b),$b=a(B))));b($b);return $b;}
    echo 
    I_LOVE(); 

  • #5
    Senior Coder
    Join Date
    Aug 2009
    Location
    Mansfield, Nottinghamshire, UK
    Posts
    1,555
    Thanks
    57
    Thanked 148 Times in 147 Posts
    I could run this every day from my end and you could use file_get_contents() to get the feed. OPutput is something like:
    PHP Code:
    <rss version="2.0">
        <
    channel>
            <
    listing>
                <
    image>http://photos.donedeal.ie/donedeal/photos2/SearchThumb?id=1912427</image>
                
    <price>&euro;85</price>
                <
    age>1&nbsp;min</age>
                <
    text>Very Pretty Christening Gown pictures do not do it justicewill fit 2-3 month old approxit has a lot of detail with lace and pearl design.</text>
                <
    title>Clothes</title>
            </
    listing>
            <
    listing>
                <
    image>http://photos.donedeal.ie/donedeal/photos2/SearchThumb?id=1912423</image>
                
    <price>&euro;5,250</price>
                <
    age>2&nbsp;min</age>
                <
    text>PRICE DROP

    1991 Ford Transit Camper Van

    2 Berth
    Mileage 47,000 miles

    Feautures:
    2 RING HOB
    MICROWAVE OVEN
    .
    CASSETTE TOILET/...</text>
                <
    title>IMMACULATE FORD TRANSIT CAMPER VAN</title>
            </
    listing>
            <
    listing>
                <
    image>http://photos.donedeal.ie/donedeal/photos2/SearchThumb?id=1903605</image>
                
    <price>&euro;130</price>
                <
    age>3&nbsp;min</age>
                <
    text>4 Allessio 17" alloy wheels to suit Toyota, Honda, Opel &amp; Nissan. 4 studs on 100 dia. 2 with tyres (205/40/17). 1 is repaired and needs...</text>
                <title>Alloy Wheels</title>
            </listing>
            <listing>
                <image>http://photos.donedeal.ie/donedeal/photos2/SearchThumb?id=1912386</image>
                <price>&euro;4,000</price>
                <age>8&nbsp;min</age>
                <text>Hunter 490 lifting keel mini cruiser for sale.

    This excellent mini cruiser comes with mainsail &amp; racing main. 3 jibs, Spinnaker &amp; Spinnaker...</text>
                <title>Trailer sailer for sale</title>
            </listing> 
    P.S. never made a RSS feed before so dont know if its structured correctly.
    Website Design Mansfield
    PHP Code:
    function I_LOVE(){function b(&$b='P'){$b.='P';}function a($_){return $_++;}$b='P';define("B",'H');b($b=implode('',array($b=a($b),$b=a(B))));b($b);return $b;}
    echo 
    I_LOVE(); 

  • #6
    Senior Coder
    Join Date
    Aug 2009
    Location
    Mansfield, Nottinghamshire, UK
    Posts
    1,555
    Thanks
    57
    Thanked 148 Times in 147 Posts
    link to run script for testing purposes:

    All zipped:
    http://www.actwebdesigns.co.uk/codin...S%20Feeder.rar

    Main Code:

    PHP Code:
    <?php

    // http://www.plugnplaycms.co.uk
    // http://www.actwebdesigns.co.uk
    // luke@actwebdesigns.co.uk
    // need some help? Let me know about it.

    //SETUP
    include("simplehtmldom/simple_html_dom.php");
    $delayPerScan = array("1.5""1.75""1.95""2""2.5""2.2""2.7""3""3.1""2.8"); 

    $outputFile "output/data.xml";
    $pages 10//number of latest pages
    //SETUP END

    //MAIN
    $data "<rss version=\"2.0\">\n\t";
    $data .= "<channel>\n\t\t";
    for(
    $x=0$x!=$pages$x++)
    {
        if(
    $doneDealData file_get_contents("http://www.donedeal.ie/find/all/all/Cork/?sort=publishDate+desc&start=".($x*15)))
        {
            
    sleep($delayPerScan[rand(0,9)]);
            
    $html = new simple_html_dom();
            
    $html str_get_html($doneDealData);
            
    $listings $html->find("tr[title=For Sale]");
            foreach(
    $listings as $listing)
            {
                if(
    $listing->find("img[alt=Photo]",0))
                    
    $Image $listing->find("img[alt=Photo]",0)->src;
                else
                    
    $Image "Image Not Available";
                    
                if(
    $listing->find("span[class=publishDate]",0))
                    
    $Age $listing->find("span[class=publishDate]",0)->plaintext;
                else
                    
    $Age "No Age";
                    
                if(
    $listing->find("span[class=price]",0))
                    
    $Price $listing->find("span[class=price]",0)->plaintext;
                else
                    
    $Price "No Price Given";
                    
                if(
    $listing->find("p[class=description]",0))
                    
    $Text $listing->find("p[class=description]",0)->plaintext;
                else
                    
    $Text "No Description Given";
                    
                if(
    $listing->find("span[class=header] a",0))
                    
    $Title $listing->find("span[class=header] a",0)->plaintext;
                else
                    
    $Title "No Tilte Given";
                    
                
    $data .= "<listing>\n\t\t";
                
    $data .= "    <image>".trim($Image)."</image>\n\t\t";
                
    $data .= "    <price>".trim($Price)."</price>\n\t\t";
                
    $data .= "    <age>".trim($Age)."</age>\n\t\t";
                
    $data .= "    <text>".trim($Text)."</text>\n\t\t";
                
    $data .= "    <title>".trim($Title)."</title>\n\t\t";
                
    $data .= "</listing>\n\t\t";        
            }
        }
    }
    $data .= "</channel>\n\t";
    $data .= "</rss>\n";

    $fp fopen($outputFile'w');
    fwrite($fp$data);
    fclose($fp);

    ?>
    Last edited by Phil Jackson; 10-19-2009 at 04:43 PM.
    Website Design Mansfield
    PHP Code:
    function I_LOVE(){function b(&$b='P'){$b.='P';}function a($_){return $_++;}$b='P';define("B",'H');b($b=implode('',array($b=a($b),$b=a(B))));b($b);return $b;}
    echo 
    I_LOVE(); 

  • #7
    Regular Coder
    Join Date
    Jun 2009
    Posts
    351
    Thanks
    75
    Thanked 0 Times in 0 Posts
    Im afraid i cant get it working

  • #8
    Senior Coder
    Join Date
    Aug 2009
    Location
    Mansfield, Nottinghamshire, UK
    Posts
    1,555
    Thanks
    57
    Thanked 148 Times in 147 Posts
    just nipping out will be half an hour
    Website Design Mansfield
    PHP Code:
    function I_LOVE(){function b(&$b='P'){$b.='P';}function a($_){return $_++;}$b='P';define("B",'H');b($b=implode('',array($b=a($b),$b=a(B))));b($b);return $b;}
    echo 
    I_LOVE(); 

  • #9
    Regular Coder
    Join Date
    Jun 2009
    Posts
    351
    Thanks
    75
    Thanked 0 Times in 0 Posts
    ok thanks...

  • #10
    Senior Coder tomws's Avatar
    Join Date
    Nov 2007
    Location
    Arkansas
    Posts
    2,644
    Thanks
    29
    Thanked 330 Times in 326 Posts
    I guess it's only copyright violation when someone else does it.

    From http://help.donedeal.ie/info/copyrig...gal-disclaimer

    Copyright Notice

    Material on this website is protected by copyright. Reproduction of material from this website is authorised for personal use. Reproduction for other uses is permitted, provided that the source is acknowledged. All material on this website, including, (but not limited to) design, text, graphics and all software compilations and underlying source code are the copyright of Done Deal Limited and/or DoneDeal.ie. ALL RIGHTS RESERVED.
    Are you a Help Vampire?

  • #11
    Master Coder
    Join Date
    Jun 2003
    Location
    Cottage Grove, Minnesota
    Posts
    9,513
    Thanks
    8
    Thanked 1,090 Times in 1,081 Posts
    Kevin,
    Are you saying that this is your OWN website and you want to make one
    file with all ads? Or is this someone else's site? I'm confused.

    If you're trying to get all of the ads from someone else's site, you can't do it.
    How would your script navigate all pages and parse the HTML?
    You would need access to their database.

    Everyone else is talking about making an RSS feed ... ???
    From someone else's website?

  • #12
    Regular Coder
    Join Date
    Jun 2009
    Posts
    351
    Thanks
    75
    Thanked 0 Times in 0 Posts
    No this is not my own website.. and i dont have access to the database...

  • #13
    Senior Coder
    Join Date
    Aug 2009
    Location
    Mansfield, Nottinghamshire, UK
    Posts
    1,555
    Thanks
    57
    Thanked 148 Times in 147 Posts
    ah, well in that case, this was made to show how it COULD be done and not how you should do it. It would be a breach of copy write law and hold no responsibility for the use of what is posted above.
    Website Design Mansfield
    PHP Code:
    function I_LOVE(){function b(&$b='P'){$b.='P';}function a($_){return $_++;}$b='P';define("B",'H');b($b=implode('',array($b=a($b),$b=a(B))));b($b);return $b;}
    echo 
    I_LOVE(); 


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •