Hello and welcome to our community! Is this your first visit?
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 1 of 1
  1. #1
    New Coder
    Join Date
    May 2011
    Thanked 0 Times in 0 Posts

    Question Scrapping multiple pages at once?

    Hi, I'm still pretty new to CF and have been trying to build a site scrapper to grab video embeds for a while now. So far it works surprisingly well, but there is one problem. Whenever the video embeds are separated by a <!--nextpage--> in Wordpress it creates a separate page, making it difficult to get at all of the embeds at once...

    What I have so far:
    PHP Code:
    if (!isset($_POST['submit'])) {


    HTML stuff

    else {

    $VideoSite $_POST['VideoSite'];

    HTML stuff


    //Not sure how I'd go about adding this:
    $s2 file_get_contents("$VideoSite/2");  

    $patterns = array();
    $patterns[] = '<embed[^>]+src="(.+?)"';
    $patterns[] = '<iframe[^>]+src="(.+?)"';
    $patterns[] = '<object[^>]+src="(.+?)"';

    $patterns "#(?:" implode("|"$patterns) . ")#si";

    if (!empty(

    $edata = array();
    $m[0] as $match)
    //....rest of code....
    What I've been searching for a way to do is get it so that this code can search multiple URLs at the same time, such as using this:

    PHP Code:
    $VideoSite 'http://random.com/random-episode-4' 
    To search for these as well:

    And so on until about eight...

    I'm in desperate need to get this working as efficient as possible for our site and our mods, I appreciate any help, thank you!
    Last edited by Suffice; 05-18-2011 at 01:54 AM.


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts