LWP::Parallel grabs ?

[12noon]

Hi,

I run a PPC search engine, but the PHP script is based on LWP::Simple to access the filler search feeds. How easy would it be to use LWP::Parallel grabs in pure PHP ?
I'm asking because LWP::Parallel grabs are much faster and would let me have lots more results in the same time it's taking to pull the 100 or so i have now. I'll pass on any help to my script maker.
Thanks.
 

[SensoVision]

ups, that's too hard for me... hope someone from our members who are better in PHP than me would give you some advice on this.

[12noon]

As far as i know, it can only be done by using Perl.
Just thought i'd ask anyway and see what advice i would get. Anyway i need a better (faster) search engine that will give more results and using LWP::Parallel grabs would be the way to do this. I'm sure this time next month things should be sorted.
I hope

[islanding]

Hay,
  I am not sure about what you are asking & pure PHP. LWP stands for " Library for WWW in Perl ". It is a suite of modules lets your programs download and extract information from the Web. LWP is a suite of modules for fetching and processing web pages. Try using Apache's server-side includes (SSI) to call the perl program and embed the results of the program.
  Good Luck.

[12noon]

Thanks.
 
My script maker is still looking in to this and is trying to custom make something that will either do the same thing as the above and speed up my results or will go with the Perl module making things faster.
The faster i can pull results, the more results i'll be able to have.
BTW i'm just about to start using AH-HA as my filler feed in my search results. They've got to be better than the filler feed i'm using at the moment.

Edit

The new code is now in place and the speed of the searches is fantastic.
 
At the moment it's running at over 1000 searches in about 1 second from two feeds plus my own database.
12noon PPC Search Engine.

[nero]

I am having the same problem (kinda).
My server has lwp::parallel installed but,
when I switch from simple to parallel I
get no search results at all. Any ideas?
I'm using smartsearch.

Thanks in advance
Nero

[12noon]

I'm not sure. It might be an idea for you to get someone to look at your feed plug-ins though or email the makers of your script.

[nero]

Someone said the host may not have installed it correctly, but I don't see how that could be..

[12noon]

Someone said the host may not have installed it correctly, but I don't see how that could be..

Hmmm, you could email your host and ask. Also find out what PERL version your using. I'm using PERL version : 5.6.1