check if urls work

Do you have a list of urls (one per line) and you do not want to check them by hand? Then try this code. It will open g1.txt (the file with your urls), then it checks every line. The urls that do work will be stored in g2.txt. The sites that do not work will get stored in g3.txt. Be aware: sites that forward the user are stored in g3.txt, too.

open (ERSTE, "g1.txt") || die "fiel g1 not found\n";

@urls = <ERSTE>;
close (ERSTE);


use LWP::Simple;

foreach (@urls)
{
if (head($_))
{
# these urls do work
open (OUTFILE, ">>g2.txt");
print OUTFILE "$_";
close (OUTFILE);
}
else
{
# these urls do not work
open (OUTFILE, ">>g3.txt");
print OUTFILE "$_";
close (OUTFILE);


}
}


 

Back to previous page