How can I extract URL and link text from HTML in Perl?

by

Please look at using the WWW::Mechanize module for this. It will fetch your web pages for you, and then give you easy-to-work with lists of URLs.

my $mech = WWW::Mechanize->new();
$mech->get( $some_url );
my @links = $mech->links();
for my $link ( @links ) {
    printf "%s, %s\n", $link->text, $link->url;
}

Pretty simple, and if you’re looking to navigate to other URLs on that page, it’s even simpler.

Mech is basically a browser in an object.

More Related Contents:

  1. Trouble with parsing table data in perl
  2. CGI page won't load
  3. Radio Button go to another file on Submit
  4. How to modify HTML file with Perl: preserving lists and erasing all other tags [closed]
  5. What to do Regular expression pattern doesn’t match anywhere in string?
  6. Absolute vs relative URLs
  7. Unicode characters in URLs
  8. Scraping html tables into R data frames using the XML package
  9. How to avoid joining all text from Nodes when scraping
  10. Absolute URLs omitting the protocol (scheme) in order to preserve the one of the current page
  11. HTML-parser on Node.js [closed]
  12. How to specify a local file within html using the file: scheme?
  13. Network-Path Reference URI / Scheme relative URLs
  14. How do HTML parses work if they’re not using regexp?
  15. Difference between Url Encode and HTML encode
  16. File URL “Not allowed to load local resource” in the Internet Browser
  17. How do I export html table data as .csv file?
  18. What characters must be escaped in an HTTP query string?
  19. HTML parsing in perl
  20. Regex to match all HTML tags except and
  21. What is the character limit on URL [duplicate]
  22. How to save the content in UIWebView for faster loading on next launch?
  23. Allow Access-Control-Allow-Origin header using HTML5 fetch API
  24. An URL to a Windows shared folder [duplicate]
  25. HtmlAgilityPack Drops Option End Tags
  26. How do I open a URL from C++?
  27. Convert html to plain text in VBA
  28. Question mark in the middle of a URL variable
  29. How to remove x and y on submit in HTML form with Image type button?
  30. How can I pre-populate html form input fields from url parameters?

Leave a Comment