Extract links from a web page

by

download java file as plain text/html pass it through Jsoup or html cleaner both are similar and can be used to parse even malformed html 4.0 syntax and then you can use the popular HTML DOM parsing methods like getElementsByName(“a”) or in jsoup its even cool you can simply use 

File input = new File("/tmp/input.html");
 Document doc = Jsoup.parse(input, "UTF-8", "http://example.com/");

Elements links = doc.select("a[href]"); // a with href
Elements pngs = doc.select("img[src$=.png]");
// img with src ending .png

Element masthead = doc.select("div.masthead").first();

and find all links and then get the detials using 

String linkhref=links.attr("href");

Taken from http://jsoup.org/cookbook/extracting-data/selector-syntax

The selectors have same syntax as jQuery if you know jQuery function chaining then you will certainly love it.

EDIT: In case you want more tutorials, you can try out this one made by mkyong.

http://www.mkyong.com/java/jsoup-html-parser-hello-world-examples/

More Related Contents:

  1. How can I solve “java.lang.NoClassDefFoundError”?
  2. Java: export to an .jar file in eclipse
  3. Read Content from Files which are inside Zip file
  4. How to add hyperlink in JLabel?
  5. What is the convention for word separator in Java package names?
  6. Java packages com and org
  7. Open a link in browser with java button? [duplicate]
  8. Running java in package from command line
  9. What is the purpose of defining a package in a Java file? [closed]
  10. Are there best practices for (Java) package organization? [closed]
  11. How to include the Spongy Castle JAR in Android?
  12. Why should java package name be lowercase?
  13. Compiling multiple packages using the command line in Java
  14. Do unused import and objects have a performance impact?
  15. Hyperlink in JEditorPane
  16. Calculating frequency of each word in a sentence in java
  17. Java Package Does Not Exist Error
  18. How can I get a frame sample (jpeg) from a video (mov)
  19. Package structure for a Java project?
  20. Java Package Vs Folder-Structure? what is the difference
  21. How to wildcard include JAR files when compiling?
  22. How to get current class name including package name in Java?
  23. How to run a .class file that is part of a package from cmd?
  24. Difference between Package and Directory in Java
  25. Why subclass in another package cannot access a protected method?
  26. URLClassLoader and accessibility of package-private methods
  27. Java error – bad source file: file does not contain class x . Please remove or make sure it appears
  28. Call protected method from a subclass of another instance of different packages
  29. Why can’t my subclass access a protected variable of its superclass, when it’s in a different package?
  30. Why do java source files require package declarations?

Leave a Comment