What is the fastest way to scrape HTML webpage in Android?

by

I think in this case it makes no sense to look for a fast way to extract the information as there is virtually no performance difference between the methods already suggested in answers when you compare it to the time it will take to download the HTML.

So assuming that by fastest you mean most convenient, readable and maintainable code, I suggest you use a DocumentBuilder to parse the relevant HTML and extract data using XPathExpressions:

Document doc = DocumentBuilderFactory.newInstance()
  .newDocumentBuilder().parse(new InputSource(new StringReader(html)));

XPathExpression xpath = XPathFactory.newInstance()
  .newXPath().compile("//td[text()=\"Description\"]/following-sibling::td[2]");

String result = (String) xpath.evaluate(doc, XPathConstants.STRING);

If you happen to retrieve invalid HTML, I recommend to isolate the relevant portion (e.g. using substring(indexOf("<table")..) and if necessary correct remaining HTML errors with String operations before parsing. If this gets too complex however (i.e. very bad HTML), just go with the hacky pattern matching approach as suggested in other answers.

Remarks

  • XPath is available since API Level 8 (Android 2.2). If you develop for lower API levels you can use DOM methods and conditionals to navigate to the node you want to extract

More Related Contents:

  1. How to display HTML in TextView?
  2. WebView and HTML5
  3. HTML file input in android webview (android 4.4, kitkat)
  4. Sharing link on WhatsApp from mobile website (not application) for Android
  5. Rendering HTML in a WebView with custom CSS
  6. Android webview & localStorage
  7. Chrome on Android resizes font
  8. How to load external webpage in WebView
  9. What kind of font files do I need for modern browsers, Android and IOS?
  10. Android WebView renders blank/white, view doesn’t update on css changes or HTML changes, animations are choppy
  11. HTML: Why does Android browser show “Go” instead of “Next” in keyboard?
  12. Enable rear camera with HTML5
  13. How to embed a YouTube clip in a WebView on Android
  14. Android : Html Anchor Link works only once in webview
  15. Webview’s Html button click detection in Activity
  16. How to autoplay HTML5 mp4 video on Android?
  17. How can I change the color of header bar and address bar in the newest Chrome version on Lollipop?
  18. Android: html in strings.xml
  19. Disabling android’s chrome pull-down-to-refresh feature
  20. Android browser bug? div overflow scrolling
  21. Android add image to webview from a drawable
  22. Play Youtube HTML5 embedded Video in Android WebView
  23. How can you parse HTML in android?
  24. android: html in textview with link clickable [duplicate]
  25. Android Custom URL to open App like in iOS
  26. Is there a way to have a masked numeric input field?
  27. HTML input type ‘file’ is not working on webview in android. Is there any way to upload file using webview android?
  28. Is there a faster way to decode html characters to a string than Html.fromHtml()?
  29. Getting net::ERR_UNKNOWN_URL_SCHEME while calling telephone number from HTML page in Android
  30. Why Bitmap to Base64 String showing black background on webview in android?

Leave a Comment