Scraping html tables into R data frames using the XML package

by

…or a shorter try:

library(XML)
library(RCurl)
library(rlist)
theurl <- getURL("https://en.wikipedia.org/wiki/Brazil_national_football_team",.opts = list(ssl.verifypeer = FALSE) )
tables <- readHTMLTable(theurl)
tables <- list.clean(tables, fun = is.null, recursive = FALSE)
n.rows <- unlist(lapply(tables, function(t) dim(t)[1]))

the picked table is the longest one on the page

tables[[which.max(n.rows)]]

More Related Contents:

  1. How to avoid joining all text from Nodes when scraping
  2. R web scraping across multiple pages
  3. Line Break in XML? [duplicate]
  4. Why are bullets not appearing on posts? [closed]
  5. What to do Regular expression pattern doesn’t match anywhere in string?
  6. Testing text() nodes vs string values in XPath
  7. Scraping data from website using vba
  8. Java HTML Parsing [closed]
  9. How can I find an element by CSS class with XPath?
  10. What is the best practice to parse html in swift?
  11. XPath to match @class value and element value?
  12. How to use XPath contains() for specific text?
  13. Scrape password-protected website in R
  14. Converting HTML to XML
  15. Space Before Closing Slash?
  16. White space inside XML/HTML tags
  17. XPath testing that string ends with substring?
  18. pandas read_html ValueError: No tables found
  19. Is it possible to have HTML text or CDATA inside an XML attribute?
  20. How to save a file from a website as PDF?
  21. R Markdown HTML Number Figures
  22. Is whitespace allowed within XML/HTML tags?
  23. including a interactive 3D figure with knitr
  24. HtmlAgilityPack Drops Option End Tags
  25. How to handle xml/html in git feature branch workflow?
  26. Using rvest or httr to log in to non-standard forms on a webpage
  27. Convert html to plain text in VBA
  28. How can you parse HTML in android?
  29. extract data from raw html in R
  30. Parse html using C

Leave a Comment