JSoup character encoding issue

by

The charset attribute is missing in HTTP response Content-Type header. Jsoup will resort to platform default charset when parsing the HTML. The Document.OutputSettings#charset() won’t work as it’s used for presentation only (on html() and text()), not for parsing the data (in other words, it’s too late already).

You need to read the URL as InputStream and manually specify the charset in Jsoup#parse() method.

String url = "http://www.latijnengrieks.com/vertaling.php?id=5368";
Document document = Jsoup.parse(new URL(url).openStream(), "ISO-8859-1", url);
Element paragraph = document.select("div.kader p").first();

for (Node node : paragraph.childNodes()) {
    if (node instanceof TextNode) {
        System.out.println(((TextNode) node).text().trim());
    }
}

this results here in

Aeneas dwaalt rond in Troje en zoekt Creüsa.
Creüsa is echter op de vlucht gestorven
Plotseling verschijnt er een schim.
Het is de schim van Creüsa.
De schim zegt:'De oorlog woedt!'
Troje is ingenomen!
Creüsa is gestorven:'Vlucht!'
Aeneas vlucht echter niet.
Dan spreekt de schim:'Vlucht! Er staat jou een nieuw vaderland en een nieuw koninkrijk te wachten.'
Dan pas gehoorzaamt Aeneas en vlucht.

More Related Contents:

  1. can someone explain what this code is doing
  2. Jsoup Java HTML parser : Executing Javascript events
  3. How to “scan” a website (or page) for info, and bring it into my program?
  4. How do I preserve line breaks when using jsoup to convert html to plain text?
  5. jsoup posting and cookie
  6. How to connect via HTTPS using Jsoup?
  7. Problems submitting a login form with Jsoup
  8. Jsoup Cookies for HTTPS scraping
  9. Jsoup get dynamically generated HTML
  10. How to add proxy support to Jsoup?
  11. Sending POST request with username and password and save session cookie
  12. How to fill a form with Jsoup?
  13. How to parse XML with jsoup
  14. Jsoup connection with basic access authentication
  15. Can Jsoup simulate a button press?
  16. Android java.lang.NoClassDefFoundError: org.jsoup.Jsoup
  17. Getting Jsoup to support dynamically generated html by JavaScript
  18. Jsoup SocketTimeoutException: Read timed out
  19. How to post form login using jsoup?
  20. Android studio error in stack trace
  21. When should we use intern method of String on String literals
  22. Interfaces with static fields in java for sharing ‘constants’
  23. What is the point of setters and getters in java? [duplicate]
  24. Handling soft-deletes with Spring JPA
  25. BigInteger.pow(BigInteger)?
  26. Generating 8-character only UUIDs
  27. Difference between an application server and a servlet container?
  28. Java: Checking if a bit is 0 or 1 in a long
  29. Check if one list contains element from the other
  30. what is the best way to get a sub HashMap based on a list of Keys?

Leave a Comment