convert streamed buffers to utf8-string

by

Single Buffer

If you have a single Buffer you can use its toString method that will convert all or part of the binary contents to a string using a specific encoding. It defaults to utf8 if you don’t provide a parameter, but I’ve explicitly set the encoding in this example.

var req = http.request(reqOptions, function(res) {
    ...

    res.on('data', function(chunk) {
        var textChunk = chunk.toString('utf8');
        // process utf8 text chunk
    });
});

Streamed Buffers

If you have streamed buffers like in the question above where the first byte of a multi-byte UTF8-character may be contained in the first Buffer (chunk) and the second byte in the second Buffer then you should use a StringDecoder. :

var StringDecoder = require('string_decoder').StringDecoder;

var req = http.request(reqOptions, function(res) {
    ...
    var decoder = new StringDecoder('utf8');

    res.on('data', function(chunk) {
        var textChunk = decoder.write(chunk);
        // process utf8 text chunk
    });
});

This way bytes of incomplete characters are buffered by the StringDecoder until all required bytes were written to the decoder.

More Related Contents:

  1. How would I create a for-loop in Node.js
  2. What is the –save option for npm install?
  3. Cannot overwrite model once compiled Mongoose
  4. ECONNREFUSED for Postgres on nodeJS with dockers
  5. ERR_HTTP_HEADERS_SENT: Cannot set headers after they are sent to the client
  6. Error handling with node.js streams
  7. How to separate routes on Node.js and Express 4?
  8. What is the difference between –save and –save-dev?
  9. TypeError: db.collection is not a function
  10. Extending TypeScript Global object in node.js
  11. Do I need dependency injection in NodeJS, or how to deal with …?
  12. Express command not found
  13. Username and Password not accepted when using nodemailer?
  14. Upgrading Node on an Azure website?
  15. npm ERR! network getaddrinfo ENOTFOUND
  16. Express doesn’t set a cookie
  17. How to server specifc static files with express.js
  18. How do I get a list of connected sockets/clients with Socket.IO?
  19. npm: When to use `–force` and `–legacy-peer-deps`
  20. Loop through an api get request with variable URL
  21. Why COPY package*.json ./ precedes COPY . .?
  22. Node Version Manager install – nvm command not found
  23. How can I save multiple documents concurrently in Mongoose/Node.js?
  24. Electron.remote is undefined
  25. What’s the maximum size of a Node.js Buffer
  26. How to detach a spawned child process in a Node.js script?
  27. How to get SCSS variables into react
  28. Read file from aws s3 bucket using node fs
  29. Express Router undefined params with router.use when split across files
  30. How do I uninstall nodejs installed from pkg (Mac OS X)?

Leave a Comment