You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

50 lines
2.8 KiB

  1. # Decode According to the WHATWG Encoding Standard
  2. This package provides a thin layer on top of [iconv-lite](https://github.com/ashtuchkin/iconv-lite) which makes it expose some of the same primitives as the [Encoding Standard](https://encoding.spec.whatwg.org/).
  3. ```js
  4. const whatwgEncoding = require("whatwg-encoding");
  5. console.assert(whatwgEncoding.labelToName("latin1") === "windows-1252");
  6. console.assert(whatwgEncoding.labelToName(" CYRILLic ") === "ISO-8859-5");
  7. console.assert(whatwgEncoding.isSupported("IBM866") === true);
  8. // Not supported by the Encoding Standard
  9. console.assert(whatwgEncoding.isSupported("UTF-32") === false);
  10. // In the Encoding Standard, but this package can't decode it
  11. console.assert(whatwgEncoding.isSupported("x-mac-cyrillic") === false);
  12. console.assert(whatwgEncoding.getBOMEncoding(new Buffer([0xFE, 0xFF])) === "UTF-16BE");
  13. console.assert(whatwgEncoding.getBOMEncoding(new Buffer([0x48, 0x69])) === null);
  14. console.assert(whatwgEncoding.decode(new Buffer([0x48, 0x69]), "UTF-8") === "Hi");
  15. ```
  16. ## API
  17. - `decode(buffer, fallbackEncodingName)`: performs the [decode](https://encoding.spec.whatwg.org/#decode) algorithm (in which any BOM will override the passed fallback encoding), and returns the resulting string
  18. - `labelToName(label)`: performs the [get an encoding](https://encoding.spec.whatwg.org/#concept-encoding-get) algorithm and returns the resulting encoding's name, or `null` for failure
  19. - `isSupported(name)`: returns whether the encoding is one of [the encodings](https://encoding.spec.whatwg.org/#names-and-labels) of the Encoding Standard, _and_ is an encoding that this package can decode (via iconv-lite)
  20. - `getBOMEncoding(buffer)`: sniffs the first 2–3 bytes of the supplied `Buffer`, returning one of the encoding names `"UTF-8"`, `"UTF-16LE"`, or `"UTF-16BE"` if the appropriate BOM is present, or `null` if no BOM is present
  21. ## Unsupported encodings
  22. Since we rely on iconv-lite, we are limited to support only the encodings that they support. Currently we are missing support for:
  23. - ISO-2022-JP
  24. - ISO-8859-8-I
  25. - replacement
  26. - x-mac-cyrillic
  27. - x-user-defined
  28. Passing these encoding names will return `false` when calling `isSupported`, and passing any of the possible labels for these encodings to `labelToName` will return `null`.
  29. ## Credits
  30. This package was originally based on the excellent work of [@nicolashenry](https://github.com/nicolashenry), [in jsdom](https://github.com/tmpvar/jsdom/blob/7ce11776ce161e8d5921a7a183585327400f786b/lib/jsdom/living/helpers/encoding.js). It has since been pulled out into this separate package.
  31. ## Alternatives
  32. If you are looking for a JavaScript implementation of the Encoding Standard's `TextEncoder` and `TextDecoder` APIs, you'll want [@inexorabletash](https://github.com/inexorabletash)'s [text-encoding](https://github.com/inexorabletash/text-encoding) package.