Pragmatic Unicode, or, How do I stop the pain?

Weeks ago while working on the @Covid19AO_Stats bot I ran into a problem related to the way Python processes text.

What helped understand what was happening was the presentation below.

https://nedbatchelder.com/text/unipain.html

This presentation, by Ned Batchelder, was the best one I found until now explaining the concepts related to ASCII, Unicode, UTF-8, the need for them and the process of encoding, decoding and string representation. Even though the presentation is Python focused, I am sure it will be helpful for any other programming languages too.

If you don’t like reading, have a look at the youtube video.

Leave a Reply

Your email address will not be published. Required fields are marked *