Likely, your problem is that you parsed it okay, and now you’re trying to print the contents of the XML and you can’t because theres some foreign Unicode characters. Try to encode your unicode string as ascii first: unicodeData.encode(‘ascii’, ‘ignore’) the ‘ignore’ part will tell it to just skip those characters. From the python docs: … Read more
I’ve read this question long time ago, and finished writing my own pretty-printer for tables: tabulate. My use case is: I want a one-liner most of the time which is smart enough to figure the best formatting for me and can output different plain-text formats Given your example, grid is probably the most similar output … Read more
If you have iconv installed, try this (the example assumes your input string is in UTF-8): echo iconv(‘UTF-8’, ‘ASCII//TRANSLIT’, $string); (iconv is a library to convert between all kinds of encodings; it’s efficient and included with many PHP distributions by default. Most of all, it’s definitely easier and more error-proof than trying to roll your … Read more
…there’s a reason they’re called “encodings”… A little preamble: think of unicode as the norm, or the ideal state. Unicode is just a table of characters. №65 is latin capital A. №937 is greek capital omega. Just that. In order for a computer to store and-or manipulate Unicode, it has to encode it into bytes. … Read more
Thanks to bits and pieces from various replies, I think we can stitch up an explanation. By trying to print an unicode string, u’\xe9′, Python implicitly try to encode that string using the encoding scheme currently stored in sys.stdout.encoding. Python actually picks up this setting from the environment it’s been initiated from. If it can’t … Read more
[u’ABC’] would be a one-element list of unicode strings. Beautiful Soup always produces Unicode. So you need to convert the list to a single unicode string, and then convert that to ASCII. I don’t know exaxtly how you got the one-element lists; the contents member would be a list of strings and tags, which is … Read more
Very simple. Just cast your char as an int. char character=”a”; int ascii = (int) character; In your case, you need to get the specific Character from the String first and then cast it. char character = name.charAt(0); // This gives the character ‘a’ int ascii = (int) character; // ascii is now 97. Though … Read more
>>> u’aあä’.encode(‘ascii’, ‘ignore’) ‘a’ Decode the string you get back, using either the charset in the the appropriate meta tag in the response or in the Content-Type header, then encode. The method encode(encoding, errors) accepts custom handlers for errors. The default values, besides ignore, are: >>> u’aあä’.encode(‘ascii’, ‘replace’) b’a??’ >>> u’aあä’.encode(‘ascii’, ‘xmlcharrefreplace’) b’aあä’ >>> u’aあä’.encode(‘ascii’, … Read more
I think you are not asking the right question– A string in python has no property corresponding to ‘ascii’, utf-8, or any other encoding. The source of your string (whether you read it from a file, input from a keyboard, etc.) may have encoded a unicode string in ascii to produce your string, but that’s … Read more
You can filter all characters from the string that are not printable using string.printable, like this: >>> s = “some\x00string. with\x15 funny characters” >>> import string >>> printable = set(string.printable) >>> filter(lambda x: x in printable, s) ‘somestring. with funny characters’ string.printable on my machine contains: 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ !”#$%&\'()*+,-./:;<=>?@[\\]^_`{|}~ \t\n\r\x0b\x0c EDIT: On Python 3, filter will … Read more