Support non-ascii characters

[GoogleCodeExporter]

First of all I really appreciate all the work you've done so far for this port.

The problem: When passing a string containing non-ascii characters the
tokenizer throws a `UnicodeEncodeError` at line 197.

I solved that with removing the `str`-cast in this line but perhaps you
want to do an instance check for `basestring` here.

BTW: It would be great if you could manage to implement the `jsexec` part
somehow... :)

Cheers

Sebastian

Original issue reported on code.google.com by [email protected] on 13 Dec 2009 at 1:42