feedjack crash on non-ascii character

[GoogleCodeExporter]

What steps will reproduce the problem?
1. Try to fetch a livejournal.com's feed with non-english content.

What is the expected output? What do you see instead?

Just this traceback. I don't reveal the wrong feed because it's not mine, 
and I don't know if the blog's author want to be know.

[17] ! -------------------------
['Traceback (most recent call last):\n', '  File "/usr/lib/python2.4/site-
packages/Feedjack-0.9.16-py2.4.egg/EGG-INFO/scripts/feedjack_update.py", 
line 378, in process_feed_wrapper\n    ret_feed, ret_entries = 
pfeed.process()\n', '  File "/usr/lib/python2.4/site-packages/Feedjack-
0.9.16-py2.4.egg/EGG-INFO/scripts/feedjack_update.py", line 305, in 
process\n    postdict = dict([(post.guid, post)\n', '  File 
"/usr/lib/python2.4/site-packages/django/db/models/query.py", line 179, in 
_result_iter\n    self._fill_cache()\n', '  File "/usr/lib/python2.4/site-
packages/django/db/models/query.py", line 612, in _fill_cache\n    
self._result_cache.append(self._iter.next())\n', '  File 
"/usr/lib/python2.4/site-packages/django/db/models/query.py", line 269, in 
iterator\n    for row in self.query.results_iter():\n', '  File 
"/usr/lib/python2.4/site-packages/django/db/models/sql/query.py", line 206, 
in results_iter\n    for rows in self.execute_sql(MULTI):\n', '  File 
"/usr/lib/python2.4/site-packages/django/db/models/sql/query.py", line 
1720, in execute_sql\n    return list(result)\n', '  File 
"/usr/lib/python2.4/site-packages/django/db/models/sql/query.py", line 
1714, in <lambda>\n    result = iter((lambda: 
cursor.fetchmany(GET_ITERATOR_CHUNK_SIZE)),\n', '  File 
"/usr/lib/python2.4/site-packages/django/db/backends/util.py", line 53, in 
typecast_date\n    return s and datetime.date(*map(int, s.split(\'-\'))) or 
None # returns None if s is null\n', "OperationalError: Could not decode to 
UTF-8 column 'title' with text '-\xa4\xd5'\n"]
Traceback (most recent call last):
  File "/usr/lib/python2.4/site-packages/Feedjack-0.9.16-py2.4.egg/EGG-
INFO/scripts/feedjack_update.py", line 378, in process_feed_wrapper
    ret_feed, ret_entries = pfeed.process()
  File "/usr/lib/python2.4/site-packages/Feedjack-0.9.16-py2.4.egg/EGG-
INFO/scripts/feedjack_update.py", line 305, in process
    postdict = dict([(post.guid, post)
  File "/usr/lib/python2.4/site-packages/django/db/models/query.py", line 
179, in _result_iter
    self._fill_cache()
  File "/usr/lib/python2.4/site-packages/django/db/models/query.py", line 
612, in _fill_cache
    self._result_cache.append(self._iter.next())
  File "/usr/lib/python2.4/site-packages/django/db/models/query.py", line 
269, in iterator
    for row in self.query.results_iter():
  File "/usr/lib/python2.4/site-packages/django/db/models/sql/query.py", 
line 206, in results_iter
    for rows in self.execute_sql(MULTI):
  File "/usr/lib/python2.4/site-packages/django/db/models/sql/query.py", 
line 1720, in execute_sql
    return list(result)
  File "/usr/lib/python2.4/site-packages/django/db/models/sql/query.py", 
line 1714, in <lambda>
    result = iter((lambda: cursor.fetchmany(GET_ITERATOR_CHUNK_SIZE)),
  File "/usr/lib/python2.4/site-packages/django/db/backends/util.py", line 
53, in typecast_date
    return s and datetime.date(*map(int, s.split('-'))) or None # returns 
None if s is null
OperationalError: Could not decode to UTF-8 column 'title' with text '-¤Õ'
[17] ! -------------------------
Traceback (most recent call last):
  File "/usr/bin/feedjack_update.py", line 5, in ?
    pkg_resources.run_script('Feedjack==0.9.16', 'feedjack_update.py')
  File "/usr/lib/python2.4/site-packages/setuptools-0.6c8-
py2.4.egg/pkg_resources.py", line 448, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/usr/lib/python2.4/site-packages/setuptools-0.6c8-
py2.4.egg/pkg_resources.py", line 1166, in run_script
    execfile(script_filename, namespace, namespace)
  File "/usr/lib/python2.4/site-packages/Feedjack-0.9.16-py2.4.egg/EGG-
INFO/scripts/feedjack_update.py", line 505, in ?
    main()
  File "/usr/lib/python2.4/site-packages/Feedjack-0.9.16-py2.4.egg/EGG-
INFO/scripts/feedjack_update.py", line 489, in main
    disp.add_job(feed)
  File "/usr/lib/python2.4/site-packages/Feedjack-0.9.16-py2.4.egg/EGG-
INFO/scripts/feedjack_update.py", line 370, in add_job
    self.process_feed_wrapper(feed)
  File "/usr/lib/python2.4/site-packages/Feedjack-0.9.16-py2.4.egg/EGG-
INFO/scripts/feedjack_update.py", line 394, in process_feed_wrapper
    prints(u'[%d] Processed %s in %s [%s] [%s]%s' % (
  File "/usr/lib/python2.4/site-packages/Feedjack-0.9.16-py2.4.egg/EGG-
INFO/scripts/feedjack_update.py", line 397, in <generator expression>
    u' '.join(u'%s=%d' % (self.entry_trans[key],
KeyError: 0

What version of the product are you using? On what operating system?
$ django-admin.py --version
1.0-final-SVN-unknown
and
feedjack 0.9.16

Please provide any additional information below.

Original issue reported on code.google.com by [email protected] on 28 Feb 2009 at 2:17