You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "/home/zb/workpace/new/distribute_crawler-master/woaidu_crawler/woaidu_crawler/pipelines/mongodb_book_file.py", line 134, in process_item
dfd.addCallback(self.item_completed, item, info)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 306, in addCallback
callbackKeywords=kw)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 295, in addCallbacks
self._runCallbacks()
--- <exception caught here> ---
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "/home/zb/workpace/new/distribute_crawler-master/woaidu_crawler/woaidu_crawler/pipelines/mongodb_book_file.py", line 274, in item_completed
if self.item_download[item['original_url']]:
exceptions.KeyError: 'http://www.woaidu.org/book_196826.html'
错误二:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 839, in _cbDeferred
self.callback(self.resultList)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 382, in callback
self._startRunCallbacks(result)
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 490, in _startRunCallbacks
self._runCallbacks()
--- <exception caught here> ---
File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "/home/zb/workpace/new/distribute_crawler-master/woaidu_crawler/woaidu_crawler/pipelines/mongodb_book_file.py", line 132, in process_item
dlist = [self._process_request(r, info) for r in requests]
File "/usr/lib/pymodules/python2.7/scrapy/contrib/pipeline/media.py", line 53, in _process_request
if fp in info.downloaded:
exceptions.AttributeError: 'WoaiduSpider' object has no attribute 'downloaded'
The text was updated successfully, but these errors were encountered:
错误一:
错误二:
The text was updated successfully, but these errors were encountered: