Skip to content Skip to sidebar Skip to footer

How To Use Peewee With Scrapinghub

I want to save my data to remote machine by using peewee. When i run my crawler i found following error, File '/usr/local/lib/python2.7/site-packages/scrapy/commands/crawl.py', lin

Solution 1:

You cannot install module of your own choice on Scrapinhub ... You can only install MySQLDB as per my knowledge, to do that.

Create a file named scrapinghub.yml in your project's main folder with following contents.

projects:
  default: 111149
requirements:
  file: requirements.txt

Where 111149 is my proejct ID on scrapinghub.

Create another file named requirements.txt in same directory.

and put your required modules along with the version number you are using in that file like so,

MySQL-python==1.2.5

PS: I was using MySQLDB module so I put that.


Post a Comment for "How To Use Peewee With Scrapinghub"