SoFunction
Updated on 2024-11-13

Installation of scrapy-1.1 on win10 system

0. Environmental description

win10 64bit, the computer is also 64bit processor, the computer is equipped with vs2010 64bit, but in order to be on the safe side, only experimented with the 32bit installation, when there is time, then try the 64bit installation. If there is no special instructions, all operations are executed at the windows command line. The computer also needs to be connected to the Internet, because pip in the installation of packages, you need to download the relevant packages online.

1. Install python

I'm using win32-python-2.7.12, please remember to use a version higher than .10 or higher, because I seem to remember that by the time I installed pip, it had to be .8 or higher.

Then is to configure the relevant environment variables into the path path, do not understand please Google, the result is illustrated in yellow below.

2. Install pip

strike (on the keyboard)/pypi/pip downloadingpip-6.1. (md5, pgp)

Unzip the folder and execute:python install

3. Install lxml

lxml is a library written in Python that allows for fast and flexible XML processing. select the corresponding Python version to install. ;

Installation commands:pip install lxml

Verify that the installation was successful see below:

4. Installation

pip install

5. Install Twisted

Twisted is an event-driven web-based engine framework implemented in Python. installation commands:

pip install twisted

I had a problem when I switched:

error: Microsoft Visual C++ 9.0 is required (Unable to find ). Get it from /vcpython27

The solution is as follows:

Execute the following command based on the version of Visual Studio installed:

Visual Studio 2010 (VS10):SET VS90COMNTOOLS=%VS100COMNTOOLS%

Visual Studio 2012 (VS11):SET VS90COMNTOOLS=%VS110COMNTOOLS%

Visual Studio 2013 (VS12):SET VS90COMNTOOLS=%VS120COMNTOOLS%

Visual Studio 2015 (VS14):SET VS90COMNTOOLS=%VS140COMNTOOLS%

Then re-execute it:

pip install twisted

Ready to go.

6. Installing pyOpenSSL

pip install pyopenssl

7. Install win32py

Provide win32api, click/projects/pywin32/files/pywin32/downloading

pywin32-220.win32-py2. and click Install.

8. Install scrapy

pip install scrapy

9. Test if scrapy is available:

Installation is complete, so start using it!

Haha ......