Web Data Extraction with Scrapy

0

Up .. Next guys ... I am writing a code with Framework scrapy to fetch and extract some data. I'm new to this! The following code would theoretically have to fetch and extract, but it does not extract the data when I run it. I'm using the class item that exists inside the items file. The issue is that the code does not report execution error, in the cmd appears the information of the requests made and tals, but does not download the data and neither saves. If anyone can help me and give me a light I will be grateful.

    
asked by anonymous 05.07.2017 / 04:12

1 answer

0

Hello, try to run the command:

scrapy crawl pensador -o pensador.json

It will save the data in a JSON.

But the most correct way to do this is to treat crawled data in pipelines.py

There you can save to the database. Take a look at the documentation: link

    
15.11.2017 / 17:39