scrapy
Scrapy: use a different .cfg file
By default Scrapy uses scrapy.cfg in the projects root. Is there a way to t开发者_如何学Pythonell it to use a different .cfg file? No this is the default behavior.See this source. As v01d said there\[详细]
2023-04-12 19:24 分类：问答Scrapy "parse" function not being executed
I have started to use scrapy on Ubuntu 11, and facing issue. Specifically the parse function in the following code does not execute, although the terminal shows开发者_如何学运维 the spider executed an[详细]
2023-04-06 04:11 分类：问答scrapy is using HTTP 1.0 by default
It looks like Scrapy is using HTTP 1.0 by default. Is there a setting to make it us开发者_运维问答e HTTP 1.1 to send request?[详细]
2023-04-03 22:57 分类：问答Serve anoher server from subdomain
on my root server http://my.root.ip I have a scrapy server running at http://my.root.ip:6800. I want to make http://my.root.ip:6800 accessable from a subdomain like http://scrapy.mydomain.com.[详细]
2023-04-03 08:46 分类：问答How to capture a number of divs/ tables at once
I am using Scrapy with the following url: http://www.marzetti.com/products/marzetti/detail.php?bc=35&cid=2&pid=1101&i=pl[详细]
2023-04-02 07:28 分类：问答Set up Scrapy framework to run on Python 2.7
Is it possible to select which version of Python is used by Scrapy?I am running Scrapy on Ubuntu 10.04 which ships with Python 2.6.I have Python 2.7 installed on my machine and would like to take adva[详细]
2023-04-02 04:38 分类：问答how to use scrapy to simulate login done through POST request (encoded)
Is it possible to开发者_JS百科 simulate login on site like www.eoddata.com with scrapy? The website use a post request to submit login information.http://readthedocs.org/docs/scrapy/en/latest/topics/r[详细]
2023-03-30 12:18 分类：问答Extracting data from an html path with Scrapy for Python
Overview of my project: I\'m trying to create a simple script in python 2.6 that will get traffic time data from Bing Maps.The Scrapy library module package (scrapy.org/) is what I\'m using to crawl[详细]
2023-03-28 21:18 分类：问答Problem logging into Facebook with Scrapy
(I have asked this question on the Scrapy google-group without luck.) I am trying to log into Facebook using Scrapy. I tried the following in the interactive shell:[详细]
2023-03-28 13:14 分类：问答Can't get Scrapy to follow links
I am trying to scrape a website but I can\'t get scrapy to follow links and I don\'t get any Python errors and I see nothing going on with Wireshark. I thought it could be the regex but I tried \".*\"[详细]
2023-03-28 07:12 分类：问答
加载中,请稍侯......