Python package scrapy-redis-expiredupefilter
A distributed crawler component based on scrapy_redis which can specify the expiration time of fingerprints in dupefilter.
Summary
| Count | 3 occurrences |
|---|---|
| State | Dead |
| Last occurred | |
| Habitening next | |
| Age | |
| Average | |
| Honeymoon | |
| Trend | None |
| In degree | 0 |
| Out degree | 8 |
| External links |