PHP package spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
Summary
Count | 13 occurrences |
---|---|
State | Dead |
Last occurred | |
Habitening next | |
Age | |
Average | |
Honeymoon | |
Trend | None |
In degree | 5 |
Out degree | 37 |
External links |