Gehe zu Anwendung: [
0
A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
Y
Z
]
Gehe zu RPM-Paket: [
3ABCDEFGHIJKLMNOPQRSTUVWXYZ
]
perl-WWW-RobotRules: database of robots.txt-derived permissions
 |
|
 |
|
 |
|
| (auf gut Glück) | |
(meist engl.) | |
(falls vorhanden) | |
- Zusammenfassung (meist engl.)
- This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at <http://www.robotstxt.org/wc/norobots.html> Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.
| Installieren: |
|
Status: |
|
Umfang: | 15 KiB |