Fix SF bug #482171: webchecker dies on file: URLs w/o robots.txt
The cause seems to be that when a file URL doesn't exist, urllib.urlopen() raises OSError instead of IOError. Simply add this to the except clause. Not elegant, but effective. :-)
G
Guido van Rossum committed
f0953b9dff9a0cc08b6dcfe206047c0490e1d38a
Parent: 3a8e59e