I have an odd problem and hoping someone may have come across this before. I have created a web parser in C# using the same method as THIS example. I am currently testing my code by grabbing a few URLs I thought of off the top of my head. It works for most of them but there are two that are failing with different exceptions. I'm dumping my exceptions to a log file:
WebException Raised. The following error occured : Timeout for URL http://www.digg.com.
WebException Raised. The following error occured : ProtocolError for URL http://www.hotmail.com.
I know both these sites are up and running and this is consistent
is it possible these websites are not letting me grab their data because its not through a browser?
thanks in advance,