I had a similar problem and had to convert the URL from string to Uri object using: Uri myUri = new Uri(URLInStringFormat, UriKind.Absolute); (URLInStringFormat is your URL) Try to connect using the Uri instead of the string as: WebClient client = new WebClient(); client.OpenRead(myUri);
Just add a simple line before you make your download: string url = … string fileName = … WebClient wb = new WebClient(); wb.Headers.Add(“User-Agent: Other”); //that is the simple line! wb.DownloadFile(url, fileName); That’s it.
What I have done is populate a Queue containing all my urls, then I download each item in the queue. When there are no items left, I can then process all the items. I’ve mocked some code up below. Keep in mind, the code below is for downloading strings and not files. It shouldn’t be … Read more
I’ve just tried it with Fiddler running to see the response and it returns the following notice with the status code. Scripts should use an informative User-Agent string with contact information, or they may be IP-blocked without notice. This works. WebClient webClient = new WebClient(); webClient.Headers.Add(“user-agent”, “Only a test!”); string content = webClient.DownloadString(“http://he.wikisource.org/wiki/%D7%A9%D7%95%D7%9C%D7%97%D7%9F_%D7%A2%D7%A8%D7%95%D7%9A_%D7%90%D7%95%D7%A8%D7%97_%D7%97%D7%99%D7%99%D7%9D_%D7%90_%D7%90”);
If you are working with .NET 4.5 or later, consider using the System.Net.Mime.ContentDisposition class: string cpString = wc.ResponseHeaders[“Content-Disposition”]; ContentDisposition contentDisposition = new ContentDisposition(cpString); string filename = contentDisposition.FileName; StringDictionary parameters = contentDisposition.Parameters; // You have got parameters now Edit: otherwise, you need to parse Content-Disposition header according to it’s specification. Here is a simple class that … Read more
You are right WebClient does not support this. You can use HttpWebRequest and set the method to HEAD if you want this functionality: System.Net.WebRequest request = System.Net.WebRequest.Create(uri); request.Method = “HEAD”; request.GetResponse();
Try this: $ftp = [System.Net.FtpWebRequest]::Create(“ftp://username:[email protected]/camera/temp.jpg”) $ftp.KeepAlive = $true $ftp.UsePassive = $true $ftp.Method = “Rename” $ftp.RenameTo = “camera/temp1.jpg” $ftp.UseBinary = $true $response = [System.Net.FtpWebResponse] $ftp.GetResponse()
Yes, there is a limit. The default connection limit is 2 concurrent connections per remote host. This can be overridden. For example, I believe that ASP.NET by default overrides the default to be 10 connections per remote host. From https://msdn.microsoft.com/en-us/library/7af54za5.aspx: The number of connections between a client and server can have a dramatic impact on … Read more
Usage : CookieContainer cookieJar = new CookieContainer(); cookieJar.Add(new Cookie(“my_cookie”, “cookie_value”, “/”, “mysite”)); CookieAwareWebClient client = new CookieAwareWebClient(cookieJar); string response = client.DownloadString(“http://example.com/response_with_cookie_only.php”); public class CookieAwareWebClient : WebClient { public CookieContainer CookieContainer { get; set; } public Uri Uri { get; set; } public CookieAwareWebClient() : this(new CookieContainer()) { } public CookieAwareWebClient(CookieContainer cookies) { this.CookieContainer = cookies; … Read more
You can check if the error is of type WebException and then inspect the response code; if (e.Error.GetType().Name == “WebException”) { WebException we = (WebException)e.Error; HttpWebResponse response = (System.Net.HttpWebResponse)we.Response; if (response.StatusCode==HttpStatusCode.NotFound) System.Diagnostics.Debug.WriteLine(“Not found!”); } or try { // send request } catch (WebException e) { // check e.Status as above etc.. }