You can do this using LINQ, like this: var document = new HtmlWeb().Load(url); var urls = document.DocumentNode.Descendants(“img”) .Select(e => e.GetAttributeValue(“src”, null)) .Where(s => !String.IsNullOrEmpty(s)); EDIT: This code now actually works; I had forgotten to write document.DocumentNode.
I just spent hours trying to get HtmlAgilityPack to render some ajax dynamic content from a webpage and I was going from one useless post to another until I found this one. The answer is hidden in a comment under the initial post and I thought I should straighten it out. This is the method … Read more
You can directly grab the attribute if you use the HtmlNavigator instead. //Load document from some html string HtmlDocument hdoc = new HtmlDocument(); hdoc.LoadHtml(htmlContent); //Load navigator for current document HtmlNodeNavigator navigator = (HtmlNodeNavigator)hdoc.CreateNavigator(); //Get value from given xpath string xpath = “//div[@id=’topslot’]/a/img/@src”; string val = navigator.SelectSingleNode(xpath).Value;
HtmlAgilityPack.HtmlDocument doc = new HtmlAgilityPack.HtmlDocument(); doc.LoadHtml(html); doc.DocumentNode.Descendants() .Where(n => n.Name == “script” || n.Name == “style”) .ToList() .ForEach(n => n.Remove());
I wrote an algorithm based on Oded’s suggestions. Here it is. Works like a charm. It removes all tags except strong, em, u and raw text nodes. internal static string RemoveUnwantedTags(string data) { if(string.IsNullOrEmpty(data)) return string.Empty; var document = new HtmlDocument(); document.LoadHtml(data); var acceptableTags = new String[] { “strong”, “em”, “u”}; var nodes = new … Read more
There are a number of ways to select elements using the agility pack. Let’s assume we have defined our HtmlDocument as follows: string html = @”<TD class=texte width=””50%””> <DIV align=right>Name :<B> </B></DIV></TD> <TD width=””50%””> <INPUT class=box value=John maxLength=16 size=16 name=user_name> </TD> <TR vAlign=center>”; HtmlDocument htmlDoc = new HtmlDocument(); htmlDoc.LoadHtml(html); 1. Simple LINQ We could use … Read more
XPATH is your friend 🙂 HtmlDocument doc = new HtmlDocument(); doc.LoadHtml(@”<html><body><p>foo <a href=”http://www.example.com”>bar</a> baz</p></body></html>”); foreach(HtmlNode node in doc.DocumentNode.SelectNodes(“//text()”)) { Console.WriteLine(“text=” + node.InnerText); }
The expression you’re looking for is: //div[contains(@class, ‘class1’) and contains(@class, ‘class2’)] I highly suggest XPath visualizer, which can help you debug xpath expressions easily. It can be found here: http://xpathvisualizer.codeplex.com/
This is also reported in this workitem. It contains a suggested workaround from DarthObiwan. You can change this without recompiling. The ElementFlags list is a static property on the HtmlNode class. It can be removed with HtmlNode.ElementsFlags.Remove(“form”); before doing the document load
heh, apparently I ALMOST found an answer in a blog post someone made…. using System.Collections.Generic; using System.Linq; using HtmlAgilityPack; namespace Wayloop.Blog.Core.Markup { public static class HtmlSanitizer { private static readonly IDictionary<string, string[]> Whitelist; static HtmlSanitizer() { Whitelist = new Dictionary<string, string[]> { { “a”, new[] { “href” } }, { “strong”, null }, { “em”, … Read more