I’d look at using the Html Agility Pack.
Here’s an example straight from their examples page on how to find all the links in a page:
HtmlWeb hw = new HtmlWeb();
HtmlDocument doc = hw.Load(/* url */);
foreach(HtmlNode link in doc.DocumentNode.SelectNodes("//a[@href]"))
{
}