I’m developing a service app that will require to navigate web pages. Traditionally, I’d go through the hoops of sniffing the HTTP traffic, parsing the HTML results with HtmlAgilityPack, re-creating the HTTP traffic, etc. It’s becoming a bit of work. I’m trying out using Form components such as WebBrowser and DotNetBrowser but it doesn’t feel “elegant nor clean”. I’m worried that since these components were designed for UI apps, that perhaps one day the app may stop working due to a dialog box popping up or something.
Anyone know a library that can do all of the above and just allow me to extract the HTML page once I hit a certain point?
Thanks for your help.