HTTP Spy
The HTTP Spy can get 'raw' web pages from any web server running on any port.
It can handle HTTP and HTTPS
requests, request HEADs or GET
the entire html file. The user agent can be set to test the behavior when
pages are requested by different browsers or search engines.
Example
Camouflaging as Google Search Engine and requesting the homepage of Spiegel
Online:
Quering the ebay login page (without browser identifcation):
Quering the ebay login page (with IE identification):
(Some features are
.)