[Wylug-help] http logging

[Gary Stainburn]

Hi folks.

I'm wanting to automate extracting data from a web site that requires a login 
dialog to be completed before the data is available.

I've tried playing with wget to try to simulate the conversation manually 
before looking at a perl or PHP script to automate the process.

However this isn't working, so I was wondering if there is an easy way to 
trace a http conversation.  The client has to be internet explorer as the 
first thing the web site does is check browser compatability.

As you can see from the script below I have tried to spoof IE by cut/pasting 
the string from an agent_log file on my server.

Anyone got suggestions on how to best do this.

Gary

wget	--keep-session-cookies		\
	--load-cookies cds.coolies	\
	--save-cookies cds.cookies	\
	--save-headers			\
	--user-agent "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 
1.1.4322; IEMB3; .NET CLR 2.0.50727; IEMB3)"	\
	--post-file post-file		\
	http://edealer.warley.fordstar.com/servlet/cds.login

-- 
Gary Stainburn
 
This email does not contain private or confidential material as it
may be snooped on by interested government parties for unknown
and undisclosed purposes - Regulation of Investigatory Powers Act, 2000