[Gllug] Caching youtube videos

Nix nix at esperi.org.uk
Mon Oct 6 19:41:09 UTC 2008


On 6 Oct 2008, Peter Corlett uttered the following:

> On Thu, Oct 02, 2008 at 09:22:49PM +0100, Nix wrote:
> [...]
>> Of course this just goes to show that you should be using Polipo instead
>> ;}
>
> Is there any way to configure it to log requests? That's rather more useful
> information than chatter about Etag: and Vary: headers and whatnot.

Yes, but it's a debugging option so requires a recompile (on the basis
that it's both a privacy violation and somewhat incoherent because
clients can often request things and then change their mind immediately
afterwards, request parts of things, and so on and so forth ad
nauseam). Change LOGGING_MAX in log.h to 0xFFFFFFFF, and then you can
set logLevel to something like, say, 2055 (that's 0x807,
L_ERROR|L_WARN|L_INFO|D_CLIENT_REQ).

If you're using the syslog output, this will get logged at debugging
priority: feel free to add entries to the array in translatePriority()
in log.c to change this. (This part of Polipo isn't as configurable as
I'd like.)

(Note that Polipo can cache *parts* of server responses, so it can
remember bits of large requests that were later interrupted or timed
out. This might throw off your tracking, most caching proxies can't do
it :) )

> (Also, before I go and test it, can I use it as a iptables-enforced
> transparent proxy? It'd be nice to cache more of my home traffic and not
> just the stuff that can be configured to use a proxy.)

No, Juliusz has been scathing about transparent proxies in the past and
is unlikely to change his tune :) parroting his words, in effect you
*cannot* do HTTP proxying reliably without application knowledge:
proxying changes the semantics of a number of things and can't be
transparently interposed reliably. (The polipo list archives have more
on this.)

Sorry :(

(what things can't be configured to use a proxy? I haven't seen anything
in years.)

-- 
`Not even vi uses vi key bindings for its command line.' --- PdS
-- 
Gllug mailing list  -  Gllug at gllug.org.uk
http://lists.gllug.org.uk/mailman/listinfo/gllug




More information about the GLLUG mailing list