[Zope3-dev] RFC: Make HTTP streaming of large data simpler

[Paul Winkler]

On Tue, Dec 06, 2005 at 12:01:37PM -0200, Sidnei da Silva wrote:
> On Tue, Dec 06, 2005 at 08:55:56AM -0500, Jim Fulton wrote:
> | Interesting.  I wasn't aware of this in Z2.  Zope 3 definately
> | doesn't have this.  Sindnei, have you verified that this actially
> | works in Z2?  I didn't think the Zope 2 publisher actually started
> | propducing output until the request was finished.
> 
> Yes, I can confirm it works like I described. I've been using and
> relying on this (where this == chunked response producing output
> before the request is finished) on Enfold Desktop for a while.

But, as Sidnei pointed out to me offlist, it's not as modular as a first
glance at the code would make one hope :-) From an offlist mesage:

> Actually, chunked_producer doesn't seem to be used, afaict. Chunking
> is inlined in the body of HTTPResponse.write(). That could really get
> some loving. I've recently added 'gzip' content-encoding to streamed
> content by hacking around the 'ChannelPipe' and it was a real pain to
> do gzip+chunked. Updating the compressed producer to add the missing
> zlib header + checksum and actually using those instead of hardcoding
> it all in ZServer would be very interesting.
>
> BUT, in the light of Zope 3 moving to twisted, and possibly Zope 2 at
> the time of Zope 2.11, maybe that's not worth the effort.

-- 

Paul Winkler
http://www.slinkp.com