file upload, how to handle big files?

[Timuçin Kızılay]

I'm trying to make file upload in my application.
uploading small txt files is ok but uploading big files is a problem.
When I try to upload very big files, it takes lots of memory and take
too much time.
the application is an inhouse application that will be used in the local
office network with gigabits connection and user will upload files by
1-2 GB's of size. any recipe to do this?

I'm googling for this but only so far theres one complete example code
by mengu.
http://www.mengu.net/post/turbogears-file-uploads
this is ok for small files but not ok for big files so I'm stuck.

[Martin Eliasson]

Many http servers aren't made for uploading Gb of data.

If memory serves me correct, Apache http server will store the whole upload in-memory because it's handle-mechanism may need to restart parsing of the incoming request (including the 2gb of data) at any time.

I don't know about other http-servers.

If I were facing such a problem, I would look at some upload-manager solution becuse as data size grows, the need for restarting of partial upload (and download) becomes more important. See apache mod_xsendfile for some discussion on this.

If you can't find an upload manager, hack one. We all need one :)

/Martin

2012/2/3 Timuçin Kızılay <t...@savaskarsitlari.org>

--
You received this message because you are subscribed to the Google Groups "TurboGears" group.
To post to this group, send email to turbo...@googlegroups.com.
To unsubscribe from this group, send email to turbogears+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/turbogears?hl=en.

--
Martin Eliasson
+46 (0) 739 97 87 33
http://asplunden.org

[Diez B. Roggisch]

Hi,

we created and use this:

 http://hg.ableton.com/abl.formstream/

Comes with some examples. Let me know if it helps you.

Diez

--
You received this message because you are subscribed to the Google Groups "TurboGears" group.
To post to this group, send email to turbo...@googlegroups.com.

To unsubscribe from this group, send email to turbogears+...@googlegroups.com.