how to upload the request file to another url

[fuch...@gmail.com]

Hey,

suppose the server got a big uploaded file from the client, and the server forward the uploaded file to another url with some extra data.

the handler:

async def test(request):

    mr = await request.multipart()

    post = {}

    while True:

        part = await mr.next()

        if part is None: break

        if 'file' == part.name:

            data = {'foo': 'bar', 'file': part.read()}

            async with aiohttp.ClientSession() as s:

                async with s.post(another_url, data = data) as r:

                    return web.json_response(await r.json())

if the file is very big, the handler will use too much memory, I have saw streaming uploads here: http://aiohttp.readthedocs.io/en/stable/client.html 

@aiohttp.streamer
def file_sender(writer, file_name=None):
    with open(file_name, 'rb') as f:
        chunk = f.read(2**16)
        while chunk:
            yield from writer.write(chunk)
            chunk = f.read(2**16)

# Then you can use `file_sender` as a data provider:

async with session.post('http://httpbin.org/post',
                        data=file_sender(file_name='huge_file')) as resp:
    print(await resp.text())

but how can i add some extra fields in the data?

[Nikolay Kim]

You can construct FormData object, individual multipart items could be part of this form data object. Then you pass form data instance to client call as data parameter

--
You received this message because you are subscribed to the Google Groups "aio-libs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to aio-libs+u...@googlegroups.com.
To post to this group, send email to aio-...@googlegroups.com.
Visit this group at https://groups.google.com/group/aio-libs.
To view this discussion on the web visit https://groups.google.com/d/msgid/aio-libs/724cc94d-79b9-4d06-8f62-8a158abca599%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[fuch...@gmail.com]

thanks kim, is there any way to write raw stream multipart request with multiple params for aiohttp client?

[fuch...@gmail.com]

It's something like http://aiohttp.readthedocs.io/en/stable/client.html#streaming-uploads but streaming upload multiple files. how can i do that with aiohttp? thanks

On Wednesday, April 26, 2017 at 10:46:26 AM UTC+8, Nikolay Kim wrote:

[Nikolay Kim]

Something like this should work

  session.post(“some url”, data=aiohttp.FormData({‘filename’: open(f1), ‘filename2’: open(f2)})

FormData can accept items from request.multipart()

To view this discussion on the web visit https://groups.google.com/d/msgid/aio-libs/bdd91f46-dcda-4636-8900-648b42cf872e%40googlegroups.com.

[hasan...@gmail.com]

[Andrew Svetlov]

use multipart sender: https://docs.aiohttp.org/en/stable/multipart.html#sending-multipart-requests

To view this discussion on the web visit https://groups.google.com/d/msgid/aio-libs/bdd91f46-dcda-4636-8900-648b42cf872e%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

Andrew Svetlov