How to get bytes bigger than 1024 from int httpd_req_recv(httpd_req_t *r, char *buf, size_t buf_len) (IDFGH-14202)

[zzzh]

Answers checklist.

• I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
• I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
• I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report

I tried to set buf_len to 5120 or 10240 but useless, the return value is limited up to 1024.
How to change it?

[nileshkale123]

Hello @zzzh,

Could you kindly provide more details about what you aim to achieve by modifying buf_len? Additionally, it would be very helpful if you could share the patch file for the changes you've made related to this issue.

Please also share any relevant debug logs and examples of your modifications so that we can replicate and analyze the issue on our side.

Looking forward to your input!

[zzzh]

Hello, @nileshkale123,

I think increase the size of each transfer may speed up the whole upload progress, that's why.
I did not change anything and it works well except slow (need about 1 minute to transfer 1MB), by changing the transfer size from 1k to 10k, I hope it can have 10 times speed.

[nopnop2002]

@zzzh

There is no limit to the size of data received by httpd_req_recv.

The return value of httpd_req_recv is the actual number of bytes received.

When using a 2048-byte buffer, processing is performed in 2048-byte units as shown below.

W (36311) example: remaining=4576
W (36311) example: httpd_req_recv ret=2048
W (36311) example: httpd_req_recv ret=2048
W (36311) example: httpd_req_recv ret=480

When using a 4096-byte buffer, processing is performed in 4096-byte units as shown below.

W (13551) example: remaining=4576
W (13551) example: httpd_req_recv ret=4096
W (13551) example: httpd_req_recv ret=480

When using a 4096-byte buffer, a 1M byte transfer will complete in 1.5 second.

W (17061) example: received=1048576 elapsed time[ms]:1510

I used this to send.

curl -X POST --data-binary @1M.dummy  192.168.10.111/echo

There may be a problem on your sending side.

[zzzh]

@zzzh

There is no limit to the size of data received by httpd_req_recv.

The return value of httpd_req_recv is the actual number of bytes received.

When using a 2048-byte buffer, processing is performed in 2048-byte units as shown below.

W (36311) example: remaining=4576
W (36311) example: httpd_req_recv ret=2048
W (36311) example: httpd_req_recv ret=2048
W (36311) example: httpd_req_recv ret=480

When using a 4096-byte buffer, processing is performed in 4096-byte units as shown below.

W (13551) example: remaining=4576
W (13551) example: httpd_req_recv ret=4096
W (13551) example: httpd_req_recv ret=480

When using a 4096-byte buffer, a 1M byte transfer will complete in 1.5 second.

W (17061) example: received=1048576 elapsed time[ms]:1510

I used this to send.

curl -X POST --data-binary @1M.dummy  192.168.10.111/echo

There may be a problem on your sending side.

Hi, nopnop2002,

Good to know, what version of esp-idf did you test on?
I'm using v4.4.2, maybe too old.

[nopnop2002]

what version of esp-idf did you test on?

$ git describe --tags
v5.3.2-1-g9a6aba7401

[zzzh]

ok, I'll test it on the latest version.