Memory exhausted when downloading zipped folder

Connecting to File Storage
1

Hi all,

When downloading a folder from an external S3 file via REST API (GET api/v2/s3/my_folder/?api_key=...&session_token=...&zip=true), the following error is displayed on the server log:

local.ERROR: exception 'Symfony\Component\Debug\Exception\FatalErrorException' with message 'Allowed memory size of 201326592 bytes exhausted (tried to allocate 9199775 bytes)' in /opt/bitnami/apps/dreamfactory/htdocs/vendor/guzzlehttp/psr7/src/Stream.php:94
Stack trace:
#0 {main}

The folder contains around 200MB of image files. It looks like all the files where loaded into memory, which I guess makes downloading large folders very difficult.

I don’t think increasing the available memory in php.ini is scalable.
Any other idea on how to make this work for large folders?

Thanks

2

@rbarriuso have you attempted to increase available PHP memory in the php.ini? There are some other ways to optimize memory settings including swap files and Apache memory limits. Which DF version are you using and how have you installed?

3

Yes, we’ve tried to increase the memory in php.ini but it never seems to be enough.

We’re using DF 2.2.0 from Bitnami installer.

4

Any other idea on how to make this work for large folders?