High memory usage when downloading

[Tokariew]

I was downloading my games using this script, but my linux box was reporting quite high memory usage. Like in the range of 10GB+. Are downloaded files being saved periodically on the disk, or keeped in the RAM? For windows files are split into 4GB chunks by GoG, but some of Linux games are over 20GB in size for single file.

[Kalanyr]

The writes for files are mostly handled by Pythons default stream flushing logic, there's nothing deliberately keeping files in memory for like performance reasons or anything*.

Resuming incomplete downloads might result in some pretty large loads though, because it reads in chunks to check if they were correctly downloaded before, but it should only be reading as needed.

Likewise calculating the MD5s for verification can result in some large reads, but those should also be done in chunks rather than all at once for large files.

*I have noticed that as of Python 3.7ish , that Python seems to be flush to disk less, if this is proving a problem, I can probably force flushes a bit more aggressively.