Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explosion in backup file size #976

Open
Nephilimi opened this issue Dec 6, 2024 · 7 comments
Open

Explosion in backup file size #976

Nephilimi opened this issue Dec 6, 2024 · 7 comments
Labels

Comments

@Nephilimi
Copy link

Earlier this week I noticed that the hydra2 web page was down and sonarr/radarr were complaining it wasn't available. I restarted the VM and shortly later sab notified me the disk was full. On further investigation I found what's in this picture. I cleaned out some of the larger big ones to get things running again.

I'm currently on 7.10.2 and I go in and hit update maybe once every couple weeks.

October backups seem reasonable, but something big happened in November.

nzbhydra-debuginfos-2024-12-06-09-51.zip

Screenshot 2024-12-06 at 9 27 24 AM
@Nephilimi Nephilimi added the bug label Dec 6, 2024
@theotherp
Copy link
Owner

theotherp commented Dec 7, 2024

How large is the database file in the data/database folder?

Also see #974

@Nephilimi
Copy link
Author

Right now

/opt/nzbhydra2/data/database$ ls -l -h
total 627M
-rw-r--r-- 1 nzbhydra2 nzbhydra2 627M Dec  7 05:06 nzbhydra.mv.db

Also I made a backup yesterday afternoon and it was a "normal" 250MB vs the one in the morning being 4x the size?

/opt/nzbhydra2/data/backup$ ls -l -h
total 7.3G
-rw-r--r-- 1 nzbhydra2 nzbhydra2  290M Oct 17 10:41 'nzbhydra-2024-10-17 10-40-39.zip'
-rw-r--r-- 1 nzbhydra2 nzbhydra2  307M Oct 24 10:46 'nzbhydra-2024-10-24 10-46-03.zip'
-rw-r--r-- 1 nzbhydra2 nzbhydra2  323M Oct 31 10:52 'nzbhydra-2024-10-31 10-51-31.zip'
-rw-r--r-- 1 nzbhydra2 nzbhydra2  1.1G Dec  4 14:05 'nzbhydra-2024-12-04 14-03-08.zip'
-rw-r--r-- 1 nzbhydra2 nzbhydra2 1012M Dec  6 09:34 'nzbhydra-2024-12-06 09-31-49.zip'
-rw-r--r-- 1 nzbhydra2 nzbhydra2  243M Dec  6 21:14 'nzbhydra-2024-12-06 21-13-53.zip'
-rw------- 1 nzbhydra2 nzbhydra2  4.2G Nov 21 12:43  zipfstmp3729379435280921705.tmp

Not sure what the temp file is either?

@burntoc
Copy link

burntoc commented Dec 11, 2024

I'm seeing the same here (the log file growth, not the temp file).

@Buttonskill
Copy link

+1 to this. 10GB db file and 4x 4GB plus backups.

@theotherp
Copy link
Owner

I'm working on it but need to wait for an update by the database programmers.

You can try setting the retention time in the main config (enabled advanced options) to 0. This increases the risk of corrupted databases, though. I have no way of knowing by how much. If the database is corrupted you lose history and stats but no settings and can restore from the latest backup.

@theotherp
Copy link
Owner

It would also help to see the file listing of the content of one of the backup.zips.

@Nephilimi
Copy link
Author

Sure.
Screenshot 2024-12-12 061112

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants