[SOLVED] 19.1.7 update fails - disk full

Started by chemlud, May 05, 2019, 03:18:28 PM

Previous topic - Next topic
May 05, 2019, 03:18:28 PM Last Edit: May 20, 2019, 12:08:11 PM by franco
Hi!

Tryingto update a 4GB Cf-card install of 386 nano (currently on 19.1.4), but after downloading all updates the install process gives "disk full" and update fails...

Any ideas?
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

Tried 4-5 more times, always stops with disk full when installing ruby. But in Dashboard disk is only 33% used. Very strange.
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

The packages are compressed. Did you try to download and extract the ruby package on other pc? Is the extracted size + the size of all downloaded update packages smaller than your free diskspace?
Intel(R) Xeon(R) Silver 4116 CPU @ 2.10GHz (24 cores)
256 GB RAM, 300GB RAID1, 3x4 10G Chelsio T540-CO-SR

May 05, 2019, 06:08:08 PM #3 Last Edit: May 05, 2019, 06:16:17 PM by chemlud
32% of 4 GB means roughly 2.6 GB free, do you really think there are packages of that size?

Additional info:

RAM = 2 GB

/var is on disk, /temp in RAM

I tried to reboot the system with /var in RAM, but it never came back (mixed system, as some updates had been done already). Have a dd-copy of the functional card (before updating) and now I'm ready for next try. Better to have /var and /temp in memory?
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

...total download for this update is 163 MiB, so not really sure there will be coming out something with more than 1 GiB size?
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

Next try with /var  and /tmp in RAM, same result:
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

Uh, oh: https://github.com/opnsense/changelog/blob/9473107466ada781911c6a9a8c353f9c8ee9ee9c/doc/19.1/19.1.7#L11-L14

If you have ruby try to deinstall the plugins using it to salvage a bit of free space first. Then upgrade and try to reinstall the plugins:

$ git grep 'PLUGIN_DEPENDS.*ruby'
benchmarks/iperf/Makefile:PLUGIN_DEPENDS=               iperf3 ruby
net/frr/Makefile:PLUGIN_DEPENDS=                frr6 ruby
security/tor/Makefile:PLUGIN_DEPENDS=           tor ruby

It might be that pkg does something weird in /var and /tmp so the best option is to *not* use RAM MFS in these scenarios, because 1G may be a bit small...


Cheers,
Franco

Plugins can be uninstalled how? :-)
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

FYI
My x64 Nano OPNsense (Intel Atom D525, 2 GB RAM, 8 GB CF-Card) updated without any problems to 19.1.7.

  • /var and /tmp in RAM
  • only ftpproxy-plugin installed



May 06, 2019, 11:21:17 AM #9 Last Edit: May 06, 2019, 11:25:14 AM by chemlud
...so only apparent difference is size of CF-card? (and 64bit board)

But as the little machines are end-of-life for opnsense by the end of the year I don't want to buy larger cards now. Don't use CF-cards anymore in other devices.
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

May 06, 2019, 11:42:25 AM #10 Last Edit: May 06, 2019, 12:34:13 PM by chemlud
@franco

dyndns, tucan and wol ar the only plugins installed by me on this system. No way to remove any preinstalled plugins, or?

PS: Tried with /var and /tmp on disk, not in RAM, same result....
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

You're probably out of inodes, like me. df -ih

dmesg should show something to the effect of: pid 62215 (pkg-static), uid 0 inumber 16868 on : out of inodes

Nano install, 4GB disk. This is irritating to say the least...

Pretty sure we cannot expand this, even in single user mode. Best course of action here, devs?

Is it possible to specify inodes at some point in the ISO installer? Or does the ISO installer format with more UFS inodes by default than the NANO disk image was created with?

Please, please bump up the inode count in the NANO image :P ;) I have 1 plugin installed, DynDNS. Can't remember which OPNsense version I started with, but it has been at least 1 year since I setup this install, applied pretty much every update over the course. I would say that this is an undesired usage pattern for resulting in total system breakdown :'(

Are we really the only two users in the whole wide world with thisproblem? :-/
kind regards
chemlud
____
"The price of reliability is the pursuit of the utmost simplicity."
C.A.R. Hoare

felix eichhorns premium katzenfutter mit der extraportion energie

A router is not a switch - A router is not a switch - A router is not a switch - A rou....

You can deinstall ruby easily, not sure how it ended up there:

# pkg remove ruby

Do you have /usr/ports on your install? I remember you building Unbound...

Yes, no inodes is an issue... a lot of small files will "fill" your system even though space is not an issue. Find the lots of files and delete them.


Cheers,
Franco