OPNsense Forum

Archive => 18.7 Legacy Series => Topic started by: schnipp on November 09, 2018, 03:45:22 pm

Title: [SOLVED] 18.7.7: Opnsense errors after update
Post by: schnipp on November 09, 2018, 03:45:22 pm
After updating Opnsense (18.7.6 --> 18.7.7) and rebooting the system, Opnsense throws an error. Therefore several services are not able to start.

Code: [Select]
[09-Nov-2018 15:13:18 Europe/Berlin] PHP Fatal error:  Uncaught Error: Call to undefined function get_configured_interface_list() in /usr/local/etc/inc/plugins.inc.d/igmpproxy.inc:80
Stack trace:
#0 /usr/local/etc/inc/plugins.inc(213): igmpproxy_configure_do(true)
#1 /usr/local/etc/rc.bootup(118): plugins_configure('bootup', true)
#2 {main}
  thrown in /usr/local/etc/inc/plugins.inc.d/igmpproxy.inc on line 80
Title: Re: 18.7.7: Opnsense errors after update
Post by: schnipp on November 09, 2018, 04:39:50 pm
Forcing the update again using the console (opnsense-update -f) solved this issue. But now, starting all the services after reboot takes long time (up to 5 minutes) and flowd_aggregate dies in its startup phase.


Code: [Select]
flowd_aggregate.py: flowd aggregate died with message Traceback (most recent call last): File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 151, in run aggregate_flowd(do_vacuum) File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 80, in aggregate_flowd stream_agg_object.add(flow_record_cpy) File "/usr/local/opnsense/scripts/netflow/lib/aggregates/interface.py", line 70, in add super(FlowInterfaceTotals, self).add(flow) File "/usr/local/opnsense/scripts/netflow/lib/aggregate.py", line 261, in add self._update_cur.execute(self._insert_stmt, flow) DatabaseError: database disk image is malformed

Edit: After repairing the database everything works fine again. Maybe, the database error was not raised during the update and occured longer time ago.
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: nivek1612 on November 12, 2018, 02:25:49 pm
I'm seeing something similar - what do you mean by "repairing the database"
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: gliddie on November 13, 2018, 12:09:46 am
I guess he is talking about the NetFlow database.
After the last update, my box did show the same behavior.
opnsense-update -f and a reboot did fix it for me too.
My NetFlow database was not broken.
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: schnipp on November 14, 2018, 06:18:51 pm
Quote from: nivek1612 on November 12, 2018, 02:25:49 pm
I'm seeing something similar - what do you mean by "repairing the database"

Under "Reporting --> Settings" you can find a button called "Repair netflow data". On my system repairing took long time (20 minutes and more). You can monitor the repair process and touched files in the system log (System --> Log Files --> General).
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: schnipp on December 03, 2018, 08:08:17 pm
The database is broken again. Maybe it's a bug in some piece of the the software because there are three exisiting issues in github (all closed without solution)


All SMART attributes of my SSD look good. But, file system is not clean. I want to give it a try. How can I force file system check at startup (e.g. creating a file "/force_fsck"?)?

Thanks
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: franco on December 03, 2018, 10:34:59 pm
IGMP Proxy plugin was fixed in 18.7.8 by reinstalling the same. That manual fix also worked for 18.7.7. It was an oversight on my part, sorry.

For dying databases sqlite + host file system this as good as it gets. Try to configure periodic netflow backups via System: Settings: Miscellaneous and see if that helps. If it helps, it's your file system trashing the database.


Cheers,
Franco
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: schnipp on December 06, 2018, 05:53:52 pm
I checked the filesystem again in single user mode (in this mode the root partition is mounted read only). The File system was clean. So, maybe there is a software bug in flow aggregate!?
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: franco on December 07, 2018, 07:18:04 am
There will always be at least one more bug left in any software. It's why the project is still alive. ;)


Cheers,
Franco
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: schnipp on December 11, 2018, 09:55:17 pm
Quote
It's why the project is still alive. ;)

Hopefully, this is not the main intention that this project is still alive  ;) ;)
Title: Re: [SOLVED] 18.7.7: Opnsense errors after update
Post by: franco on December 12, 2018, 04:27:48 pm
Fingers crossed... ;)

On a more serious note, the insight database handling has been improved for 19.1 and can be previewed from the development release type.


Cheers,
Franco