[SOLVED] 18.7.7: Opnsense errors after update

[schnipp]

After updating Opnsense (18.7.6 --> 18.7.7) and rebooting the system, Opnsense throws an error. Therefore several services are not able to start.

Code Select Expand


[09-Nov-2018 15:13:18 Europe/Berlin] PHP Fatal error:  Uncaught Error: Call to undefined function get_configured_interface_list() in /usr/local/etc/inc/plugins.inc.d/igmpproxy.inc:80
Stack trace:
#0 /usr/local/etc/inc/plugins.inc(213): igmpproxy_configure_do(true)
#1 /usr/local/etc/rc.bootup(118): plugins_configure('bootup', true)
#2 {main}
  thrown in /usr/local/etc/inc/plugins.inc.d/igmpproxy.inc on line 80


[schnipp]

Forcing the update again using the console (opnsense-update -f) solved this issue. But now, starting all the services after reboot takes long time (up to 5 minutes) and flowd_aggregate dies in its startup phase.

Code Select Expand


flowd_aggregate.py: flowd aggregate died with message Traceback (most recent call last): File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 151, in run aggregate_flowd(do_vacuum) File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 80, in aggregate_flowd stream_agg_object.add(flow_record_cpy) File "/usr/local/opnsense/scripts/netflow/lib/aggregates/interface.py", line 70, in add super(FlowInterfaceTotals, self).add(flow) File "/usr/local/opnsense/scripts/netflow/lib/aggregate.py", line 261, in add self._update_cur.execute(self._insert_stmt, flow) DatabaseError: database disk image is malformed


Edit: After repairing the database everything works fine again. Maybe, the database error was not raised during the update and occured longer time ago.

[nivek1612]

I'm seeing something similar - what do you mean by "repairing the database"

[gliddie]

I guess he is talking about the NetFlow database.
After the last update, my box did show the same behavior.
opnsense-update -f and a reboot did fix it for me too.
My NetFlow database was not broken.

[schnipp]

I'm seeing something similar - what do you mean by "repairing the database"

Under "Reporting --> Settings" you can find a button called "Repair netflow data". On my system repairing took long time (20 minutes and more). You can monitor the repair process and touched files in the system log (System --> Log Files --> General).

[schnipp]

The database is broken again. Maybe it's a bug in some piece of the the software because there are three exisiting issues in github (all closed without solution)

• #1696
• #1017
• #999

All SMART attributes of my SSD look good. But, file system is not clean. I want to give it a try. How can I force file system check at startup (e.g. creating a file "/force_fsck"?)?

Thanks

[franco]

IGMP Proxy plugin was fixed in 18.7.8 by reinstalling the same. That manual fix also worked for 18.7.7. It was an oversight on my part, sorry.

For dying databases sqlite + host file system this as good as it gets. Try to configure periodic netflow backups via System: Settings: Miscellaneous and see if that helps. If it helps, it's your file system trashing the database.


Cheers,
Franco

[schnipp]

I checked the filesystem again in single user mode (in this mode the root partition is mounted read only). The File system was clean. So, maybe there is a software bug in flow aggregate!?

[franco]

There will always be at least one more bug left in any software. It's why the project is still alive. ;)


Cheers,
Franco

[schnipp]

It's why the project is still alive. ;)

Hopefully, this is not the main intention that this project is still alive  ;) ;)

[franco]

Fingers crossed... ;)

On a more serious note, the insight database handling has been improved for 19.1 and can be previewed from the development release type.


Cheers,
Franco