Insight Aggregator issue

Started by psilovybin, March 28, 2025, 05:39:48 AM

Previous topic - Next topic
It will run for about a minute then fail with this error

2025-03-27T22:41:17-05:00 Error flowd_aggregate.py flowd aggregate died with message Traceback (most recent call last): File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 160, in run aggregate_flowd(self.config, do_vacuum) File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 86, in aggregate_flowd stream_agg_object.cleanup(do_vacuum) File "/usr/local/opnsense/scripts/netflow/lib/aggregates/__init__.py", line 208, in cleanup self._update_cur.execute('delete from timeserie where mtime < :expire', {'expire': expire_timestamp}) sqlite3.DatabaseError: database disk image is malformed
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum src_addr_details_086400.sqlite
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum dst_port_086400.sqlite
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum dst_port_003600.sqlite
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum dst_port_000300.sqlite
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum interface_086400.sqlite
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum interface_003600.sqlite
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum interface_000300.sqlite
2025-03-27T22:41:16-05:00 Notice flowd_aggregate.py vacuum interface_000030.sqlite
2025-03-27T22:40:27-05:00 Notice flowd_aggregate.py start watching flowd
2025-03-27T22:40:26-05:00

I know I can reset the data and it will run fine after that for a few days and will just repeat.

Updated 25.1.4_1