Sensei on OPNsense - Application based filtering

Started by mb, August 25, 2018, 03:38:14 AM

Previous topic - Next topic
July 20, 2019, 03:05:49 AM #420 Last Edit: July 20, 2019, 03:18:10 AM by mb
@opnip, @malac, @space,

A hotfix release 0.8.1 is available fixing these problems. It also fixes a compatibility issue with OPNsense 19.7.

You can update your installation through Sensei -> Status -> Check for updates. An update should have been reported already.

@space, can you check whether old logs are pruned?

@mb Thanks for the quick response ... I have updated to 0.8.1. When are the logfiles usually pruned? At some specific time?

Quote from: mb on July 20, 2019, 03:05:49 AM
@opnip, @malac, @space,

A hotfix release 0.8.1 is available fixing these problems. It also fixes a compatibility issue with OPNsense 19.7.

You can update your installation through Sensei -> Status -> Check for updates. An update should have been reported already.

@space, can you check whether old logs are pruned?

great!!
does it also fix:
Scheduled reports could not be generated. Probably elasticsearch service is not running or not working properly. Please check elasticsearch service manually.

Quote from: Space on July 20, 2019, 12:04:03 PM
@mb Thanks for the quick response ... I have updated to 0.8.1. When are the logfiles usually pruned? At some specific time?

Yes, it's fixed now ... I just checked and it only kept the last 14 days ... now it's using only 2GB ...

Thanks!

July 21, 2019, 03:49:58 AM #424 Last Edit: July 21, 2019, 06:10:01 PM by biomatrix
I just registered to post this (as opposed to on github)
the 0.8.1 hotfix fixed the first error I was having - now I get this error :



my settings are :




I have restarted the device - I have reset the config - I have uninstalled and reinstalled 0.8.1.

let me know if there is any other steps or information I need to proceed.

EDIT : had the #'s of the versions wrong.

Quote from: malac on July 20, 2019, 12:18:09 PM
Quote from: mb on July 20, 2019, 03:05:49 AM
@opnip, @malac, @space,

A hotfix release 0.8.1 is available fixing these problems. It also fixes a compatibility issue with OPNsense 19.7.

You can update your installation through Sensei -> Status -> Check for updates. An update should have been reported already.

@space, can you check whether old logs are pruned?


great!!
does it also fix:
Scheduled reports could not be generated. Probably elasticsearch service is not running or not working properly. Please check elasticsearch service manually.

i still get this error after upgrading to 0.8.1 (occuring since upgrade to 19.7)

How can I return to version 0.8.0? I upgraded to version 0.8.1 and found it unstable. Now I want to go back to version 0.8.0. How do I change it? Many thanks

Ok, looks like in some cases people still experience some more 19.7 compatibility issues that need attention

I'd appreciate if you can share the these oddities so that we can address them.

For now we are aware of:

1. elastic search stopping - so scheduled reports not generating
2. engine not being able to open interface in netmap mode
3. UI not recognizing already selected interface

These seem to pop up in limited use-cases, still trying to understand the exact root causes.

We'll reach out to @malac, @biomatrix to diagnose.

@fiterzs, you can do (thorough OPNsense shell)


service eastpect onestop
pkg unlock os-sensei
pkg remove os-sensei
fetch https://updates.sunnyvalley.io/repo/All/os-sensei-0.8.0.txz
pkg add os-sensei-0.8.0.txz
pkg lock os-sensei


But I'm not sure if the problems you're seeing are related to 0.8.1 since there are very minimal changes. I'm inclined to think that they might be related to sensei -> 19.7 compatibility. Would be happy if you can report back if anything is better with 0.8.0.


@space, glad that logs are pruned now. With 1.0 we are disabling log archiving at all. Logs will hold very minimal disk space.

Hi MB
Thank you for your help, but when I run this command, System prompted to find the file.

fetch: https://updates.sunnyvalley.io/repo/All/os-sensei-0.8.0.txz: Not Found

@fiterzs, please try again. 0.8.0 should be there now. But I'd suggest you try the recently released 0.8.2 since this has an important fix that might be responsible for some weirdness.

If you've uninstalled os-sensei, just type

# pkg install os-sensei

and it'll install 0.8.2.

If you still want to revert back to 0.8.0 you can do so by resuming the commands batch i've shared earlier.

Quote from: mb on July 22, 2019, 09:20:08 PM
Ok, looks like in some cases people still experience some more 19.7 compatibility issues that need attention

Dear Sensei users,

Issues which arose after 19.7 upgrade seem to be the result of OPNsense python 3.7 migration. Removal of unused Python 2.7 modules caused issues since they were required by some Sensei scripts.

We just released 0.8.2 addressing this. While you're upgrading to 0.8.2 missing python dependencies will be automatically installed.

Sorry for the inconvenience this might have caused.

Please feel free to share any further problems you've encountered.

Hi Mb
Thank you for your help
now I am back to version 0.8.
It still looks stable at the moment, I will try version 0.8.2 later, thank you

@fiterzs, glad to hear that worked for you.  Feel free to try at your convenience.



Quote from: abraxxa on July 23, 2019, 10:23:03 PM
0.8.2 still doesn't start for me on 19.7.

@abraxxa, just sent a private message to you. Let's have a look at it together.