OPNsense
  • Home
  • Help
  • Search
  • Login
  • Register

  • OPNsense Forum »
  • English Forums »
  • Zenarmor (Sensei) »
  • disk space
« previous next »
  • Print
Pages: [1]

Author Topic: disk space  (Read 5033 times)

flames

  • Newbie
  • *
  • Posts: 9
  • Karma: 2
    • View Profile
disk space
« on: July 18, 2021, 04:54:11 am »
Hello,
i am evaluating Sensei for some weeks. The appliance has a disk of 64GB, 20% used. With Sensei + MongoDB 23% is used (when erase all reporting data), max number of days is 1.
Now the interesting part: disk usage grows slowly (3-4 days) to about 50%, then all of a sudden 70-75% and growing very fast to 80%++ (within 1-2 hours), where i overreact and reset reporting data again. After erasing, back to 23% disk used.
My question: what happens, when i would not reset the reporting data in Sensei? Is there an automatic cap of used disk space before the disk would run to 100% full? would anything crash? i had no nerves to test that in the production environment. my testing environment has not enough traffic to get into such scenario.
Thanks in advance

edit:
all newest stable updates installed (opns 21.1.8, sensei enigne 1.9.2, ui 21.7.7, db 1.9.21070514)
issue persist since i installed sensei 8-9 weeks ago
sensei is in passive mode, level warning, deployment size small, rotation 1 day, max days to store reporting data 1 day (not a lot of traffic except the usual attacks from outside)
« Last Edit: July 18, 2021, 05:05:00 am by flames »
Logged

almodovaris

  • Sr. Member
  • ****
  • Posts: 318
  • Karma: 15
    • View Profile
Re: disk space
« Reply #1 on: July 18, 2021, 04:06:27 pm »
My installation on an APU2 occupies about 13 GB in total, including toolchain for compiling binaries from source code. YMMV, I don't know how many devices you have on your LAN.

Oh, yes, I have no swap file, I killed the swap partition.
« Last Edit: July 18, 2021, 04:10:26 pm by almodovaris »
Logged
OPNsense HW:

Minisforum Venus series UN100C, 16 GB RAM, 512 GB SSD
T-bao N9N Pro, 16 GB RAM, 512 GB SSD

sy

  • Hero Member
  • *****
  • Posts: 598
  • Karma: 44
    • View Profile
Re: disk space
« Reply #2 on: July 19, 2021, 09:24:15 pm »
Hi @flames,

Sensei will stop working when detected that a partition is %90 + full. But did you look that which folder is growing fastly? It is not expected behavior for DB data.
Logged

sg

  • Newbie
  • *
  • Posts: 3
  • Karma: 1
    • View Profile
Re: disk space
« Reply #3 on: July 21, 2021, 03:52:52 pm »
You can send your logs to a remote server running elasticsearch to lower the space used on the device running the firewall.
Logged

flames

  • Newbie
  • *
  • Posts: 9
  • Karma: 2
    • View Profile
Re: disk space
« Reply #4 on: July 21, 2021, 08:43:38 pm »
Quote from: sy on July 19, 2021, 09:24:15 pm
Sensei will stop working when detected that a partition is %90 + full. But did you look that which folder is growing fastly? It is not expected behavior for DB data.

thank you. it is indeed mongodb index files (/usr/local/datastore/mongodb/*.wt, a lot of them), i also found something similar in the mongodb community https://www.mongodb.com/community/forums/t/mongodb-disk-space-increases-abruptly-wiredtigerlas-wt/3620
will investigate further.
also i am now a little more relaxed by the 90% disk limit, in case i am not around, when it grows again.
« Last Edit: July 21, 2021, 09:11:56 pm by flames »
Logged

almodovaris

  • Sr. Member
  • ****
  • Posts: 318
  • Karma: 15
    • View Profile
Re: disk space
« Reply #5 on: July 30, 2021, 02:36:09 pm »
I have another APU2 21.7 with Sensei, it has 9 GB in total.
Logged
OPNsense HW:

Minisforum Venus series UN100C, 16 GB RAM, 512 GB SSD
T-bao N9N Pro, 16 GB RAM, 512 GB SSD

  • Print
Pages: [1]
« previous next »
  • OPNsense Forum »
  • English Forums »
  • Zenarmor (Sensei) »
  • disk space
 

OPNsense is an OSS project © Deciso B.V. 2015 - 2024 All rights reserved
  • SMF 2.0.19 | SMF © 2021, Simple Machines
    Privacy Policy
    | XHTML | RSS | WAP2