WAN DHCP issue and one package

[none]

hail,

I have a soekris 5501-70 running:

OPNsense 15.7-i386
FreeBSD 10.1-RELEASE-p14
LibreSSL 2.2.0

This box has two cable wan, and there is the point. I get once a day a lost connection. Even though all looks fine, I can't ping from the main wan. I have to go on interfaces UI and click on "release" e "renew". This happened today once, and tomorrow too.

Has anyone seen this ?

I have a strangely high load of, at least, 1.00. Does this have any to do ?

I come from the project that is sibling to this, I don't know if there is any problem on saying it (so I don't), and I want to give this a try. So far, a bit slow on the 5501-70, but still testing.

About the packages, how can I test or run them ?

All I need so far is the vnstat package. I found some links to git, but I can't find how to install them. The pkg add on CLI won't find vnstat :(

thanks for the project, its a great project !

none

[franco]

Is this a PPPoE connection going down? It sounds like a scheduled provider timeout. Without further details it's hard to say if the scripts don't pick it up or if there is something else going on with the setup/deployment.

A load of 1.00 means your scheduler is always has exactly 1 process running. For a system that can be normal, even without producing high CPU time. It could be IO blocking or a daemon process misbehaving. Can you post top output for us? This Soekris CPU is quite slow, too, except that the RAM is ok with 512 MB. Maybe the load average is to be expected.

15.7 is rather old. I reckon this is nano? Have you had trouble upgrading?

There are only two test plugins at the moment, see the other thread:

https://forum.opnsense.org/index.php?topic=1187

[none]

Is this a PPPoE connection going down? It sounds like a scheduled provider timeout. Without further details it's hard to say if the scripts don't pick it up or if there is something else going on with the setup/deployment.

franco, both internet pipes are cable dhcp-only. I used ISP two on OpenBSD dedicated machine and both on pfSense on this same soekris and never got this dhcp issoe. Please don't get me as comparing opnsense to pfsense, just showing info I got. I am a big opnsense fan already :)

A load of 1.00 means your scheduler is always has exactly 1 process running. For a system that can be normal, even without producing high CPU time. It could be IO blocking or a daemon process misbehaving. Can you post top output for us? This Soekris CPU is quite slow, too, except that the RAM is ok with 512 MB. Maybe the load average is to be expected.

I know this box is not that fast. I see this on other scenarios, mostly on heavy traffic (50Mbps is heavy for it). The other test machines are quite close to it :(

Code Select Expand

last pid: 79597;  load averages:  1.11,  0.89,  0.81                                                                                                    up 5+15:49:58  11:06:38
47 processes:  2 running, 45 sleeping
CPU: 57.8% user,  0.0% nice, 38.1% system,  4.1% interrupt,  0.0% idle
Mem: 17M Active, 165M Inact, 99M Wired, 46M Buf, 190M Free
Swap:

  PID USERNAME    THR PRI NICE   SIZE    RES STATE    TIME    WCPU COMMAND
15362 root          1  52    0 34672K 21360K piperd   7:07  14.89% php-cgi
55786 root          1  52    0 34672K 20208K accept   6:39   8.98% php-cgi
58143 matheus       1  20    0 11232K  2424K RUN      0:00   0.29% top
54914 unbound       1  20    0 30044K 20488K select 123:16   0.00% unbound
61146 root          1  20    0 25300K 13848K kqread  52:44   0.00% lighttpd
37954 root          1  20    0 12044K  4220K select  26:22   0.00% miniupnpd
24573 root          1  20    0 10200K  1872K bpf     13:21   0.00% filterlog
78627 _dhcp         1  20    0 10160K  1976K select   8:11   0.00% dhclient
5309 root          1  20    0 10140K  1884K select   5:20   0.00% syslogd
50230 root          1  20    0 10020K  1932K select   1:07   0.00% radvd
99069 root          1  20    0 10212K  1768K select   0:34   0.00% ping
27792 root          1  52    0 10432K  2048K wait     0:34   0.00% sh
  208 root          1  20    0 24132K 14300K accept   0:29   0.00% python2.7
51849 root          1  20    0 12972K 13000K select   0:15   0.00% ntpd
59957 dhcpd         1  20    0 16224K  9128K select   0:12   0.00% dhcpd
82917 root          1  20    0 10084K  1832K nanslp   0:05   0.00% cron
61049 matheus       1  20    0 15396K  5092K select   0:03   0.00% sshd
76974 root          1  52    0 10160K  1852K select   0:01   0.00% dhclient
31133 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
32647 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
30961 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
31661 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
31365 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
32327 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
32282 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
31944 root          1  20    0 10036K  1696K nanslp   0:01   0.00% getty
61864 root          1  52    0 30576K 15256K wait     0:01   0.00% php-cgi
23252 root          1  52    0  9924K  1556K nanslp   0:01   0.00% minicron
  215 root          1  20    0  8976K  3360K select   0:01   0.00% devd
61242 root          1  49    0 30576K 15256K wait     0:00   0.00% php-cgi
84848 root          1  20    0 10796K  2984K pause    0:00   0.00% csh
32850 root          1  22    0 10424K  2184K wait     0:00   0.00% login
8157 root          1  22    0 15396K  4572K select   0:00   0.00% sshd
84875 _dhcp         1  20    0 10160K  2000K select   0:00   0.00% dhclient
79066 root          1  52    0 10160K  1848K select   0:00   0.00% dhclient
46298 root          1  21    0 12644K  4172K select   0:00   0.00% sshd
62041 matheus       1  20    0 10796K  2784K pause    0:00   0.00% csh


15.7 is rather old. I reckon this is nano? Have you had trouble upgrading?

Yes, its nano. I never tried upgrade so far. I get the message when I click to "check for", but never clicked. I will try then. Is there any screen before it beginning the update that tells me the new version found ?

There are only two test plugins at the moment, see the other thread:

https://forum.opnsense.org/index.php?topic=1187

I saw that. So no way to install vnstat now, right ?
As my cable providers do some accounting, I like to measure it by myself. Hence the need for vnstat :(

thanks,

none

[Shaok353]

We need to know more about your WAN links still. Are both those WAN links running to the same modem or different modems?

Also are you referring to your DHCP isn't auto-renewing on the LAN side or is the DHCP not auto-renewing on the service provider side?

[franco]

I can add vnstat to the package mirror in time for 15.7.8, how does that sound?

I know that early 15.7 had issues with DHCP on nano specifically, although I'm not 100% sure it applies to your case. I'm going to release a semi-official nano 15.7.8 image later today or tomorrow that fixes the headaches we had with nano in early 15.7 to see if that improves things for you.

[none]

We need to know more about your WAN links still. Are both those WAN links running to the same modem or different modems?

Also are you referring to your DHCP isn't auto-renewing on the LAN side or is the DHCP not auto-renewing on the service provider side?

Hi :)

I have two ISP's, each one has its own modem. I suspect just the link on the WAN interface has this issue.

My dhcp issue is not on LAN side, I have it all fine there.

thanks :)

[none]

I can add vnstat to the package mirror in time for 15.7.8, how does that sound?

Super !

I have quite simple needs on my home firewall. I have some clients outside that runs pfsense, so my goal is to try opnsense so I can change those clients in the future, if all runs fine. I will see the best choice and use it :)

I know that early 15.7 had issues with DHCP on nano specifically, although I'm not 100% sure it applies to your case. I'm going to release a semi-official nano 15.7.8 image later today or tomorrow that fixes the headaches we had with nano in early 15.7 to see if that improves things for you.

That's great for me, and I can try it later today.

BTW, I had to go back to pfsense on the 5501-70 as I tried to upgrade it and got some errors. Nothing was displayed on the WebUI, but now I can't make the dhcp server to run again, and the wife begun complaining about no internet on mobile phone :) So, as I had few to no time to deal with it, I got the old CF card back.

I can download the new nano image and use the config on the 15.7 and test it.

BTW, again, I tried to upgrade, got the package list and then clicked on upgrade. From that point on, nothing changed on UI, no progress bar, nothing would tell me that it was running. Is that the way ? I got no progress bar whatsoever, or nothing alike to inform me how my upgrade was.

thanks,

[franco]

I will see the best choice and use it :)

Fair enough. We could ask for nothing more. :)

BTW, I had to go back to pfsense on the 5501-70 as I tried to upgrade it and got some errors. Nothing was displayed on the WebUI, but now I can't make the dhcp server to run again, and the wife begun complaining about no internet on mobile phone :) So, as I had few to no time to deal with it, I got the old CF card back.

I can download the new nano image and use the config on the 15.7 and test it.

BTW, again, I tried to upgrade, got the package list and then clicked on upgrade. From that point on, nothing changed on UI, no progress bar, nothing would tell me that it was running. Is that the way ? I got no progress bar whatsoever, or nothing alike to inform me how my upgrade was.

I think you're seeing the bug that the initial nano had WRT package manager with all its side effects: the package database disappeared underneath the "/var" RAM disk and could not be accessed, causing empty updates and dhcp server issues. Let's start fresh with 15.7.8.

I was going to do it now but I realised I misplaced my Serial-to-USB adapter. Meh, tomorrow it is.

[none]

I will see the best choice and use it :)

Fair enough. We could ask for nothing more. :)

BTW, I had to go back to pfsense on the 5501-70 as I tried to upgrade it and got some errors. Nothing was displayed on the WebUI, but now I can't make the dhcp server to run again, and the wife begun complaining about no internet on mobile phone :) So, as I had few to no time to deal with it, I got the old CF card back.

I can download the new nano image and use the config on the 15.7 and test it.

BTW, again, I tried to upgrade, got the package list and then clicked on upgrade. From that point on, nothing changed on UI, no progress bar, nothing would tell me that it was running. Is that the way ? I got no progress bar whatsoever, or nothing alike to inform me how my upgrade was.

I think you're seeing the bug that the initial nano had WRT package manager with all its side effects: the package database disappeared underneath the "/var" RAM disk and could not be accessed, causing empty updates and dhcp server issues. Let's start fresh with 15.7.8.

I was going to do it now but I realised I misplaced my Serial-to-USB adapter. Meh, tomorrow it is.

hehehe. Deal !

Looking forward to downloading this :)

none

[none]

Hi Franco,

where Will I find the image ?

I looked for it on some mirrors, not found so far :)

thanks,

none

[franco]

Here is the test snapshot... 4 GB image for i386 for now, but it works the same with config import/export.

https://pkg.opnsense.org/snapshots/OPNsense-15.7.8-LibreSSL-nano-i386.img.bz2

We are probably giving out new images for all combinations with 15.7.9 because we want a few firmware upgrade tweaks to go in which are not in 15.7.8 yet.

[none]

Hi Franco,

I got it installed ok. And installed the vnstat package. Thanks :)

The config.xml from previous version worked fine, but I can't find how to access the vnstat page.

Is there a page for vnstat ?

I will try to reinstall the package anyway.

thanks,

none

[franco]

That's why we differ in terminology between packages and plugins. Packages come from FreeBSD and only denote services. Plugins can tie these packages into installable plugins with a GUI on top. Long story short, the plugin for vnstat is missing for now. We are, however, just now adding code to allow plugins to live in the GUI menu and access control.

[none]

Hi,

a bit far from this plugin/package issue, is this normal ?

Code Select Expand

last pid: 75940;  load averages:  2.84,  2.97,  2.83                                                                                                                                                                 up 0+22:17:46  13:22:25
48 processes:  5 running, 43 sleeping
CPU: 41.3% user,  0.0% nice, 56.5% system,  2.2% interrupt,  0.0% idle
Mem: 21M Active, 118M Inact, 42M Wired, 25M Buf, 290M Free
Swap:

  PID USERNAME    THR PRI NICE   SIZE    RES STATE    TIME    WCPU COMMAND
64663 unbound       1  78    0 21852K 14184K RUN      7:05  19.48% unbound
81434 root          1  77    0 34792K 19328K RUN      0:07  16.36% php-cgi
  522 root          1  21    0 34900K 21932K RUN      5:04   7.96% php-cgi
1809 root          1  22    0 12040K  4040K select   1:44   5.08% miniupnpd
29823 _dhcp         1  20    0 10160K  1940K select   0:40   1.07% dhclient
16919 _dhcp         1  20    0 10160K  1944K select   0:21   0.59% dhclient
50062 root          1  20    0 11232K  2428K RUN      0:00   0.20% top
56865 root          1  20    0 13016K  6580K kqread  17:58   0.00% lighttpd
38802 root          1  20    0 10200K  1872K RUN      1:51   0.00% filterlog
5138 root          1  20    0 10140K  1892K select   0:36   0.00% syslogd
74116 root          1  20    0 10020K  1776K select   0:12   0.00% radvd
  197 root          1  20    0 23744K 13488K accept   0:10   0.00% python2.7
32363 matheus       1  20    0 15388K  4704K select   0:02   0.00% sshd
4650 root          1  22    0 15388K  4580K select   0:01   0.00% sshd
50254 root          1  52    0 10432K  2040K wait     0:01   0.00% sh
5951 root          1  22    0 10084K  1816K nanslp   0:01   0.00% cron
57582 root          1  52    0 30696K 14456K wait     0:00   0.00% php-cgi
56964 root          1  52    0 30696K 14528K wait     0:00   0.00% php-cgi
72574 dhcpd         1  20    0 16224K  9128K select   0:00   0.00% dhcpd
81603 root          1  20    0 11232K  2444K select   0:00   0.00% top
68862 root          1  20    0 10796K  2976K pause    0:00   0.00% csh
60941 root          1  22    0 10424K  2184K wait     0:00   0.00% login
24442 root          1  22    0 10160K  1840K select   0:00   0.00% dhclient
49055 matheus       1  23    0 10416K  2132K wait     0:00   0.00% su
59956 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
60110 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
60265 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
60030 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
60875 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
60495 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
60686 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
60759 root          1  20    0 10036K  1700K nanslp   0:00   0.00% getty
  203 root          1  20    0  8976K  3368K select   0:00   0.00% devd
50785 root          1  49    0  9924K  1560K nanslp   0:00   0.00% minicron
63923 root          1  20    0 10796K  3060K pause    0:00   0.00% csh
11987 root          1  38    0 10160K  1832K select   0:00   0.00% dhclient
32525 matheus       1  21    0 10796K  2884K pause    0:00   0.00% csh
66658 root          1  25    0 10432K  1912K wait     0:00   0.00% sh
61117 root          2  20    0 10212K  1760K nanslp   0:00   0.00% sshlockout_pf
61369 root          1  26    0 10432K  2032K wait     0:00   0.00% sh
51444 root          1  27    0  9924K  1556K nanslp   0:00   0.00% minicron
5481 root          1  20    0 12636K  4040K select   0:00   0.00% sshd
27289 root          1  52    0  5832K  1512K nanslp   0:00   0.00% sleep
44739 root          1  20    0 10136K  1740K select   0:00   0.00% inetd
50486 root          1  52    0  9924K  1548K wait     0:00   0.00% minicron
51722 root          1  52    0  9924K  1548K wait     0:00   0.00% minicron
51039 root          1  52    0  9924K  1548K wait     0:00   0.00% minicron
52433 root          1  52    0  9924K  1556K nanslp   0:00   0.00% minicron


load here was above 3. It is slow :(

Versions   OPNsense 15.7.8-i386   
FreeBSD 10.1-RELEASE-p17   
LibreSSL 2.2.2

thanks,

none

ps: a small update on the dhcp issue. I got another dhcp failure as told on the opening post, but this is 22h after boot. So I got some progress here. Is there any update for this image here ? Just tell me and I will test :)

[none]

That's why we differ in terminology between packages and plugins. Packages come from FreeBSD and only denote services. Plugins can tie these packages into installable plugins with a GUI on top. Long story short, the plugin for vnstat is missing for now. We are, however, just now adding code to allow plugins to live in the GUI menu and access control.

Franco,

if there is anything I can do to help, test and whatever, just say :)

thanks,