Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Messages - TheSmoker

Pages: 1 [2]

20.1 Legacy Series / Re: iperf3 speed difference with 10G networking

« on: July 01, 2020, 10:53:05 am »

1 day and 1 reboot later. nothing changed from yesterday with today. what the hell is going on?

Code: [Select]

iperf-3.1.3-win64>iperf3.exe -c 192.168.1.138
Connecting to host 192.168.1.138, port 5201
[  4] local 192.168.1.99 port 50593 connected to 192.168.1.138 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   162 MBytes  1.36 Gbits/sec
[  4]   1.00-2.00   sec   197 MBytes  1.65 Gbits/sec
[  4]   2.00-3.00   sec   201 MBytes  1.69 Gbits/sec
[  4]   3.00-4.00   sec   198 MBytes  1.66 Gbits/sec
[  4]   4.00-5.00   sec   188 MBytes  1.58 Gbits/sec
[  4]   5.00-6.00   sec   190 MBytes  1.60 Gbits/sec
[  4]   6.00-7.00   sec   191 MBytes  1.60 Gbits/sec
[  4]   7.00-8.00   sec   192 MBytes  1.61 Gbits/sec
[  4]   8.00-9.00   sec   192 MBytes  1.61 Gbits/sec
[  4]   9.00-10.00  sec   198 MBytes  1.66 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.86 GBytes  1.60 Gbits/sec                  sender
[  4]   0.00-10.00  sec  1.86 GBytes  1.60 Gbits/sec                  receiver

iperf Done.

iperf3.exe -c 192.168.1.138 -R
Connecting to host 192.168.1.138, port 5201
Reverse mode, remote host 192.168.1.138 is sending
[  4] local 192.168.1.99 port 50619 connected to 192.168.1.138 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  81.8 MBytes   687 Mbits/sec
[  4]   1.00-2.00   sec  78.6 MBytes   660 Mbits/sec
[  4]   2.00-3.00   sec  90.4 MBytes   758 Mbits/sec
[  4]   3.00-4.00   sec  90.8 MBytes   762 Mbits/sec
[  4]   4.00-5.00   sec  99.4 MBytes   834 Mbits/sec
[  4]   5.00-6.00   sec  92.4 MBytes   775 Mbits/sec
[  4]   6.00-7.00   sec  85.7 MBytes   719 Mbits/sec
[  4]   7.00-8.00   sec  88.0 MBytes   738 Mbits/sec
[  4]   8.00-9.00   sec  87.1 MBytes   730 Mbits/sec
[  4]   9.00-10.00  sec  89.2 MBytes   749 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   884 MBytes   741 Mbits/sec  203             sender
[  4]   0.00-10.00  sec   884 MBytes   741 Mbits/sec                  receiver

iperf Done.

20.1 Legacy Series / Re: Redundant DNS

« on: June 30, 2020, 10:32:32 pm »

Is your dns serving stand alone zones, or you are using unbound just as caching dns?

I am asking this because unbound is just a resolver/caching dns server, the authoritative part of that package is NSD.

If you are just using it to serve local zones only, then you just need to copy paste the unbound.conf (the configuration of the unbound) to another box.

Of course that box/docker/whatever needs to be on separate hardware in case your opnsense box fails.

Additionally you will need to instruct dhcpd to announce both dns servers in the dhcp answer to hosts or configure them by hand on your deployed OSes.

https://www.nlnetlabs.nl/documentation/nsd/
https://nlnetlabs.nl/documentation/unbound/

20.1 Legacy Series / Re: Redundant DNS

« on: June 30, 2020, 07:28:16 pm »

You can always add a raspberry pi box with a slave/caching dns based on need, or you can always rent a 5/9USD VPS in cloud which you can use a a secondary dns.

Both of them are cheap. Although if you have services behind the opnsense box, they will not be available even if the dns will resolve the requests.

20.1 Legacy Series / Re: iperf3 speed difference with 10G networking

« on: June 30, 2020, 04:37:23 pm »

I've also done the following test. Assigned no interfaces. Reboot OPNSense.
Open shell on server and assign IPs to both 10G interfaces:

Then, start iperf3 testing:

Code: [Select]

http://iperf3.exe -c 192.168.1.138
Connecting to host 192.168.1.138, port 5201
[  4] local 192.168.1.99 port 55187 connected to 192.168.1.138 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   256 MBytes  2.15 Gbits/sec
[  4]   1.00-2.00   sec   264 MBytes  2.22 Gbits/sec
[  4]   2.00-3.00   sec   299 MBytes  2.50 Gbits/sec
[  4]   3.00-4.00   sec  60.2 MBytes   505 Mbits/sec
[  4]   4.00-5.00   sec   197 MBytes  1.65 Gbits/sec
[  4]   5.00-6.00   sec   228 MBytes  1.91 Gbits/sec
[  4]   6.00-7.00   sec   225 MBytes  1.89 Gbits/sec
[  4]   7.00-8.00   sec   245 MBytes  2.05 Gbits/sec
[  4]   8.00-9.00   sec   306 MBytes  2.57 Gbits/sec
[  4]   9.00-10.00  sec   293 MBytes  2.46 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  2.32 GBytes  1.99 Gbits/sec                  sender
[  4]   0.00-10.00  sec  2.32 GBytes  1.99 Gbits/sec                  receiver

iperf Done.

iperf-3.1.3-win64>iperf3.exe -c 192.168.1.138 -R
Connecting to host 192.168.1.138, port 5201
Reverse mode, remote host 192.168.1.138 is sending
[  4] local 192.168.1.99 port 55236 connected to 192.168.1.138 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  1004 MBytes  8.43 Gbits/sec
[  4]   1.00-2.00   sec  1.05 GBytes  9.06 Gbits/sec
[  4]   2.00-3.00   sec  1.06 GBytes  9.08 Gbits/sec
[  4]   3.00-4.00   sec  1.08 GBytes  9.24 Gbits/sec
[  4]   4.00-5.00   sec  1.09 GBytes  9.34 Gbits/sec
[  4]   5.00-6.00   sec  1.03 GBytes  8.81 Gbits/sec
[  4]   6.00-7.00   sec  1.09 GBytes  9.34 Gbits/sec
[  4]   7.00-8.00   sec  1.06 GBytes  9.11 Gbits/sec
[  4]   8.00-9.00   sec  1.05 GBytes  9.02 Gbits/sec
[  4]   9.00-10.00  sec  1.02 GBytes  8.79 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  10.5 GBytes  9.02 Gbits/sec    0             sender
[  4]   0.00-10.00  sec  10.5 GBytes  9.02 Gbits/sec                  receiver

iperf Done.

This was the previously WAN assigned interface. What's going on?

Same test using my computer as the iperf3 server:

Code: [Select]

-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.1.138, port 39562
[  5] local 192.168.1.99 port 5201 connected to 192.168.1.138 port 39563
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-1.00   sec   189 MBytes  1.58 Gbits/sec
[  5]   1.00-2.00   sec   999 MBytes  8.38 Gbits/sec
[  5]   2.00-3.00   sec   980 MBytes  8.22 Gbits/sec
[  5]   3.00-4.00   sec  1.06 GBytes  9.11 Gbits/sec
[  5]   4.00-5.00   sec  1.02 GBytes  8.74 Gbits/sec
[  5]   5.00-6.00   sec   944 MBytes  7.92 Gbits/sec
[  5]   6.00-7.00   sec  1.08 GBytes  9.32 Gbits/sec
[  5]   7.00-8.00   sec  1.09 GBytes  9.36 Gbits/sec
[  5]   8.00-9.00   sec  1.09 GBytes  9.33 Gbits/sec
[  5]   9.00-10.00  sec  1.09 GBytes  9.37 Gbits/sec
[  5]  10.00-10.76  sec   834 MBytes  9.15 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-10.76  sec  0.00 Bytes  0.00 bits/sec                  sender
[  5]   0.00-10.76  sec  10.3 GBytes  8.21 Gbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.1.138, port 39564
[  5] local 192.168.1.99 port 5201 connected to 192.168.1.138 port 39565
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-1.00   sec  5.12 MBytes  43.0 Mbits/sec
[  5]   1.00-2.00   sec   326 MBytes  2.74 Gbits/sec
[  5]   2.00-3.00   sec   354 MBytes  2.97 Gbits/sec
[  5]   3.00-4.00   sec   314 MBytes  2.63 Gbits/sec
[  5]   4.00-5.00   sec   392 MBytes  3.29 Gbits/sec
[  5]   5.00-6.00   sec   350 MBytes  2.93 Gbits/sec
[  5]   6.00-7.00   sec   336 MBytes  2.82 Gbits/sec
[  5]   7.00-8.00   sec   307 MBytes  2.57 Gbits/sec
[  5]   8.00-9.00   sec   395 MBytes  3.32 Gbits/sec
[  5]   9.00-10.00  sec   280 MBytes  2.35 Gbits/sec
[  5]  10.00-10.91  sec   316 MBytes  2.91 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-10.91  sec  3.30 GBytes  2.60 Gbits/sec                  sender
[  5]   0.00-10.91  sec  0.00 Bytes  0.00 bits/sec                  receiver

Cheers!

20.1 Legacy Series / iperf3 speed difference with 10G networking

« on: June 30, 2020, 04:25:09 pm »

Hello,

I am trying to deploy a new gateway for a small but demand home network: mine.

For the hardware I am using a supermicro server : https://www.supermicro.com/en/products/system/1u/5019/SYS-5019D-FN8TP.cfm

Which should be quite sufficient in regards to hardware.
Up until now I've installed OpnSense and updated it to the latest version:
OPNsense 20.1.7-amd64
FreeBSD 11.2-RELEASE-p20-HBSD
OpenSSL 1.1.1g 21 Apr 2020

In rest nothing else installed no pf rules and no other services running.

I have configured one of the SFP+ ports with a Twinax/DAC cable, as a wan interface and add 1 single pf rule which permits all traffic. The server is connected to a Ubiquiti XG 6 switch. No VLANS and no other fancy stuff. This is only used for testing.

My computer is a 9900K with an Aquantia AQC107 network card linked to the same switch with CAT6 cable.

I've started iperf3 on the opnsense and i've used my computer as client. The results are as follows:

Code: [Select]

iperf-3.1.3-win64>iperf3.exe -c 192.168.1.138
Connecting to host 192.168.1.138, port 5201
[  4] local 192.168.1.99 port 54029 connected to 192.168.1.138 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   175 MBytes  1.47 Gbits/sec
[  4]   1.00-2.00   sec   194 MBytes  1.63 Gbits/sec
[  4]   2.00-3.00   sec   200 MBytes  1.68 Gbits/sec
[  4]   3.00-4.00   sec   194 MBytes  1.62 Gbits/sec
[  4]   4.00-5.00   sec   200 MBytes  1.68 Gbits/sec
[  4]   5.00-6.00   sec   193 MBytes  1.62 Gbits/sec
[  4]   6.00-7.00   sec   196 MBytes  1.64 Gbits/sec
[  4]   7.00-8.00   sec   196 MBytes  1.64 Gbits/sec
[  4]   8.00-9.00   sec   193 MBytes  1.62 Gbits/sec
[  4]   9.00-10.00  sec   192 MBytes  1.61 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.89 GBytes  1.62 Gbits/sec                  sender
[  4]   0.00-10.00  sec  1.89 GBytes  1.62 Gbits/sec                  receiver

iperf Done.

iperf-3.1.3-win64>iperf3.exe -c 192.168.1.138 -R
Connecting to host 192.168.1.138, port 5201
Reverse mode, remote host 192.168.1.138 is sending
[  4] local 192.168.1.99 port 54050 connected to 192.168.1.138 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   109 MBytes   913 Mbits/sec
[  4]   1.00-2.00   sec   113 MBytes   949 Mbits/sec
[  4]   2.00-3.00   sec   113 MBytes   949 Mbits/sec
[  4]   3.00-4.00   sec   113 MBytes   949 Mbits/sec
[  4]   4.00-5.00   sec   113 MBytes   948 Mbits/sec
[  4]   5.00-6.00   sec   113 MBytes   949 Mbits/sec
[  4]   6.00-7.00   sec   113 MBytes   949 Mbits/sec
[  4]   7.00-8.00   sec   113 MBytes   949 Mbits/sec
[  4]   8.00-9.00   sec   113 MBytes   949 Mbits/sec
[  4]   9.00-10.00  sec   113 MBytes   946 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  1.10 GBytes   945 Mbits/sec    2             sender
[  4]   0.00-10.00  sec  1.10 GBytes   945 Mbits/sec                  receiver

iperf Done.

I've switched the DAC cable to the other port (ixl2). Link up. Then without configuring anything else in GUI i run dhclient for that network card and re-ran the iperf3 tests. And the results:

Code: [Select]

iperf3.exe -c 192.168.1.139
Connecting to host 192.168.1.139, port 5201
[  4] local 192.168.1.99 port 52943 connected to 192.168.1.139 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   311 MBytes  2.61 Gbits/sec
[  4]   1.00-2.00   sec   326 MBytes  2.74 Gbits/sec
[  4]   2.00-3.00   sec   343 MBytes  2.88 Gbits/sec
[  4]   3.00-4.00   sec   330 MBytes  2.77 Gbits/sec
[  4]   4.00-5.00   sec   330 MBytes  2.77 Gbits/sec
[  4]   5.00-6.00   sec   335 MBytes  2.81 Gbits/sec
[  4]   6.00-7.00   sec   342 MBytes  2.87 Gbits/sec
[  4]   7.00-8.00   sec   354 MBytes  2.97 Gbits/sec
[  4]   8.00-9.00   sec   349 MBytes  2.93 Gbits/sec
[  4]   9.00-10.00  sec   355 MBytes  2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  3.30 GBytes  2.83 Gbits/sec                  sender
[  4]   0.00-10.00  sec  3.30 GBytes  2.83 Gbits/sec                  receiver

iperf Done.

iperf-3.1.3-win64>iperf3.exe -c 192.168.1.139 -R
Connecting to host 192.168.1.139, port 5201
Reverse mode, remote host 192.168.1.139 is sending
[  4] local 192.168.1.99 port 52970 connected to 192.168.1.139 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   975 MBytes  8.18 Gbits/sec
[  4]   1.00-2.00   sec  1.06 GBytes  9.13 Gbits/sec
[  4]   2.00-3.00   sec  1.06 GBytes  9.06 Gbits/sec
[  4]   3.00-4.00   sec  1.06 GBytes  9.08 Gbits/sec
[  4]   4.00-5.00   sec  1.10 GBytes  9.41 Gbits/sec
[  4]   5.00-6.00   sec  1.06 GBytes  9.12 Gbits/sec
[  4]   6.00-7.00   sec  1.08 GBytes  9.30 Gbits/sec
[  4]   7.00-8.00   sec  1.04 GBytes  8.91 Gbits/sec
[  4]   8.00-9.00   sec  1.10 GBytes  9.44 Gbits/sec
[  4]   9.00-10.00  sec  1.09 GBytes  9.32 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  10.6 GBytes  9.10 Gbits/sec    0             sender
[  4]   0.00-10.00  sec  10.6 GBytes  9.10 Gbits/sec                  receiver

iperf Done.

Something is really wrong here....

Any ideeas?

Cheers!

Pages: 1 [2]