[SOLVED] Traffic Shaper: Weights over 50 MBit/s faulty

[nuwe70]

Hello,
I have discovered a strange problem using the Weighted Fair Queueing scheduler. The greater the bandwidth of the pipe, the less the weight matters. This behaviour starts about at a pipe bandwidth of 50 Mbit/s.

The following measurements show the problem.

Pipe Bandwidth	Host1 Bandwidth (Weight 100)	Host2 Bandwidth (Weight 1)
10 Mbit/s	9,56 Mbit/s	100 Kbit/s
20 Mbit/s	19,1 Mbit/s	185 Kbit/s
30 Mbit/s	28,7 Mbit/s	290 Kbit/s
40 Mbit/s	38,3 Mbit/s	380 Kbit/s
50 Mbit/s	47,7 Mbit/s	740 Kbit/s
60 Mbit/s	55,3 Mbit/s	2,46 Mbit/s
70 Mbit/s	55,8 Mbit/s	12,1 Mbit/s
80 Mbit/s	55,9 Mbit/s	22,2 Mbit/s
90 Mbit/s	55,8 Mbit/s	31,5 Mbit/s
100 Mbit/s	55,8 Mbit/s	41,1 Mbit/s

The Bandwidth tests were performed with iperf3. The test setup consists of one pipe, two queues and two roles.

Code: [Select]

Bandwidth: 100  (adjusted for each test as seen above)
Metric: Mbit/s
Mask: none
Description: PipeDown


Code: [Select]

Pipe: PipeDown
Weight: 100
Mask: none
Description: QueueDownHigh


Code: [Select]

Pipe: PipeDown
Weight: 1
Mask: none
Description: QueueDownLow

Rule "ShapeDownHigh" assigns traffic from Host1 to the queue "QueueDownHigh".
Rule "ShapeDownLow" assigns traffic from Host2 to the queue "QueueDownLow".

Does anyone have an idea what the problem might be? Does a similar setup work for anyone?

[mimugmail]

Inzeresting, I try to reproduce.

What happens when you switch to QFQ instead WFQ

[nuwe70]

Thank you for your response! But unfortunately no difference.

[mimugmail]

Any chance to test with 20.1?

[hkp]

Are you sure host1 is able to saturate the pipe? What happens when you remove the second queue? Does host1 deliver 100MBits?

[nuwe70]

@hkp Sure. Then I get around 870 Mbit/s.

@mimugmail Yes. I have just downloaded OPNsense 20.1 and I will set up the test environment shortly.

[nuwe70]

Unfortunately exactly the same problem exists in OPNsense 20.1.
Edit: And also in OPNsense 19.1.4 

[mimugmail]

This is good, not another problem due to 20.7 .. I'll test next week

[nuwe70]

Are there any news here? Can anyone try to reproduce this problem?

[nuwe70]

push 

[nuwe70]

I think it's a bug in ipfw/dummynet. The same behaviour appears in the Limiter of pfSense.

[mimugmail]

I think it's a bug in ipfw/dummynet. The same behaviour appears in the Limiter of pfSense.

Do you have a link for this?

[nuwe70]

Do you have a link for this?

I read that the framework behind the pfSense Limiter is what OPNsense uses as traffic shaper technology. So I have set up a new pfSense VM and tested it myself. The result is the same as described in the first post. Bandwidth without Limiter enabled 2.30 Gbits/sec.
The config screenshots are attached. Additionally, two rules that redirect traffic from two different hosts to queueLow and queueHigh.

[mimugmail]

Do you know if this is tracked somewhere at pfsense (forum or redmine).

[nuwe70]

No, unfortunately I have not found anything there.