cannot get traffic shaper to work properly

[actionhenkt]

Hi, Im trying to configure the traffic shaper on opnsense. On the shaper settings I created:

1 upstream pipe 40mb
1 downstream pipe 180mb

1 normal upstream queue - weight 1 (used for normal upstream traffic)
1 normal downstream queue - weight 1 (used for normal downstream traffic)
1 higher prio upstream queue - weight 10 (used for higher prio upstream traffic)
1 higher prio downstream queue - weight 10 (used for higher prio downstream traffic)

1 rule with tcp/ack proto (sequence 1) - connected to higher prio upstream queue with weight 10, left settings default (src/dst any)
1 rule for download (sequence 2) - connected to normal downstream queue all settings default
1 rule for upstream (sequence 3) - connected to normal upstream queue also all settings left default

Tried a speed test and my max download is now 40mb, how do I make it use the downstream pipe (switched it around aswell, setting upstream to downstream but the download speed remains 40mb) ?

Thanks!