Messages

1

24.7 Production Series / Re: 24.7 CPU Temps

« on: October 25, 2024, 06:13:37 pm »

Sorry to bring up an old thread, but this latest 24.7.7 update seems to have helped reduce the CPU utilization problem. I'm still not at pre-24.7 levels, but it's definitely a welcome steep drop I can see in my health reporting charts. Another user in the update thread on Reddit has posted the same positive observation.

Does anyone know what changed that improved this?

2

24.7 Production Series / Re: Power Management with AMI (standard) vs Coreboot BIOS on Protectli devices

« on: September 14, 2024, 02:10:05 am »

I also use a Protectli VP2420, and after the 24.7 update have had higher CPU temps and utilization. After a little research on things to mitigate the problem, I added the "dev.cpu.0.cx_lowest" tunables.

This reduced my CPU temps by ~4C, and haven't noticed any issues. I was concerned about possible stability or latency issues, but so far it has been a positive improvement.

3

24.7 Production Series / Re: 24.7 CPU Temps

« on: September 02, 2024, 09:07:07 pm »

I apologize if I sounded argumentative, was just trying to relay what I'm seeing. I genuinely only take issue with one person in this thread.

One note, I'm currently limited to what I can access via web GUI...

I checked my config.xml and <updatefreq> was only set for one 1 alias (not the Geoblock), of which I updated it so it's no longer set either... That had no impact, however.

Playing with Geoblock further, I have to get the number of current table entries below 100,000 (only 1/10th of the Geoblock list) for there to be any impact to temps and utilization.

I'm also curious about what exactly is happening when update_tables.py runs and the task it's performing, since it's not actually updating the aliases. If it were, I assume I'd see changes to the "Last updated" timestamp everytime it runs. However, the time stamp is only updating once a day based on Cron schedule.

4

24.7 Production Series / Re: 24.7 CPU Temps

« on: September 02, 2024, 01:30:14 am »

I only have 5 aliases, and I followed the guides when I did my initial install. There is enough available, there are no errors in my logs, and the problems didn't arise until after the 24.7 install - which is why I could see the noticeable difference in health reporting.

I searched before posting, and there is a lot of people reporting that specific process running about once a minute over the years without anyone contradicting it as abnormal... Disabling the Geoblock alias also does not change the frequency that the process runs, it only changes the percentage of CPU utilization to pre-24.7 levels.

5

24.7 Production Series / Re: 24.7 CPU Temps

« on: September 02, 2024, 01:06:17 am »

It's not running all the time, but approximately once a minute for a few seconds which is enough to effect temperature readings and the average CPU usage under health reporting.

6

24.7 Production Series / Re: Weird CPU utilization since 24.7.2

« on: September 02, 2024, 12:10:03 am »

Do you happen to use any firewall aliases with large table entries loaded?

I discovered that by disabling Maxmind Geoblock, I'm able to reduce my temperatures and utilization to pre-24.7 levels. Since I made no alteration to any of mine between 24.1 and 24.7, I think python 3.11 introduced a bug.

7

24.7 Production Series / Re: 24.7 CPU Temps

« on: September 02, 2024, 12:06:57 am »

Followup:

I've found a workaround that reduces my CPU utilization and temps to pre-24.7 levels. The problem is:
/usr/local/bin/python3 /usr/local/opnsense/scripts/filter/update_tables.py

When I disable the Maxmind Geoblock aliases, the CPU temp drops by 10C and utilization from that process drops by 50%. If I reenable that alias, the temp and utilization jump back up.

I have not altered any of these aliases, and the table entries are consistent with what they were under 24.1. This leads me to believe there is still an underlying problem that needs to be identified (this just helps narrow it down).

Since this is a python script, and 24.7 brought us python 3.11 - Is it possible that python 3.11 is the underlying problem?

8

24.7 Production Series / Re: Weird CPU utilization since 24.7.2

« on: August 30, 2024, 12:54:55 am »

Fun fact, I saw your thread on Reddit and linked to it here (sorry for not responding, I don't have an account there):
https://forum.opnsense.org/index.php?topic=41759.45

I've also noticed increased CPU utilization, and wondering if increased temperature readings are a 3rd order effect of whatever the overall underlying cause is.

I personally have been unable to identify the reason for it.

9

24.7 Production Series / Re: 24.7 CPU Temps

« on: August 28, 2024, 10:03:05 pm »

Or, hear me out, the CPU utilization issue seen here and elsewhere is the problem.

10

24.7 Production Series / Re: 24.7 CPU Temps

« on: August 28, 2024, 06:37:21 pm »

I am not ignoring that, as I'm well aware that hardware differences and such can impact differently just like with any other piece of software. Any legitimate testing takes into account different platforms.

11

24.7 Production Series / Re: 24.7 CPU Temps

« on: August 28, 2024, 06:14:07 pm »

I am not running Suricata. The only optional services I'm running are CrowdSec and Unbound, of which neither appear to be the crux of the issue as their utilization is the same as before. There are no runaway processes, nor indicators in my logs. My configuration between 24.1 and 24.7 is identical outside of what changed from the update.

This exact problem is also being noticed and shared outside of this particular forum. Here is another example from a user on Reddit that has a screenshot of the same trend myself and maxus have seen after the update:
https://www.reddit.com/r/opnsense/comments/1f13bkk/weird_cpu_utilization_since_2472/

Instead of irrationally deriding the problem as an issue with my forum post count, lets try acknowledging that multiple people are sharing the exact same data point of historical CPU utilization showing steep increases following the 24.7 update with no other configuration changes. In each case CPU utilization skyrockets immediately after the update (as obviously shown in the graphs) and maintains a significantly higher average than under 24.1.

I was seeing other similar posts from people prior to discovering I had the same problem. I didn't notice any obvious performance or operational impacts from normal use, and bought into the initial narrative that higher CPU temps were simply a result of how the new widget is reporting. However, after seeing repeated claims of higher CPU utilization with 24.7 I looked into my own health reports, and realized I have the same vertical cliff face of dramatically increased usage and load averages. Now that I'm seeing multiple people with the same problem, I'm not inclined to believe CPU temps are anything less than a symptom of a greater flaw.

12

24.7 Production Series / Re: 24.7 CPU Temps

« on: August 28, 2024, 01:01:36 am »

If you think an unexplained 25x increase in CPU utilization resulting from an update is a non-existent problem, then there is no hope in discussing this rationally.

It's very clearly a flaw and it explains why more heat is being generated.

13

24.7 Production Series / Re: 24.7 CPU Temps

« on: August 28, 2024, 12:48:59 am »

You're ignoring the underlying problem of both mine and maxus' concern regarding the higher CPU utilization, and higher temps being a symptom of it.

If it were *just* a widget reporting higher temperatures, I wouldn't be so annoyed with your responses... But a major increase in utilization correlates with what we're seeing.

I'm also well aware of what my specs are as I'm seeing spikes of temps above 70C, which is the maximum for my processor. Right now it's averaging 60C.

14

24.7 Production Series / Re: 24.7 CPU Temps

« on: August 28, 2024, 12:31:11 am »

I think this is worth investigating and patching before anyone has hardware failure as a result.

This is getting borderline absurd. Get a better cooling system if you have such concerns.

My cooling system wasn't a problem in 24.1.

My CPU utilization increasing for no apparent reason in 24.7 and producing more heat is though.

Why be so condescending about a problem that is so easily observable and graphed in the system history?

15

24.7 Production Series / Re: 24.7 CPU Temps

« on: August 28, 2024, 12:22:42 am »

maxus,

I'm having the exact same issue and observations, and I do not believe the higher temperatures are strictly the result of how they're being reported as explained by others. Instead, as you inferred, I think the temperature is the result of higher CPU utilization.

Under Reporting -> Health my 'user' and 'system' processor utilization is showing it run 25 times higher under 24.7.x than under 24.1. The number of existing processes is still the same though. Logically, this explains why I am also seeing temperatures that are 10 to 15 degrees higher and peaking into maximum range of what my processors specs.

I think this is worth investigating and patching before anyone has hardware failure as a result.