Problem DEC750 freeze with 26.7 version

Started by droumanet, September 02, 2026, 08:40:29 AM

Previous topic - Next topic
After few days running, my DEC750 freeze.
Console port says something about
zfs: WARNING: Pool 'zroot' has encoutered an uncorrectable I/O failure and has been suspended

AI help me to check temperature was too high, so I changed place and now it seems to be ok (according to os-smart: max 68°C)

Anybody have an idea how to troubleshoot (console is not usable) ?

Your SSD might be failing. Run a long SMART test. Also run a zpool scrub.
Deciso DEC750
People who think they know everything are a great annoyance to those of us who do. (Isaac Asimov)

I did many tests and there is no failure. AI suspected too much write on it, then I reduced rules log, rddtools and some settings.
Let see for next tests

Quote from: droumanet on September 02, 2026, 10:44:37 AM[...]AI suspected too much write on it[...]

"Services: SMART" -> "Info", "Info type" = "Attributes", "View". Anything out of nominal? I have most rule logging enabled, and show 2.3TB written over nearly two years.

It seems I've 12 TB in less than one year. Main of them are Outbound DNS level 3 (down to level 2).
This morning, here are statistics:

=== START OF SMART DATA SECTION ===
SMART/Health Information (NVMe Log 0x02, NSID 0xffffffff)
Critical Warning:                   0x00
Temperature:                        52 Celsius
Available Spare:                    100%
Available Spare Threshold:          10%
Percentage Used:                    13%
Data Units Read:                    662,615 [339 GB]
Data Units Written:                 24,519,123 [12.5 TB]
Host Read Commands:                 4,037,958
Host Write Commands:                465,833,667
Controller Busy Time:               4,513,538
Power Cycles:                       30
Power On Hours:                     4,677
Unsafe Shutdowns:                   24
Media and Data Integrity Errors:    0
Error Information Log Entries:      0
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0
Temperature Sensor 1:               66 Celsius
Temperature Sensor 2:               41 Celsius
Temperature Sensor 3:               52 Celsius
Thermal Temp. 1 Transition Count:   93
Thermal Temp. 1 Total Time:         4478


The main temperature of the firewall (in Dashboard) is 39.1°C, so 66°C for NVMe0 is strange, no?

Passively cooled 66 C is not uncommon. Percentage used is at 13% so you still have more than ten years of specified life at your current write rate.

What model is this? It probably has a TBW (terabytes written) spec of 100 or so.
Deciso DEC750
People who think they know everything are a great annoyance to those of us who do. (Isaac Asimov)

Thanks Patrick !
You're right, it's a
Transcend TS256GMTE712A (série MTE712A)

I've made some write reduction (outbound DNS, tested rules, etc.) and since that, no more error.

Today
SMART/Health Information Log
============================
Critical Warning State:         0x00
 Available spare:               0
 Temperature:                   0
 Device reliability:            0
 Read only:                     0
 Volatile memory backup:        0
Temperature:                    325 K, 51.85 C, 125.33 F
Available spare:                100
Available spare threshold:      10
Percentage used:                13
Data units (512,000 byte) read: 858477
Data units written:             24738666
Host read commands:             4822576
Host write commands:            468806337
Controller busy time (minutes): 4513573
Power cycles:                   30
Power on hours:                 4823
Unsafe shutdowns:               24
Media errors:                   0
No. error info log entries:     0
Warning Temp Composite Time:    0
Error Temp Composite Time:      0
Temperature Sensor 1:           340 K, 66.85 C, 152.33 F
Temperature Sensor 2:           315 K, 41.85 C, 107.33 F
Temperature Sensor 3:           325 K, 51.85 C, 125.33 F
Temperature 1 Transition Count: 93
Temperature 2 Transition Count: 0
Total Time For Temperature 1:   4478
Total Time For Temperature 2:   0

Sorry to re-open this post, but problem still occur. I've changed my hardware (we've bought two appliances) and send the first one to Decisio... however, the firewall (new appliance) still freeze.
This time, I'll have a look at log (logging to a graylog server), because here are the symptoms:
  • The firewall still route and (I hope) filter packets
  • Any way to access management is impossible: HTTPS, SSH, USB Console
On console, the message happens between login (I don't use root but a sudoer account) and password

FreeBSD/amd64 (fw.btssio.domain) (ttyu2)

login: adminfw
zfs: WARNING: Pool 'zroot' has encountered an uncorrectable I/O failure and has been suspended.

I can do nothing but shutdown the appliance and after that, I don't know how to troubleshoot the problem (maybe I've removed to much log?)


The error message is enough: "uncorrectable I/O failure". Replace the SSD.
Deciso DEC750
People who think they know everything are a great annoyance to those of us who do. (Isaac Asimov)

Quote from: Patrick M. Hausen on <strong>Today</strong> at 06:11:54 PMThe error message is enough: "uncorrectable I/O failure". Replace the SSD.
But that's the second same appliance? Is that possible we've got a bad series? I'll wait for Decisio troubleshooting on my first appliance but I feel unlucky 😅