A memory leak ate up all my truenas memory
When I built my own Truenas SCALE system, I purchased new RAM, CPU, computer case and motherboard.
Turns out, I had not updated the BIOS which is something I normally do. It came to bite me later when there were ACHI errors flooding my server. So much so that it ate up all my RAM and stopped my VM from running because there was no RAM left.
This VM was my K8s cluster node. I was at a loss until I updated the BIOS which also happened to be a very early version of Arrow Lake.
It was weird that my memory was being eaten up by ‘Services.’ It was a little tricky to track down. Nothing in the logs pointed to the error funny enough. I only saw these ACHI errors when I plugged a monitor into my NASA system and saw what was going on.
I think the smoking gun was the first core in my CPU being constantly pegged. Then, after about a day or two, my memory would be gone and I’d have to restart to clear the RAM.
I’m glad it was an easy fix.

