I just woke up to all my lights on and my server off. It was a power cut, but… Checking the logs for Proxmox, it seems to have lost memory… There were no logs for 10 days and when rebooting it said the system clock was off by as much (931,920 seconds = 10.7 days). What do? Anyone seen this before?

Thanks all, gonna replace the CMOS battery as suggested. Got a few in storage. 🖤

    • lime_red@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      6 days ago

      I feel like other things would have misbehaved if the power frequency was too low. And I’d expect the RTC to run well while power is on, and fail to accumulate time while power is off, but still remember the time at power off.

      None of what I said above explains what we are seeing with our eyes though.

  • 486@lemmy.world
    link
    fedilink
    English
    arrow-up
    29
    ·
    6 days ago

    It is just a dead CMOS battery. So the clock had the wrong time, which in turn also causes the log entries to have the wrong time and date. Simply replace the battery. It is most likely of the CR2032 type.

  • galacticbackhoe@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    5 days ago

    What kind of storage is it running on? Maybe the filesystem went read-only as another possibility to cmos battery issues.

    Usually a cmos battery alone wouldn’t cause something like logging to stop.

  • lime_red@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    6 days ago

    In line with the possibility of your system’s clock actually being wrong, can you correlate some other events in your logs to when you know they occurred? What about inside your VMs and CTs?

  • thelittleblackbird@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    6 days ago

    By any chance… Your proxmox is not close to any source of big electromagnetic fields, right?

    Close to big Transformator or electric motors, right?

  • Possibly linux@lemmy.zip
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    2
    ·
    5 days ago

    Switch to ZFS

    Ext4 is way to vulnerable to power loss. It just keep a journal but it isn’t nearly as robust as ZFS