siad is constantly writing to disk

  • I've setup siad and already host ~5GiB. I noticed that siad is constantly performing write operations.

    Total DISK READ :     904.36 K/s | Total DISK WRITE :     239.43 K/s
    Actual DISK READ:     904.36 K/s | Actual DISK WRITE:     344.83 K/s
      TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND                                  
      287 be/4 sia       208.20 K/s   39.04 K/s  0.00 %  9.93 % siad -d /var/lib/sia
     1272 be/4 sia        19.52 K/s   23.42 K/s  0.00 %  5.81 % siad -d /var/lib/sia
      274 be/4 sia        42.94 K/s   46.84 K/s  0.00 %  4.88 % siad -d /var/lib/sia
      383 be/4 sia         0.00 B/s   65.06 K/s  0.00 %  4.25 % siad -d /var/lib/sia
     1274 be/4 sia         0.00 B/s   52.05 K/s  0.00 %  4.02 % siad -d /var/lib/sia
      296 be/4 bitcoin   633.70 K/s    0.00 B/s  0.97 %  2.01 % bitcoind -daemon [bitcoin-msghand]
      343 be/4 sia         0.00 B/s   13.01 K/s  0.00 %  0.00 % siad -d /var/lib/sia
        1 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % systemd --system --deserialize 20
        2 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.

    The blockchain is fully synced. While it would be great, I doubt that there are constants file uploads going on, as my storage's folder used space does not grow.

    Compare this to bitcoind running on the same system, which mostly performs reads and occasional writes (e.g. when a new block is found).

    Why does siad constantly write ~200 KiB/s to disk?

  • @Flow my guess is not enough hosts to 3x redundancy all the data.. so therefore everyone is on max load. But this would defy the logic of only hosts storing data. So I am not sure... I have noticed the same.

    Unofficial User / Tester / Analyst of Sia ( w/Renter and Host experience)


  • @Flow Yes, i have noticed same behavior even on empty (= without any active contracts with renters) node. siad writes about 10 GB of data to disk every day on idle nodes.
    So it's definitely not a files uploads from renters.

    I set up disk monitoring for siad process and found out what it is constantly (every second!) rewrite all files in \sia\host\contractmanager\ folder.

    Looks like a bug for me...

  • @Mad_Max definitely a drain on resources- I thought it was just me.

    Unofficial User / Tester / Analyst of Sia ( w/Renter and Host experience)


  • Thanks so far your replies. Sadly I can confirm that this behavior is also existent in the master branch of today.

  • It use many local databases which is saved every 1-2+ minutes and of course blockchain(transactions etc...).
    And also p2p sharing data over network.

  • @Sanasol said in siad is constantly writing to disk:

    Yes, and it is a normal behavior for blockchain, txpool, renter db - siad write only new/changed data to disk every minute or so.
    But for host contracts database siad entirely rewrite all 4 files (create file, fill with data, delete it, create again, fill, delete and so on) not every 1-2 minutes, but every second!
    On classic HDD you can ever hear it - after siad start HDD works rhythmically, like a ticking clock non stop. lol - actually this is how i initially discovered this - by strange HDD sounds.

    And siad does so even if there were no any changes in contracts at all. No any changes to write to DB, but program still rewrite it every second.

    This is definitely not a normal behavior.

  • I have checked new sia version (1.3.0) and found out - this bug is still here.
    Client re-writes some files continuously every second.

    May be in next release...

Log in to reply