Consensus DB downloads

  • @Taek Thanks for the reply. The drive is Microsoft storage space with parity (sort of software RAID5 with extremely large stripes) It's indeed somewhat slow, but this kind of load for it is the worst I can think of performance-wise. But it's almost synced now, and as it's a one-time operation and the configuration is probably rare, I guess it's not a serious issue.
    Upd: after the download finished, the storage is indeed mostly idle.

  • admins

    Oh yeah, doing RAID on top of the random writes that we use in the database would destroy performance, that completely explains why it was taking so long.

    After 1.0 is released we're going to be spending some energy on optimization, and also on finding people to help us with optimization. Though I'm not sure there's much we can do about the slowdowns associated with RAID. We're storing a bunch of hashes on disk in sorted order, there's not a whole lot we can do to improve that performance (other than batch things better so it's not nearly as random).

  • Global Moderator

    Hey, I just want to say that it seems like the 0.6 consensus.db is in fact compatible with 1.0. But I will still update it anyway, next time I restart my wallet.

    Link is there now!

  • A few updates:

    1. It still makes sense not to keep the blockchain on a slow drive as the wallet unlocking time can get ridiculously high (more than an hour, no kidding!)
    2. I had no success bootstrapping download with your blockchain snapshot, @fornax. Did you verify that it's usable? Maybe there are some caveats?

  • Global Moderator

    Should be usable, I use it for bootstrapping new nodes too. It just takes a while to load the consensus set for the first time, but it's still faster than completely downloading it from scratch.

  • Global Moderator

    Added 1.2.1

  • Global Moderator

    It has come to my attention that the consensus database has grown over 5 GB since I last uploaded it.. Pixeldrain has a file size limit of 5 GB, so I can no longer update this list through traditional methods. The last version I uploaded still works fine with the latest version of Sia, so you can use that for now.

    For the next database version I may set up a little webserver that automatically releases the latest consensus db to the public every day or so. Or I need to increase pixeldrain's file size limit, this is also an option since it's my own website. But that would require modifying the code, I'd rather not do that.

  • Hi, Could you please add the db file for 1.3.0?

  • Global Moderator

    Hey @pashapanther, this thread has been abandoned since a long time. I have written a guide over on the wiki to replace it. Check it out here:

Log in to reply