Upload speed
-
Hello!
I ran Sia-UI on Fedora Linux, added 5000 SC to wallet, created allowance with 5000 SC (as Sia-UI said approx 300Gb for 3 monthes). Contracts were created successfully. Then I tried to upload two files 1,3 Gb and 2,1 Gb. They are uploading several hours. Initially uploading was with reasanable speed. But now uploading practically stopped.
Is it normal?renter list
Tracking 2 files:
1.307 GB 0B0;LO 8 ;5:A59 G1.zip (uploading, 79.17%)
2.098 GB 0B0;LO 8 ;5:A59 G2.zip (uploading, 53.14%)
-
That's looking pretty good actually, for just a few hours.
The uploads tend to slow down as they progress. When you start an upload it starts sending your data to the hosts, when it has sent the entire file once the files is marked "available", this means that the file can be downloaded from the network. When that is done the Sia client will start boosting the file's redundancy. This is like an insurance against host downtime. When the file first becomes available the client has uploaded just enough data re retrieve the file from the hosts, but when one of the hosts goes down it goes lost. So by boosting the redundancy it uploads more redundant data to the hosts that can be used to reconstruct the file even if some hosts go offline. The last bits of redundancy are very slow, but it looks like your files should already be pretty safely stored in Sia.
It's true that uploads are currently painfully slow, and this has high priority with the developers. A new release should come out soon that will multiply the upload speed many times :).
-
Thank you for fast reply!
May be a lot of small files are better than a few of big?
-
The upload speed scales with the file size, small files are even slower because it will send smaller chunks every upload round.
-
We've got some changes coded up at this point which should give a pretty substantial speedboost, even at the end of the file. It's not going to make it into the next release, but shouldn't be too much after.
We're still running the early tests on it, but I'm estimating it'll be able to saturate most home connections, and even most seedboxes.
-
@reinhard 1-2 GB is not particularly big. 100 GB is big. I would not worry about the size of your files. As Fornax points out, uploads sometimes stop for a while and then pick up speed again. Just leave Sia alone and don't obsess over minute by minute progress. In a day or two your files should get to full (x6) redundancy on the network.
-
@in-cred-u-lous thank you for reply!
The files was marked as uploaded during the night.
How can I view redundancy of the files?
I've summarized data column in renter contracts output and have got 15821 MB
Comparing with original file sizes (3405MB) it is approx. 4,64 time more.As far as I understand, Sia is not ready yet for storage of daily backups with size 200-300 GB?
-
You can view file redundancy by turning on verbosity:
./siac renter -v, that should give you detailed info on everything your uploads are doing.
-
@reinhard The new v1.0.4 just released today shows you the redundancy in the UI. Check it out:
http://forum.sia.tech/topic/827/sia-v1-0-4-and-v1-0-4-lts-released
-
Sia today is not ready for 200GB per day in uploads, no. It tops out at about 10 GB per day right now.
We're pretty far along in implementing + testing something that should boost the speeds substantially. Even then though I think it'll start to struggle above maybe 2 TB total until we make some further improvements. (the current implementation does a lot of unnecessary disk I/O. Not so bad at 100 GB, but a lot worse at 2 TB. The improvements I'm working on today don't fix that portion, they address the networking speeds).
I'm planning on writing a roadmap update next week to explain everything that we're working on and guess at the timeline for implementation.
-
@in-cred-u-lous I've just installed v1.0.4 yes, it shows redundancy, thanks. It's cool. Now redundancy of files I uploaded is 3.75. Is this final value? Will it grow?
Tracking 2 files:
File size Available Progress Redundancy Renewing Sia path
1.307 GB Yes 82.75% 3.75 Yes Nataly_Alex_p1.zip
2.098 GB Yes 73.05% 3.75 Yes Nataly_Alex_p2.zip
-
@Taek well, Sia is not ideal solution now but I hope it will become better.
Keep up good work!
Thank you!
-
Is this final value? Will it grow?
If all goes according to plan, it'll grow until it hits a value of 6.0. Sia is not super flexible at the moment about picking up those final hosts, and so I wouldn't be surprised if it stops at 3.75. The best way to tell is if the total amount of data uploaded is still increasing.
This is something we'll also be fixing in the next major version - we've got the first part coded already and the second part should be done early next week.
-
Will it grow?
Most of my files stop at a redundancy of 5.25. The target (max) is 6, but 5.25 is still pretty good.
