Sia bandwidth usage
-
Has anyone measured the typical bandwidth usage by the Sia daemon, or have suggestions for some good tools to isolate, and measure, Sia traffic on Linux?
-
Found nethogs which seems to do the job. In/out traffic seems to average at about 17 Kb/s, i.e. excess of 1 Gb per day. This exclude any file up/downloads (node is also not hosting). It does seem a bit high in my mind. Is this bandwidth consumption reasonable?
-
Seems in-line with what I would expect. Right now when there's a new block or transaction, it get flooded to all peers. That means minimally an 8x blowup, but if you are well-connected it could mean a 50x+ blowup for the amount of bandwidth that you would expect to see.
For the time being it hasn't been a huge problem for people. 1GB per day is a lot but it shouldn't really interfere with data caps. We will be optimizing things at some point, but right now we're much more concerned about the user experience than we are about the data usage. Sia needs to be easier to use.
-
I am new to the site, and fairly new to siacoin and the wallet / UI, however, after about 2 weeks worth of using it, I have noticed a LOT of bandwidth usage for my 2 sites ive installed the client at. In some cases, I am seeing over 2 gigs of data PER HOUR being transferred. Is this something to expect in the future as well? Also some of the files ive seen in in the wallet that have been uploaded to my share, have been in excess of 300 MB, that also seems high if the files are supposed to be broken down and sent to several hosts over the network.
-
Is this something to expect in the future as well?
No. Most of the bandwidth is a result of highly inefficient gateway code. You are also seeing a lot of bandwidth usage because a lot of people tried out Sia this week and they all needed to download the whole blockchain, something that, (currently), puts like 5GB of network strain on the network per new user. In the future, it should be significantly less usage, because we're currently upgrading the networking code. I think we can bring down the bandwidth usage by about a factor of 10. Even more if we start distributing the first 35,000 blocks with the client downloads, at that point people will only need to catch up on the recent chain, instead of on the whole chain.
Files that are 300MB in size on your server are not surprising. Currently, files are spread across 24 hosts at a redundancy of 6, meaning each host gets 1/4th of the original file size. So, 300MB corresponds to a 1.2GB file, and demonstrates that the uploading code is working well with large files. I'm actually glad to see that you have files that large.
-
@Taek said:
Is this something to expect in the future as well?
No. Most of the bandwidth is a result of highly inefficient gateway code. You are also seeing a lot of bandwidth usage because a lot of people tried out Sia this week and they all needed to download the whole blockchain, something that, (currently), puts like 5GB of network strain on the network per new user. In the future, it should be significantly less usage, because we're currently upgrading the networking code. I think we can bring down the bandwidth usage by about a factor of 10. Even more if we start distributing the first 35,000 blocks with the client downloads, at that point people will only need to catch up on the recent chain, instead of on the whole chain.
Files that are 300MB in size on your server are not surprising. Currently, files are spread across 24 hosts at a redundancy of 6, meaning each host gets 1/4th of the original file size. So, 300MB corresponds to a 1.2GB file, and demonstrates that the uploading code is working well with large files. I'm actually glad to see that you have files that large.
Ok thats fine, as long as in the future the data usage drops. At some point im going to be running a server at my home, and 2Mbps up tends to get killed, im assuming when the blockchain is being downloaded by someone. Ill just worry about setting it up there in a couple of months once there are more nodes.
Is there a file size limit? Im currently offering up about 5 TB, and its really not a space issue, just wanting to learn more about it. I think the project in general is a great idea.
-
Is there a file size limit? Im currently offering up about 5 TB, and its really not a space issue, just wanting to learn more about it. I think the project in general is a great idea.
There is no filesize limit, and currently Sia actually works much better with large files than it does with small files. The difference should be eliminated once we finish the file batching code.
