3. file retrieval

file retrieval

  • admins

    ok. Unfortuantely I don't think the v0.4.8 renter saves very frequently because I've lost files this way too. We've addressed this in the release that's coming out on Jan. 22nd. We've also taken a bunch of steps to improve upload speeds. Uploads still aren't as fast as they could be, but should be substantially improved over v0.4.8.

    I'm sorry for the trouble.

    0
  • I
    Global Moderator

    Why don't you also try uploading a couple of smaller files? Just to convince yourself everything is working. As taek mentions, the file could have been lost due to your accidental shut-down.

    3.8 GB in a day is not bad. Remember that your data is duplicated 5 times over, so in fact you uploaded 3.8 x 5 = 19 GB of data! If any (or, several) of the hosts keeping your data went offline, your data would still be safe on the Sia network, thanks to this built-in redundancy.

    0
  • W

    So on Jan 22nd it will be saving the renter more often? How often exactly? Is there a searchable way to find the lost file? like by name maybe? Just to see if a file is anywhere on the Sia network? If I had previously stored the share code, would I today be able to access my lost files? Just wondering how to help people not have this happen to them. I still have some local copies of the files.

    0
  • admins

    How often exactly?

    After every 4mb that gets uploaded.

    All files on the Sia network are encrypted. If the file is not showing up in the GUI, it likely means that the encryption passwords has been lost, which means even if you could find the host that has the file, you still would not be able to decrypt it.

    0
  • W

    error 500 Internal Server Error Upload failed:rename renter\minecraft_server.sia_temp

    Whats up with this?

    then they just stay processing but don't confirm? Yesterday it worked?

    0
  • I
    Global Moderator

    Did you try to rename a file? Renaming is disabled / not-implemented in 0.4.x

    0
  • W

    ok cool its working now :) This is awesome

    0
  • L

    @in-cred-u-lous said:

    3.8 GB in a day is not bad. Remember that your data is duplicated 5 times over, so in fact you uploaded 3.8 x 5 = 19 GB of data! If any (or, several) of the hosts keeping your data went offline, your data would still be safe on the Sia network, thanks to this built-in redundancy.

    Is there, or will there be in the future (maybe when bandwidth is paid in coins like storage), any provision to let hosts take care of propagating your uploaded file to other hosts for redundancy, instead of having to do it yourself when you first upload it? This could help low-uplink renters tremendously.

    0
  • I
    Global Moderator

    Is there, or will there be in the future (maybe when bandwidth is paid in coins like storage), any provision to let hosts take care of propagating your uploaded file to other hosts for redundancy, instead of having to do it yourself when you first upload it? This could help low-uplink renters tremendously.

    As the Sia network grows, the need for redundancy decrease. @Taek can elaborate on the numbers, but realistic figures with not much growth seems to be 1.5 - 2 times redundancy.

    0
  • admins

    For security reasons, it's important the the user upload all of their own redundancy, which is unfortunate. There could be middleman services or hosts that offer a significant amount of collateral to do extra redundancy on their end, but for now that stuff doesn't exist.

    As Sia continues to grow, Sia will be able to offer reliability equivalent to Amazon at a redundancy of about 1.5x. When Sia is a fully fledged network, redundancies as low as 1.1x or 1.2x will likely be acceptable for most users. May sound incredible, but erasure coding + distributed file hosting is a very powerful tool. Today, redundancy is 6x because the network is small and hosts are generally unreliable. We also don't have great tools for determining how reliable a host is, so we are forced to assume the worst from every host. As we write better code, the required redundancy should fall. I'm expecting 4x to be suitable by March, and 2.5x to be suitable by June. That will speed things up significantly.

    0
  • W

    Sounds very promising. SO I just decided to start hosting, I want to host my entire 80GB hard drive I just wiped. I have 3 hard drives. What if I say I want to Host more than 80GB? Do I have to move my Sia software to the 80GB hard drive? I want my main SSD to be untouched by SIA if possible.

    0
  • I
    Global Moderator

    I think you're asking: "Can I host files across multiple drives?"

    The principal limitation at present is that all hosted files are in the /host folder where siad is located (or the startup directory you chose with the --sia-directory when starting siad). So, only one LOCATION on your system can currently be used for hosting files.

    This means you're only way at present is to create a logical volume which includes all of your 3 drives. You can later add drives to this logical volume to make it even bigger. Then, in case you're running siad on your SSD you can create a symbolic link to your logical volume (or, a folder on it) from your /host folder.

    These things are straight-forward on the OS I know, which is Linux. It should be a good method to use on Mac too. I'm not sure if Windows has the equivalent of symbolic links.

    Which OS do you use?

    0
  • W

    Unfortunately I use windows. Just can't make the full time switch to ubuntu/linux. I don't know any coding language, but the expanding logical drive sounds do able in windows. So I'm going to move my whole directory to my dedicated Sia drive, for starters. When I do that what happens to my contracts? I hope it is pretty flawless at the moment I have 383 contracts. SO hopefully it goes smooth. I did it. It went flawlessly! :)

    0
  • I
    Global Moderator

    Here's some pointers to get you started with a logical drive (i.e. combine all 3 drives into 1 volume):
    https://technet.microsoft.com/en-us/library/cc727978(v=ws.10).aspx

    PS: You may be better off with a RAID. Combining 3 drives into 1 probably increases your chance of some catastrophic failure.

    In Windows there seems to be a command called mlink which creates symbolic links:
    mklink /prefix link_path file/folder_path

    I have never used it. Source: http://www.howtogeek.com/howto/16226/complete-guide-to-symbolic-links-symlinks-on-windows-or-linux/

    1
  • J

    So are you saying that if I offer to be a "farmer" that the disk space for offering space will be allocated from the drive that I have the Sia executable located? For instance if I have my SIA folder located on a 1TB external drive the 1TB drive will be used for rentals/farming?

    0
  • L

    That is not the case @JPCrypto as far as I'm aware: the directory used will be the current directory when siad is started, I believe. So just "cd" to the wanted directory before running the executable, which can be located wherever you like.

    0
  • admins

    'siad' will run from whatever folder you run the executable. If you run 'siad' from the home folder, it'll create a directory structure in the home folder. If you run it from your 1TB external, it'll create the directory structure from there. You can point 'siad' to a different directory with the -d or --sia-directory flag.

    0
Log in to reply