Hello,
I would like to upload files on the cluster and each weights around 1To.
Does this seems feasible with ssh protocole ? Or it might be interrupted each times ?
PS : sorry if it’s a dumb question but i’d rather know before trying.
Ewen
Hello,
This is totally feasible with the SSH protocol.
You can find documentation here: https://ifb-elixirfr.gitlab.io/cluster/doc/data/data/#transfer
For large files or a large number of files, I recommend using rsync (which can use the SSH protocol: rsync -e ssh ...).
You can relaunch the command as many times as needed — the transfer will continue only for the missing files.
This is particularly useful in case of network interruptions or to ensure that all your files are correctly transferred.
Hi, and happy new year
Thanks for your answer.
Can I get an increase in disk space of 5To. I need it to store this big data and process them.
Ewen
Can I get an increase in disk space of 5To.
For which project ?
proudhon_lab
sorry
Ewen,
Before increasing your storage space, could you check if there are files you can clean up or compress?
You have several large temporary files (e.g. *tmp) and uncompressed files (e.g. .txt, .bed).
Additionally, it looks like you're using this project space to store multiple projects. This isn’t recommended and goes against our guidelines: https://ifb-elixirfr.gitlab.io/cluster/doc/data/project/#general-issues
Could you coordinate with your colleagues to create a separate project for each of your projects?
It's possible to have multiple projects on the IFB Core Cluster.
Best regards,
I see,
Okay, I’ll work on completely restructuring our storage and our way to manage them. Thanks for the information.