Výpočetní cluster a úložiště Botanického ústavu & MetaCentra

User Tools

Site Tools


en:datove-uloziste

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
Next revisionBoth sides next revision
en:datove-uloziste [2020/06/11 09:55] – created Vojtěch Zeiseken:datove-uloziste [2020/08/18 09:12] – [Shared folders] Vojtěch Zeisek
Line 1: Line 1:
 ====== Disk array ====== ====== Disk array ======
  
-Employees and collaborators of IBOT can take advantage of the [[en:hw:uloziste|data storage]] capacity that amounts to a total of 180 TB, for running analyses on the Průhonice cluster and for long term storage. The basic disk usage allowed for members of the ''ibot'' group is **2 TB**. Shared folder with restricted access to specific users can be also implemented. The storage is backed up in the [[https://www.cesnet.cz/services/data-storage/?lang=en|CESNET]] infrastructure. For disk quota increase or for the creation of shared folders please contact the [[en:spravci-podpora|administrators]].+Employees and collaborators of IBOT can take advantage of the [[en:hw:uloziste|data storage]] capacity that amounts to a total of 180 TB, for running analyses on the Průhonice cluster and for long term storage. The basic disk usage allowed for members of the ''ibot'' group is **2 TB** (7 GB for the others). Shared folder with restricted access to specific users can be also implemented. The storage is backed up in the [[https://www.cesnet.cz/services/data-storage/?lang=en|CESNET]] infrastructure. For disk quota increase or for the creation of shared folders please contact the [[en:spravci-podpora|administrators]].
  
 ===== How to access the disk array ===== ===== How to access the disk array =====
  
-Access to the disk array is possible **from any node in the MetaCentrum**, where it can be found at ''/auto/pruhonice1-ibot/'' with the home directories located in ''/auto/pruhonice1-ibot/home/''. One can access the storage through a direct connection (using any client application such as [[https://filezilla-project.org/|FileZilla]]) by ''SFTP'', ''SCP'' or ''SSHFS'' at ''tilia-nfs.ibot.cas.cz'' (alias ''storage-pruhonice1-ibot.metacentrum.cz'').+Access to the disk array is possible **from any node in the MetaCentrum**, where it can be found at ''/storage/pruhonice1-ibot/'' with the home directories located in ''/storage/pruhonice1-ibot/home/''. 
 + 
 +One can access the storage through a direct connection (using any client application such as [[https://filezilla-project.org/|FileZilla]]) by ''SFTP'', ''SCP'' or ''SSHFS'' at ''tilia-nfs.ibot.cas.cz'' (alias ''storage-pruhonice1-ibot.metacentrum.cz'').
  
 ==== Graphical clients ==== ==== Graphical clients ====
Line 20: Line 22:
 ==== Access via command line ==== ==== Access via command line ====
  
-<code bash pristup.sh>+<code bash access.sh>
 # Copy files to and from the storage... # Copy files to and from the storage...
 scp -r local/files USER@tilia-nfs.ibot.cas.cz:~/server/folder/ scp -r local/files USER@tilia-nfs.ibot.cas.cz:~/server/folder/
Line 28: Line 30:
 ===== Shared folders ===== ===== Shared folders =====
  
-Shared folders are located on the storage in folder ''/auto/pruhonice1-ibot/shared/GROUP_FOLDER/'' accessible from all MetaCentrum frontends and computing nodes. There is UNIX group available for every shared folder, administered in [[https://perun.metacentrum.cz/|Perun]]. Any user can be group administrator. Login uses MetaCentrum credentials, group admin can than click to "Group Manager", "Select Group", "Select VO: MetaCentrum" and select group whose members should be administered.+Shared folders are located on the storage in folder ''/storage/pruhonice1-ibot/shared/GROUP_FOLDER/'' accessible from all MetaCentrum frontends and computing nodes. There is UNIX group available for every shared folder, administered in [[https://perun.metacentrum.cz/|Perun]]. Any user can be group administrator. Login uses MetaCentrum credentials, group admin can than click to "Group Manager", "Select Group", "Select VO: MetaCentrum" and select group whose members should be administered.
  
 All files, regardless if they are located in shared folders, or in users' home directories, are counted into personal file quota of particular user (shared folders do not have separate quota). If needed, user can [[en:spravci-podpora|request]] increase of the quota. All files, regardless if they are located in shared folders, or in users' home directories, are counted into personal file quota of particular user (shared folders do not have separate quota). If needed, user can [[en:spravci-podpora|request]] increase of the quota.
  
-Files newly created in directory ''/auto/pruhonice1-ibot/shared/GROUP_FOLDER/'' have automatically set group owner ''GROUP''. If it would not happen, user must change group owner. It is then necessary to alter the permissions so that data are accessible exclusively for members of the group using commands like:+Files newly created in directory ''/storage/pruhonice1-ibot/shared/GROUP_FOLDER/'' have automatically set group owner ''GROUP''. If it would not happen, user must change group owner. It is then necessary to alter the permissions so that data are accessible exclusively for members of the group using commands like:
  
-<code bash prava.sh>+<code bash permissions.sh>
 # Change group owner # Change group owner
-chgrp -R GROUP /auto/pruhonice1-ibot/shared/GROUP_FOLDER+chgrp -R GROUP /storage/pruhonice1-ibot/shared/GROUP_FOLDER
 # Change folder permissions # Change folder permissions
-find /auto/pruhonice1-ibot/shared/GROUP_FOLDER/ -type d -exec chmod 770 '{}' \;+find /storage/pruhonice1-ibot/shared/GROUP_FOLDER/ -type d -exec chmod 770 '{}' \;
 # Change file permissions # Change file permissions
-find /auto/pruhonice1-ibot/shared/GROUP_FOLDER/ -type f -exec chmod 660 '{}' \;+find /storage/pruhonice1-ibot/shared/GROUP_FOLDER/ -type f -exec chmod 660 '{}' \;
 </code> </code>
  
 Because of security of files and necessity of their share, user must be well aware of UNIX permissions! Wrong settings of the permissions might result in data loss (e.g. as by wrongly working script of another user). Alongside it is necessary to set up permissions that another members of the group have full access to them. These tasks can be done in graphical SFTP clients (e.g. FileZilla, WinSCP), however usage of command line is faster and simpler. In case of issues contact [[en:spravci-podpora|maintainers]]. Because of security of files and necessity of their share, user must be well aware of UNIX permissions! Wrong settings of the permissions might result in data loss (e.g. as by wrongly working script of another user). Alongside it is necessary to set up permissions that another members of the group have full access to them. These tasks can be done in graphical SFTP clients (e.g. FileZilla, WinSCP), however usage of command line is faster and simpler. In case of issues contact [[en:spravci-podpora|maintainers]].
  
en/datove-uloziste.txt · Last modified: 2023/06/27 09:27 by Vojtěch Zeisek