Výpočetní cluster a úložiště Botanického ústavu & MetaCentra

User Tools

Site Tools


en:datove-uloziste

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
en:datove-uloziste [2020/08/14 13:51]
Vojtěch Zeisek [Disk array]
en:datove-uloziste [2020/09/10 13:30]
Vojtěch Zeisek [How to access the disk array]
Line 5: Line 5:
 ===== How to access the disk array ===== ===== How to access the disk array =====
  
-Access to the disk array is possible **from any node in the MetaCentrum**, where it can be found at ''/auto/pruhonice1-ibot/'' with the home directories located in ''/auto/pruhonice1-ibot/home/''. One can access the storage through a direct connection (using any client application such as [[https://filezilla-project.org/|FileZilla]]) by ''SFTP'', ''SCP'' or ''SSHFS'' at ''tilia-nfs.ibot.cas.cz'' (alias ''storage-pruhonice1-ibot.metacentrum.cz'').+Access to the disk array is possible **from any node in the MetaCentrum**, where it can be found at ''/storage/pruhonice1-ibot/'' with the home directories located in ''/storage/pruhonice1-ibot/home/''. 
 + 
 +One can access the storage through a direct connection (using any client application such as [[https://filezilla-project.org/|FileZilla]]) by ''SFTP'', ''SCP'' or ''SSHFS'' at ''tilia-nfs.ibot.cas.cz'' (alias ''storage-pruhonice1-ibot.metacentrum.cz''). Detailed [[https://wiki.metacentrum.cz/wiki/Working_with_data#Data_transfer:_large_amount_of_data|MetaCentrum instructions]].
  
 ==== Graphical clients ==== ==== Graphical clients ====
Line 11: Line 13:
 Use [[https://filezilla-project.org/|FileZilla]], [[https://winscp.net/eng/docs/lang:en|WinSCP]], etc. and enter: Use [[https://filezilla-project.org/|FileZilla]], [[https://winscp.net/eng/docs/lang:en|WinSCP]], etc. and enter:
  
-  * Host (target server): ''tilia-nfs.ibot.cas.cz''+  * Host (target server): ''storage-pruhonice1-ibot.metacentrum.cz'' or ''tilia-nfs.ibot.cas.cz''
   * Port: ''22''   * Port: ''22''
   * Protocol: ''SFTP'', ''SCP'', ''SSH2''   * Protocol: ''SFTP'', ''SCP'', ''SSH2''
Line 28: Line 30:
 ===== Shared folders ===== ===== Shared folders =====
  
-Shared folders are located on the storage in folder ''/auto/pruhonice1-ibot/shared/GROUP_FOLDER/'' accessible from all MetaCentrum frontends and computing nodes. There is UNIX group available for every shared folder, administered in [[https://perun.metacentrum.cz/|Perun]]. Any user can be group administrator. Login uses MetaCentrum credentials, group admin can than click to "Group Manager", "Select Group", "Select VO: MetaCentrum" and select group whose members should be administered.+Shared folders are located on the storage in folder ''/storage/pruhonice1-ibot/shared/GROUP_FOLDER/'' accessible from all MetaCentrum frontends and computing nodes. There is UNIX group available for every shared folder, administered in [[https://perun.metacentrum.cz/|Perun]]. Any user can be group administrator. Login uses MetaCentrum credentials, group admin can than click to "Group Manager", "Select Group", "Select VO: MetaCentrum" and select group whose members should be administered.
  
 All files, regardless if they are located in shared folders, or in users' home directories, are counted into personal file quota of particular user (shared folders do not have separate quota). If needed, user can [[en:spravci-podpora|request]] increase of the quota. All files, regardless if they are located in shared folders, or in users' home directories, are counted into personal file quota of particular user (shared folders do not have separate quota). If needed, user can [[en:spravci-podpora|request]] increase of the quota.
  
-Files newly created in directory ''/auto/pruhonice1-ibot/shared/GROUP_FOLDER/'' have automatically set group owner ''GROUP''. If it would not happen, user must change group owner. It is then necessary to alter the permissions so that data are accessible exclusively for members of the group using commands like:+Files newly created in directory ''/storage/pruhonice1-ibot/shared/GROUP_FOLDER/'' have automatically set group owner ''GROUP''. If it would not happen, user must change group owner. It is then necessary to alter the permissions so that data are accessible exclusively for members of the group using commands like:
  
 <code bash permissions.sh> <code bash permissions.sh>
 # Change group owner # Change group owner
-chgrp -R GROUP /auto/pruhonice1-ibot/shared/GROUP_FOLDER+chgrp -R GROUP /storage/pruhonice1-ibot/shared/GROUP_FOLDER
 # Change folder permissions # Change folder permissions
-find /auto/pruhonice1-ibot/shared/GROUP_FOLDER/ -type d -exec chmod 770 '{}' \;+find /storage/pruhonice1-ibot/shared/GROUP_FOLDER/ -type d -exec chmod 770 '{}' \;
 # Change file permissions # Change file permissions
-find /auto/pruhonice1-ibot/shared/GROUP_FOLDER/ -type f -exec chmod 660 '{}' \;+find /storage/pruhonice1-ibot/shared/GROUP_FOLDER/ -type f -exec chmod 660 '{}' \;
 </code> </code>
  
 Because of security of files and necessity of their share, user must be well aware of UNIX permissions! Wrong settings of the permissions might result in data loss (e.g. as by wrongly working script of another user). Alongside it is necessary to set up permissions that another members of the group have full access to them. These tasks can be done in graphical SFTP clients (e.g. FileZilla, WinSCP), however usage of command line is faster and simpler. In case of issues contact [[en:spravci-podpora|maintainers]]. Because of security of files and necessity of their share, user must be well aware of UNIX permissions! Wrong settings of the permissions might result in data loss (e.g. as by wrongly working script of another user). Alongside it is necessary to set up permissions that another members of the group have full access to them. These tasks can be done in graphical SFTP clients (e.g. FileZilla, WinSCP), however usage of command line is faster and simpler. In case of issues contact [[en:spravci-podpora|maintainers]].
  
en/datove-uloziste.txt · Last modified: 2020/09/10 13:30 by Vojtěch Zeisek