SDS@hd - Scientific Data Storage

SDS@hd is a central service for the secure storage of scientific data. This service is available state-wide and can be used by scientists at public higher education institutions in Baden-Württemberg. It is meant to be used for data that is accessed frequently (so-called "hot data").

All data is stored in the storage system LSDF2, which is the second hardware generation of the Large Scale Data Facility. The system is financed by the Ministry for Sciences, Research and Arts of Baden-Württemberg (German acronym: MWK) and by the Deutsche Forschungsgemeinschaft (“German Research Foundation”, German acronym: DFG). The LSDF2 is part of the implementation concept bwDATA for data-intensive services at higher education institutions in the state of Baden-Württemberg.

Thanks to the federated identity management bwIDM, scientists at Baden-Württemberg's public higher education institutions can use this service with their regular institutional accounts/IDs. Users at Heidelberg University can login with their Uni-ID. The user entitlement ‘sds-hd-user’, assigned to a potential user by his or her home organization, is required for accessing and using SDS@hd. Users of Heidelberg University automatically receive this entitlement with their Uni-ID.

Data storage resources are managed through "storage projects" (German acronym: SV which stands for Speichervorhaben), which can be created on application for project or working groups. Every storage project is allocated a storage space that can be accessed by all users who belong to the respective storage project.

Wie erhalte ich Zugang zu SDS@hd? Wie kann ich mich registrieren?

Die benötigten Registrierungsschritte hängen von dem gewünschten Nutzungsszenario ab:

Mitarbeit an einem bestehenden Speichervorhaben (SV):

  • Für die Mitarbeit an einem SV muss das Entitlement 'sds-hd-user' vorhanden sein. Dieses Entitlement wird von der Heimatorganisation vergeben.
  • In der Anwendung SDS@hd Management kann einem bestehenden Speichervorhaben beigetreten werden. Die benötigten Zugangsdaten erhalten Sie direkt vom SV-Verantwortlichen. In dieser Anwendung können auch organisatorische und technische Änderungen für ein SV vorgenommen werden, etwa beim Gruppen- und Rollenmanagement.
  • Abschließend erfolgt auf der bwServices-Seite die Registrierung für den Dienst und das Setzen eines Dienstpasswortes.

Anmeldung eines neuen Speichervorhabens (SV):

  • Für die Beantragung eines neuen SV muss das Entitlement 'sds-hd-sv' vorhanden sein, das zur Anmeldung eines eigenen SVs berechtigt. Dieses Entitlement muss ggf. bei der Heimatorganisation zunächst beantragt werden. Mitarbeiter/innen der Universität Heidelberg erhalten dieses Entitlement automatisch.
  • Nun kann in der Anwendung SDS@hd Management ein Speichervorhaben (SV) beantragt werden. In dieser Anwendung können auch organisatorische und technische Änderungen für ein SV vorgenommen werden, etwa beim Gruppen- und Rollenmanagement.
  • Im letzten Schritt erfolgt die Registrierung auf der bwServices-Seite und das Setzen eines Dienstpasswortes.

Anschließend wird ein Vertrag erstellt und der Antragstellerin/dem Antragsteller zugeschickt. Erst auf Basis dieses unterschriebenen Vertrags wird ein neues SV angelegt und anschließend die Antragstellerin/der Antragsteller informiert.

User meetings

We host regular meetings to inform (potential) users about our storage services, storage resources and associated services (e.g., our HPC services). These events are meant to foster the exchange between existing users, potential new users and the service owners. Join our CF-DIC mailing list to learn about upcoming meetings.

For the SDS@hd service, two bwIDM entitlements are used. Each of these two entitlements is connected with a range of different rights and obligations. The criteria for assigning an entitlement to a user account are solely determined by the respective home organization.

User entitlement 'sds-hd-user':

This entitlement allows you to join an existing storage project, to be able to use the service SDS@hd with the role "Employee". You can join one or more storage projects at once.

Recommendation: This user entitlement should be made available for all users statewide, who may benefit from using this service as part of their (IT-supported) research.

Storage project entitlement 'sds-hd-sv':

This entitlement allows you to request a new storage project. The person requesting the storage project is responsible for all data stored in the assigned storage project space and will also have to cover the cost for the storage project. Storage project owners are obliged to report back to the service owners on a regular basis.

Recommendation: This user entitlement should be made available for all users statewide, who may want to request storage projects.

If you use SDS@hd for your research, please make sure that all publications based on this research contain the follow passage:

The authors gratefully acknowledge the data storage service SDS@hd supported by the Ministry of Science, Research and the Arts Baden-Württemberg (MWK) and the German Research Foundation (DFG) through grant INST 35/1314-1 FUGG.

Please also take the time to inform us about any publications and research projects that involved the use of SDS@hd (for more details and contact information, please see: SDS@hd Management). By thoroughly documenting how SDS@hd is used, it will be easier for us to secure further funding for the service and offer you even better support and hardware in the long run.

We will publish regular news updates on this website. Additionally, you can sign up to our mailing list CF-DIC mailing list for more detailed updates and announcements.

Yes, SDS@hd cannot be used free of charge, but is available at a reasonable cost. For more information and a pricing overview, please visit SDS@hd Management.

SDS@hd is built as a "hot data" storage service, that is, a service that only stores scientific data which is accessed and worked with on a regular basis. For any backup and archiving needs, please contact our IT-Service.

At the moment, you can access your data via the SMB (>= v2.x), NFSv4 and SSHFS/SFTP protocols. For more information, please visit SDS@hd Management and visit the "Meine Speichervorhaben" section.

News

No news at the moment.

Announcements

No current announcements.

How-tos

No how-tos available yet.