The report from our Annual User Survey 2023 is ready. The survey aims to determine overall user satisfaction with the national e-infrastructure services and elicit feedback from our users. Once again, we are pleased to report that our users are satisfied with our services.
We use the results and feedback from the survey to adjust and improve our operations and support mechanisms, and to guide further product development.
The user survey was distributed to 1.999 registered users (as of December 2023). 232 users replied. Approximately 1 in 3 respondents furthermore reported answering the survey on behalf of the other users in their projects, thus giving us feedback from potentially 812 users.
Below are some excerpts from the survey showing how users assessed our services, operations and activities in 2023 compared to 2022. The 2022 numbers are presented in brackets after the 2023 numbers.
Highlighted responses
In this survey, 44 % (35 %) of the respondents reported that they have a data management plan (DMP), while 19.8 % (25 %) don´t have one and 36.2 % (40%) don’t know. This is a continuing trend where the use and awareness of data management plans are increasing. Since the first resource allocation period in 2021, having a DMP is required for all projects applying to our data services. The Resource Allocation Committee reviews these plans.
Satisfaction with coordination services
Below you will see how our coordination services scored. Scores are given on a scale from 1 to 6, where 1 is poor and 6 is excellent.
- Available computing capacity — 5.12 (4.98)
- Available storage capacity (storage project area) — 4.77 (4.61)
- Amount of extra resources granted (during allocation periods) — 5.39 (5.39)
- Response time for application for extra resources — 5.57 (5.56)
- Project application procedure and feedback on application — 5.17 (5.28)
- Quality of user support services (contact@sigma2.no) — 5.42 (5.38)
- Response time for the requests sent (to contact@sigma2.no) — 5.44 (-)
- Management of user accounts (creation and passwords) — 5.25 (5.25)
- Frequency and duration of allocation periods (usually 6 months) — 4.69 (4.75)
- Information available on www.sigma2.no (administrative documentation) — 5.06 (4.84)
- MAS - the administration system for project leaders — 4.72 (4.98)
- Phurui.metacenter.no (for HPC/LUMI project leaders) — 4.93 (5.00)
N=232/812
Satisfaction with support services
Below you will see how our support services scored. Scores are given on a scale from 1 to 6, where 1 is poor and 6 is excellent.
- Response time for the requests sent (to support@nris.no) — 5.43 (5.36)
- Overall quality of user support — 5.43 (5.35)
- Quality of user support - NIRD storage-related requests — 5.32 (5.28)
- Quality of user support - NIRD Toolkit-related requests — 5.45 (5.19)
- Quality of user support - HPC/Betzy-related requests — 5.36 (5.09)
- Quality of user support - HPC/Fram-related requests — 5.36 (5.25)
- Quality of user support - HPC/Saga-related requests — 5.41 (5.36)
- Quality of user support - HPC/LUMI-related requests 5.17 (4.90)
- Information available on opslog.sigma2.no (operation information) — 5.05 (4.82)
- Information available on documentation.sigma2.no (technical) — 5.18 (4.86)
N=232/812
During 2023 we have worked actively to improve our technical information and it it thus especially pleasing to see an increase in satisfaction from 4.86 in 2022 to 5.18 in 2023.
Services overall satisfaction
NIRD services
The survey indicates high overall satisfaction among 90% of users, an increase from 83% in 2022, 39 % rated it as excellent (6) and 51% as very good (5). N=109.
Reported satisfaction with the functionality of the NIRD Storage services:
- Resource availability (uptime) — 5.51(5.36)
- Performance/capability of application servers — 5.34 (5.20)
- Connectivity, data access rate (read/write) from — 5.27 (5.06)
- User environment (e.g. software, shells, compilers) — 5.19 (5.03)
- Data transfer (e.g. ssh/sftp/scp/gridftp, rsync) — 5.31(5.13)
- Data sharing (internally and externally) — 5.31 (5.00)
- Machine actionability on the data using APIs — 5.28 (4.82)
N=109
HPC
The survey indicates high overall satisfaction among 89,4 % of users, increasing from 85,3 % in 2022. 37,5 % rated the HPC service as excellent (6) and 51,5 % as very good (5). N=198.
Advanced user support
The respondents expressed high overall satisfaction With the Advanced User Support. In total, 50.0 % scored 6 and 35.7 % scored 5, which is quite stable compared to the average score from last year, when 57.1 % scored 6 and 37.5 % scored 5. N=16.
Training
To identify potential training needs, we asked respondents to select and rank the importance of 24 different course topics. The courses that ranked on top were:
- Code Development
- Pre/Post processing tools
Many expressed a need for specialist training in specific research software tools, packages, and programming languages, with GPU programming mentioned multiple times. Feedback also included suggestions on applying computational techniques such as research tools and data analysis, and a significant need for improved training for new users.
About the survey
The survey, containing 47 questions including multiple free text fields, was distributed to all users by email. The survey was open between 12 December 2023 to 10 January 2024. 232 users responded, including users from the Sigma2 partner sites (the BOTT Universities) and other user groups. The survey was anonymous, and all answers were treated confidentially.
How do we use the results?
We use the survey results actively to improve operations and support and plan future service development. Many of your suggestions related to services initiatives can be tracked on the services roadmaps.
If you have questions regarding the survey, or you wish to direct our attention towards additional matters, you are welcome to contact us at contact@sigma2.no