Handling of Datasets in openBIS 7

Developments
1

I would like to come back to a discussion during the Nov. 8th, 2024 virtual community meeting:
It was mentioned by @juanf that datasets would dissappear from the UI and files would become directly associated with objects. To us this would be an extremeley unpleasant situation. We rely on the semantics and functionality of datasets:

  • We distinguish dataset types for raw data, processed data, machine settings documentations etc. and rely on the dataset type to identify the correct data in external processings.
  • Datasets may contain large number of files which clutter the view if not grouped by datasets.
  • Dataset metadata is sometimes relavant for understanding the data in the dataset correctly.

Please consider these arguments in your developements.

Thanks and best regards.

2

Dear @webhart,

The functionality remains the same.

There’s no requirement to attach data to objects of different types. What I mean is that you can create the same types for Objects tomorrow as you have for DataSets today and attach the data accordingly.

You can then continue filtering by those types as usual.

Best,
Juan

3

Thanks for the clarification @juanf . Out of curiosity: for me, this raises the question of whether we then can then build arbitrary graphs of linked objects or wheter this linking remains possible only at a single level of attaching objects to objects and objects to collections, as we do with datasets today.

4

Current State:

  • Today, you can create a Directed Acyclic Graph (DAG) of Objects. However, the ELN currently requires that Objects be attached to Collections initially.

Future State:

  • Going forward, you will still be able to create a DAG of Objects as you do today. However, you will also have the ability to attach Objects directly to Spaces and Projects within the ELN.

As a result, Experiments will become unnecessary and can be replaced with Objects.

We may introduce this change in a future 20.10.x release rather than waiting for openBIS 7.

Our Goal:
To simplify the system by reducing the number of concepts while maintaining full functionality. This should result in a platform that is easier to teach and more intuitive for most users.

Best,
Juan