[[PageOutline]] == GENI Storage and Archive Service (GSAS) == === Participating Projects and Organizations === [http://groups.geni.net/geni/wiki/DigitalObjectRegistry Project 1663: Digital Object Registry (CNRI)] [[BR]] [http://groups.geni.net/geni/wiki/GIMI Project 1856: GIMI I&M Tools (UMass Amherst, RENCI and others)] [[BR]] === Technical Contacts === Giridhar Manepalli (CNRI) (mailto:gmanepalli@cnri.reston.va.us / 703 620 8990) [[BR]] Shu Huang (RENCI) (mailto:shuang@renci.org) [[BR]] '''GPO System Engineer:''' [mailto:hmussman@bbn.com Harry Mussman] [[BR]] '''GPO Software Engineer:''' [mailto:johren@BBN.COM Jeanne Ohren] [[BR]] === 1) Goals === For GSAS: [[BR]] 1. A structured place to store all of the objects (artifacts) for an experiment, with descriptors (metadata), that is easy to access, with short to medium term storage, and the ability to search. (Note: this goes well beyond just measurement data objects.) [[BR]] 2. A separate long-term archive, with controlled access from the outside world, using a DOI (handle) as a persistent identifier [[BR]] 3. Include most of the functionality provided by the Measurement Data Archive (MDA) prototype, built by CNRI. [[BR]] 4. Establish multiple federated iRODS services, starting at RENCI and UMass Amherst, and operate for GENI users (experimenters). 5. Establish persistent accounts for each user, and use icommands to store and retrieve objects (artifacts) for each user in the storage service. 6. Establish authentication for each user based on username/password, certificates, and also proxy (delegated) certificates. [[BR]] 7. Establish a directory structure in the storage service for each user to accommodate multiple experiments, and a directory structure for each experiment (consider "bag") to include all objects (artifacts) associated with that experiment, including one or more descriptors (metadata) within XML files (following the GENI descriptor schema). [[BR]] 8. Provide multiple interfaces (including icommand and web) to allow an authenticated user to view, search and curate their objects (artifacts). [[BR]] 9. Provide interface to allow a user to define an object (artifact) to be archived (where the object (artifact) may range from a large directory to a single file), include a descriptor (following the GENI ObjectDescriptor Schema), assign a persistent Digital Object Identifier (DOI, or "handle"), and decide when to push it to archive service. [[BR]] 10. Establish an archive service that provides long-term and reliable storage, with public access via a DOI from the global handle service. [[BR]] 11. Include a search function in the archive service, so that an outside user can search for and then retrieve an object, but allow the object’s owner to disable search, so that an outside user needs the DOI of the object to retrieve it. [[BR]] Goals for GENI ObjectDescriptor Schema [[BR]] 11. Useful for all types of objects, not just MeasurementData objects. [[BR]] 12. Keep it simple, with the minimum number of mandatory fields. [[BR]] 13. Where possible, values for fields should be automatically generated by Experiment Management Tools. [[BR]] Use of “DataCite Schema for the Publication and Citation of Research Data”: [[BR]] 14. When an object (artifact) is archived in the Archive Service with public access from the outside world via the Internet, using a DOI (handle) as a persistent identifier, and include descriptors (metadata) that follows DataCite Schema (ref) [[BR]] == Operational Capabilities == === Status Reports and Demonstrations === === Software Releases and Acceptance Tests === [wiki:GSASv2tasks GSAS v2.0 Plan, Tasks and Status (before GEC17)] [[BR]] === Tutorials and Experimenter Support === === Technical Documents === [http://groups.geni.net/geni/attachment/wiki/GIMI/iRODS_Fact_Sheet-0907c.pdf iRODS fact sheet] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/iRODS_Overview_0903.pdf iRODS overview] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/irods-gec14-1.pptx iRODS configuration] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/041712%20%20gimi_use_cases.pptx iRODS use cases] [[BR]] [http://groups.geni.net/geni/attachment/wiki/GIMI/011513%20%20iRODS%20GENI%20plan.docx iRODS plan] [[BR]] [wiki:TestTutorialExperimentStoryboard I&M Tools: Basic Test/Tutorial/Experiment Storyboard] [[BR]] [wiki:TestTutorialExperimentWorkflow I&M Tools: Basic Test/Tutorial/Experiment Workflow] [[BR]]