Changes between Version 1 and Version 2 of GEC11InstMeasWorkingSession


Ignore:
Timestamp:
07/19/11 11:46:09 (12 years ago)
Author:
hmussman@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GEC11InstMeasWorkingSession

    v1 v2  
    1 === Instrumentation and Measurement Working Session ===
    2 
    3 ==== Organizers ====
    4   Harry Mussman, ''GENI Project Office''
    5 
    6 ==== Time ====
    7   Wed 1:00 - 3:00 pm
    8 
    9 ==== Description ====
    10    This session will review the key instrumentation and measurement (I&M) topics still under study by the GENI I&M community, including metadata schema and authorization to share measurement data.  Each topic will be reviewed by members of the community, and then opened for discussion and a determination of the next steps.
     1[[PageOutline]]
     2
     3= Instrumentation and Measurement (I&M) Working Session =
     4Thursday,  July 28, 2011, 1:00pm - 3:00pm [[BR]]
     5Room:     [[BR]]
     6Session Leader:  Harry Mussman, (GPO, Raytheon BBN Technologies) [[BR]]
     7
     8== Description ==
     9
     10 This session will review the latest DRAFT of the measurement_data_object_descriptor, commonly known as "metadata";  review the status of current I&M tools and services;  and review new topics and next steps.  [[BR]]
     11
     12== Summary ==
     13
     14 [  slides]  [[BR]]
     15
     16
     17== Agenda ==
     18This is a tentative agenda, which may change. [[BR]]
     19
     20
     21=== 1)  Introductions ===
     221:00pm  [[BR]]
     23
     24=== 2)  Measurement Data Object Descriptor (MDOD) ===
     251:05pm  [[BR]]
     26Harry Mussman[[BR]]
     27
     28==== 2.1) Overview ====
     29
     30
     31==== 2.2)  Use Cases ====
     32  Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc  Architecture document:[[BR]]
     33  4.5   GATHERING, TRANSFERRING AND SHARING MD   [[BR]]
     34  4.5.1  Schema and Provenance of MD     [[BR]]
     35  4.5.2  Gathering MD into a Slice       [[BR]]
     36  4.5.3  Transferring MD between I&M Services in the Same Slice  [[BR]]
     37  4.5.4  Transferring MD between I&M Services in Different Slices        [[BR]]
     38  4.5.5  Sharing MD with Others
     39
     40  Use these [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/Visio-4.x%20%20030911%20_IM-ARCH-Figures.pdf  figures][[BR]]
     41 
     42  A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_GatheringTransferringMD_I%26MArch_Overview.pptx  slides][[BR]]
     43
     44  See: I&M in Experimenter's Slice
     45
     46  See:  I&M in Operator's Infrastructure Measurement Slice
     47
     48 
     49=== 2.3)  Content (Semantics) ===
     50  Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc  Architecture document:] [[BR]]
     51  8     SCHEMA AND ELEMENTS FOR MEASUREMENT DATA OBJECT DESCRIPTORS (MDODS)      [[BR]]
     52  8.1    MEASUREMENT DATA OBJECTS (MDOS)         [[BR]]
     53  8.2    MEASUREMENT DATA (MD) OBJECT DESCRIPTOR         [[BR]]
     54  8.2.1   Uses   [[BR]]
     55  8.2.2   One Data Model         [[BR]]
     56  8.2.3   Multiple Schemas       [[BR]]
     57  8.3    MD OBJECT DESCRIPTOR DATA MODEL         [[BR]]
     58  8.3.1   Vocabulary     [[BR]]
     59  8.3.2   Identifier Elements    [[BR]]
     60  8.3.3   Interoperability Elements:     [[BR]]
     61  8.3.4   Discovery Elements     [[BR]]
     62  8.3.5   Administrative Elements:       [[BR]]
     63  8.3.6   Mapping into Descriptors from GENI MD Schemas  [[BR]]
     64  8.4    MD OBJECT DESCRIPTOR SCHEMAS    [[BR]]
     65  8.4.1   File Schema    [[BR]]
     66  8.4.2   MI Registration Schema         [[BR]]
     67  8.4.3   Archive Schema   [[BR]]
     68
     69  A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_MDObjectsDescriptors%20_I%26MArch_Overview.pptx  slides][[BR]]
     70
     71  DRAFT ver0.2 MDOD Data Model, Elements and Values: [[BR]]
     72
     73==== 2.3)  Prototype Measurement Data Archive (MDA) Service ====
     741:45pm  [[BR]]
     75Giridhar Manepalli  (CNRI)  [[BR]]
     76  Measurement Data Archive (MDA) Service [[BR]]
     77 
     78  Defined earlier in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/110410%20%20Topic2_MDASrvc_GEC9_Agenda_WGMtgInstAndMeas.ppt  slides][[BR]]
     79 
     80  Overview of User Workspace and Digital Object Archive services presented in these summarized in these   [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_SharingMDObjects%20_I%26MArch_Overview.pptx slides]:[[BR]]
     81
     82  CNRI prototype defined:[[BR]]
     83  [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031011%20%20Measurement%20Data%20Archive%20Prototype.docx  text][[BR]]
     84  [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/MDA_CNRI_Giridhar.pptx Discussion Slides][[BR]]
     85
     86  Demo[[BR]]
     87
     88  First users?[[BR]]
     89
     90  Other uses in GENI?[[BR]]
     91 
     92
     93
     94
     95
     96=== 4)  Measurement Data Objects and Descriptors (i.e, metadata) ===
     973:00pm [[BR]]
     98Harry Mussman [[BR]]
     99  Read the following sections of the [http://groups.geni.net/geni/attachment/wiki/GeniInstrumentationandMeasurementsArchitecture/122010i%20GENI-SE-IM-ARCH-1.0.doc  Architecture document:] [[BR]]
     100  8     SCHEMA AND ELEMENTS FOR MEASUREMENT DATA OBJECT DESCRIPTORS (MDODS)      [[BR]]
     101  8.1    MEASUREMENT DATA OBJECTS (MDOS)         [[BR]]
     102  8.2    MEASUREMENT DATA (MD) OBJECT DESCRIPTOR         [[BR]]
     103  8.2.1   Uses   [[BR]]
     104  8.2.2   One Data Model         [[BR]]
     105  8.2.3   Multiple Schemas       [[BR]]
     106  8.3    MD OBJECT DESCRIPTOR DATA MODEL         [[BR]]
     107  8.3.1   Vocabulary     [[BR]]
     108  8.3.2   Identifier Elements    [[BR]]
     109  8.3.3   Interoperability Elements:     [[BR]]
     110  8.3.4   Discovery Elements     [[BR]]
     111  8.3.5   Administrative Elements:       [[BR]]
     112  8.3.6   Mapping into Descriptors from GENI MD Schemas  [[BR]]
     113  8.4    MD OBJECT DESCRIPTOR SCHEMAS    [[BR]]
     114  8.4.1   File Schema    [[BR]]
     115  8.4.2   MI Registration Schema         [[BR]]
     116  8.4.3   Archive Schema   [[BR]]
     117
     118  A summary of the topic is presented in these [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_MDObjectsDescriptors%20_I%26MArch_Overview.pptx  slides][[BR]]
     119
     120  DRAFT MDOD Data Model, Elements and Values: [[BR]]
     121
     122  Identifier  (type, value)                                     Mandatory [[BR]]
     123
     124  Locator  (type, value)                                        Mandatory [[BR]]
     125
     126  [Collection (member of):  type;  name;  index] ---            Optional [[BR]]
     127
     128  [Structure: (where object includes multiple sub-objects) [[BR]]                       
     129
     130                Sub-object x descriptor: [[BR]]
     131                        (repeat above) [[BR]]
     132 
     133                Sub-object y descriptor: [[BR]]
     134                        (repeat above) [[BR]]
     135                                                                ]  Optional [[BR]]
     136
     137  Object type:  flow  |  file  |  directory  |  data base  |  GUI  |  digital object    Mandatory [[BR]]
     138
     139  Measurement data schema:  template;  names;  parameters;  types               Mandatory [[BR]]
     140
     141  Size:  (type, value)                                                          Optional [[BR]]
     142
     143  Encryption:  (type, owner)                                                    Optional [[BR]]
     144
     145  Subject:  what;  where                Mandatory [[BR]]
     146
     147  Time:  when                   Optional [[BR]]
     148
     149  Keywords                              Optional [[BR]]
     150
     151  Description                   Optional [[BR]]
     152
     153  GENI-specific discovery elements:  (services;  identifiers;  slices;  experiments;  runs)             Mandatory [[BR]]
     154
     155  Owner/creator:  (slice;  experiment;  run;  when;  who;  contact;  processing;  annotation)    Mandatory [[BR]]
     156
     157  Previous holder(s):  (slice;  experiment;  run;  when;  who;  contact;  processing;  annotation)  Optional [[BR]]
     158
     159  Current holder:  (slice;  experiment;  run;  when;  who;  contact;  processing;  annotation)  Optional [[BR]]
     160
     161  Last modified:  (date;  time;  contact)  Mandatory [[BR]]
     162
     163  Licenses:    Optional [[BR]]
     164
     165  Private information:  type;  mitigation;  responsibilities            Optional [[BR]]
     166
     167  Transfer rules:               Optional [[BR]]
     168
     169  Disposal rules:               Optional [[BR]]
     170
     171
     172  Comments from earlier discussion: [[BR]]
     173
     174  Camilo Viecco:[[BR]]
     175
     176  All parameters look fine.  I have one question:  The 'Time' optional parameter appears to be redundant. Should it not match the owner/creator when mandatory value?[[BR]]
     177
     178  There is also the issue of metadata for time ranges. How do we express that?  If we remove the time, then I belive this is a good place to start[[BR]]
     179
     180  Hussam Nasir:[[BR]]
     181
     182  I agree with Camillo suggestions and dont see any more addition/removal i would want to make.[[BR]]
     183
     184  Max Ott:  [[BR]]
     185
     186  As for meta data I first of all want to stress that we really should find a way to align this with the Resource Description spec of the Control Framework. While there is substantial reluctance there to embrace anything assembling some kind of structure, I'm not giving up the fight that easily. I just find it utterly silly to have two or more different ways to describe resources. Measurements are resources as well and metadata is all about describing where the measurements are coming from, that includes the resources we provision through the control framework.[[BR]]
     187
     188  I know , with the little (or zero as in my case) funding we have available, nobody is excited about re-factoring for alignment sakes, but we shouldn't forget why we are we doing this in the first place. We just published a paper which included an analysis of last year's edition of one of the major conferences in our field. 26 out of the 36 accepted papers had substantial flaws in their respective analysis section, ranging from not even describing the experiment  to the sloppy "10-run average" without any indication of precision.  The numbers would have looked a lot grimmer if we would have tried to figure out on how to repeat the results.[[BR]]
     189
     190  Coming back to meta data and repeating my RSpec argument. We first need an object/component/resource model and then we need a way to attach meaning to various 'groups' of model instances. The first part (model) should be quite stable as it gets baked into tools, services, and code and is expensive to change. The second part (semantics) should be easy to change as it inadvertently will as it reflects our changing needs, understandings, use cases. In other words, the rate of change somewhat reflects the vibrancy of the community using it.[[BR]]
     191
     192  This is sitting in my drafts folder already for a few days, still half baked, but hopefully still of some marginal value.[[BR]]
     193
     194
     195  Discussion[[BR]]
     196
     197  Consensus?[[BR]]
     198
     199  Next steps?  [[BR]]
     200
     201
     202
     203===  5)  Current I&M Design and Prototyping Efforts ===
     2043:45pm [[BR]]
     205
     206
     207 I&M services for Experimenters, including: [[BR]]
     208   Instrumentation Tools (for use with protoGENI) [[BR]]
     209   OMF/OML [[BR]]
     210   LAMP  (uses perfSONAR technology, for use with protoGENI) [[BR]]
     211   OnTimeMeasure   (for use with protoGENI or PlanetLab) [[BR]]
     212
     213 I&M services for monitoring infrastructure, including: [[BR]]
     214   Measurement System, for packet capture [[BR]]
     215   Shadownet, for router monitoring [[BR]]
     216   Scalable Sensing Service [[BR]]
     217
     218 Measurement Data Archive (MDA) service [[BR]]
     219   First prototype by CNRI, including User Workspace (UW) service and Digital Object Archive (DOA) service [[BR]]
     220
     221 Management of an I&M service, from Measurement Orchestration (MO) service: [[BR]]
     222   First prototype by IMF and ERM projects, following OMF approach [[BR]]
     223
     224 Measurement Data Objects, and Descriptors  (“metadata”): [[BR]]
     225   Defining common data model, then schemas [[BR]]
     226   First prototype software by ? [[BR]]
     227
     228 Measurement traffic flows, proxies/mechanisms) to reach servers in private address space [[BR]]
     229  First prototype of ssh access by ORCA project  [[BR]]
     230
     231 [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_CurrentStatus%20_I%26MArch_Overview.pptx  slides] [[BR]]
     232
     233 Is anything missing?  [[BR]]
     234 
     235 Next steps?  [[BR]]
     236
     237=== 6)  I&M Service Deployments ===
     2383:50pm [[BR]]
     239 
     240 Current I&M services for Experimenters, including: [[BR]]
     241   Instrumentation Tools (for use with protoGENI) [[BR]]
     242   OMF/OML [[BR]]
     243   LAMP  (uses perfSONAR technology, for use with protoGENI) [[BR]]
     244   OnTimeMeasure (for use with protoGENI or PlanetLab) [[BR]]
     245
     246 Introduce I&M services for monitoring infrastructure, including: [[BR]]
     247   perfSONAR components, with Measurement Information (MI) service, and first use of Measurement Data Object Descriptors (MDOD’s)?  Who? [[BR]]
     248   Measurement System for packet capture? [[BR]]
     249   Scalable Sensing Service? [[BR]]
     250
     251 Introduce Measurement Data Archive (MDA) service: [[BR]]
     252   Include User Workspace (UW) service  [[BR]]
     253   Include Digital Object Archive (DOA) service [[BR]]
     254   Who are first users? [[BR]]
     255   Are there other uses, e.g., software downloads? [[BR]]
     256   When ready to support Researchers? [[BR]]
     257 
     258  [http://groups.geni.net/geni/attachment/wiki/GEC10InstMeasWorkingSession/031711_CurrentStatus%20_I%26MArch_Overview.pptx  slides] [[BR]]
     259 
     260 Discussion  [[BR]]
     261
     262 Can we build a guide?  [[BR]]
     263 
     264
     265
     266=== Adjourn ===
     2674:00pm  [[BR]]
     268
     269== Background Reading ==
     270
     271[http://groups.geni.net/geni/wiki/GeniInstMeas  I&M integration wiki][[BR]]
     272[http://groups.geni.net/geni/wiki/GENIIandMCAPCAT  GENI I&M Capabilities Catalog][[BR]]
     273[http://groups.geni.net/geni/wiki/GeniInstrumentationandMeasurementsArchitecture  GENI I&M Architecture document][[BR]]