Changes between Version 16 and Version 17 of GEMINI/Tutorial/GEC20/GENI_Desktop_and_GEMINI_data/RetrieveData


Ignore:
Timestamp:
06/20/14 17:49:56 (5 years ago)
Author:
mkeele@indiana.edu
Comment:

all text

Legend:

Unmodified
Added
Removed
Modified
  • GEMINI/Tutorial/GEC20/GENI_Desktop_and_GEMINI_data/RetrieveData

    v16 v17  
    3434
    3535== How to Access Data from UNIS and the MS ==
    36 
    37 step-by-step process of scanning the topology, looking for metadata, finding the eventTypes you are interested in (using unis_client.py or a browser), and then ms_plot.py as a simple graphing tool tht can be customized for whatever graphing the user needs
    3836
    3937Before we provide a step-by-step guide to retrieving data, lets go more in depth with these components. UNIS is a topology service that is used to describe a network but underlying this concept is a RESTful API. As you might expect UNIS supports the standard HTTP Verbs: GET, POST, PUT, and DELETE.
     
    126124{{{ GET /api/domains/:id }}}
    127125
     126Once some measurements are posted and executed by BLiPP, metadata will be generated. Every measurement object has a list of event types associated with it and you will use this event type of find the data you desire. For example, if you were to schedule a throughput test you could expect an event type for bandwidth. BLiPP executes a few measurement probes directly after Instrumentation, such as cpu, mem, and net. Now, lets step through the process of gathering memory usage data.
     127
     128Navigate to {{{ http://pcvm2-4.instageni.illinois.edu:42424/api/metadata }}} to see a list of all metadata.
     129
     130Search for "memory" and you will see every event types such as: [[BR]]
     131"ps:tools:blipp:linux:memory:utilization:free" [[BR]]
     132"ps:tools:blipp:linux:memory:utilization:kernel" [[BR]]
     133"ps:tools:blipp:linux:memory:utilization:used"
     134
     135For the memory free event type copy the value for the id key and add that value to your route, {{{ http://pcvm2-4.instageni.illinois.edu:42424/api/metadata/53a486ad377f972d2e1b8e7b }}}. This will display the single metadata object for memory free. To see the actual memory free data alter the URL to, {{{ http://pcvm2-4.instageni.illinois.edu:42424/api/data/53a486ad377f972d2e1b8e7b }}}.
     136
     137Now you should see all your data in JSON format. To reiterate, each metadata object represents an event type for a particular measurement. Navigating to a particular event type/metadata object by the metadata ID will get the single metadata object. Using that metadata ID, you can query the data route to get the data associated with that event type.
     138
     139Once you have your data you might like to visualize it to help make discoveries from the data. At this repository, [https://github.com/periscope-ps/peri-client-scripts] we provide some scripts to help you with data visualization.
     140
    128141[[BR]]