Changes between Version 6 and Version 7 of GEC16Agenda/IMDesignTopics
- Timestamp:
- 03/11/13 12:09:43 (11 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
GEC16Agenda/IMDesignTopics
v6 v7 9 9 == Description == 10 10 11 This I&M session will focus on th e key issues of interest to both the GIMI and GEMINI projects, as they continue to work towards a comprehensive set of I&M tools for GENI experimenters and for infrastructure measurement. In particular, we will consider the services and functions that can be used by both the GIMI and GEMINI projects.[[BR]]11 This I&M session will focus on three key issues of interest to both the GIMI and GEMINI projects, as they continue to work towards a comprehensive set of I&M tools for GENI experimenters and for infrastructure measurement. [[BR]] 12 12 13 We will form teams that can resolve these issues. [[BR]] 13 We will first review the overall goal to move towards a "unified experiment environment". [[BR]] 14 15 Then, we will discuss these topics: 16 * Support for GIMI and GEMINI I&M tools on both ExoGENI and InstaGENI racks 17 * Use of an instrumentize script, driven by rspec extension, to configure/init all I&M tools 18 * Options for further measurement data analysis and presentation 19 20 For each topic, we will have a review of current practice, and a discussion of how to move forward. [[BR]] 21 22 Finally, we will form teams for continued discussion. [[BR]] 14 23 15 24 Finally, we will discuss the I&M goals for the next 4 months, particularly how to best support experimenters and those doing infrastructure measurement. [[BR]] … … 26 35 27 36 28 == 2) Meeting Introduction==37 == 2) Towards a Unified Experiment Environemnt == 29 38 8:35am [[BR]] 30 Harry Mussman (GENI Project Office) [[BR]] 39 Marshall Brinn (GENI Project Office) [[BR]] 40 10min 31 41 32 33 Today’s discussion topics: 34 35 36 Goals and Approach 37 * Work towards a "unified experiment environment". 38 * Help groups prepare responses to Sol 4 39 40 Current overall experiment configuration 41 42 Summary of current experiment steps 43 44 Possible next steps towards a “unified experiment environment”. 45 46 Today’s discussion topics: 47 * Support GIMI and GEMINI I&M tools on both ExoGENI and InstaGENI racks 48 * Use instrumentize script, driven by rspec extension, to configure/init I&M tools 49 * Options for further measurement data analysis and presentation 50 42 What does it mean to move towards a "unified experiment environment"? [[BR]] 51 43 52 44 53 45 == 3) Support GIMI and GEMINI I&M tools on both ExoGENI and InstaGENI racks == 54 8:4 0am46 8:45am 55 47 56 === Overview===48 === Introduction === 57 49 Harry Mussman [[BR]] 58 2min59 50 60 Step 3: Obtain slice, install software61 * Now: GIMI using ExoGENI, Flukes; loads images/pkgs62 * Now: GEMINI using InstaGENI, FLACK; loads images/pkgs63 51 64 Next: be able to use GEMINI on ExoGENI, and GIMI on InstaGENI 65 66 Suggest: set goal to begin testing all combinations starting 5/1; good support by GEC17 52 GENI experiment management Step 3: Obtain slice, install software 53 * Now: GIMI loaded (and tested) on ExoGENI 54 * Now: GEMINI loaded (and tested) on InstaGENI, FLACK 55 * Next: be able to use GEMINI on ExoGENI, and GIMI on InstaGENI 56 * Suggest: set goal to begin testing all combinations starting 5/1; good support by GEC17 67 57 68 58 === Lessons learned from using GIMI tools on ExoGENI racks === 69 59 Cong Wang [[BR]] 70 8min60 5min 71 61 72 4 slides: current config; current capabilities and issues; future possibilities 62 3 slides: current config; key techniques; known challenges [[BR]] 73 63 74 64 === Lessons learned from using GEMINI tools on InstaGENI racks === 75 65 Hussam Nasir [[BR]] 76 8min66 5min 77 67 78 4 slides: current config; current capabilities and issues; future possibilities 68 3 slides: current config; key techniques; known challenges [[BR]] 79 69 80 70 === Discussion === … … 82 72 Cong Wang; Hussam Nasir; (Ilia Baldine); (Rob Ricci); Louisa Nevers; Jeanne Ohren 83 73 74 How do we move towards using GEMINI on ExoGENI, and GIMI on InstaGENI? [[BR]] 75 84 76 Discuss: 77 * Suggested approaches 78 * Key techniques 79 * Likely challenges 85 80 * Goal to begin testing all combinations starting 5/1; good support by GEC17 86 * Likely roadblocks 87 * Suggested approaches 81 88 82 89 83 Any topics, suggestions and issues suggested AHEAD OF TIME by members of roundtable? 90 84 91 At the end: any conclusions, list of issues, team to continue discussion] 85 At the end: 86 * List of conclusions 87 * List of issues 88 * Team to continue discussion 92 89 93 90 94 95 == 4) Use instrumentize script, driven by rspec extension, to configure/init I&M tools == 96 9:15am 91 == 4) Use of instrumentize script, driven by rspec extension, to configure/init I&M tools == 92 9:10am 97 93 98 94 === Overview === 99 95 Harry Mussman [[BR]] 100 2min101 96 102 Step 4: Configure/init I&M and exp app 97 98 GENI experiment management Step 4: Configure/init I&M and exp app 103 99 * Now: GIMI using post boot scripts, OMF 104 100 * Now: GEMINI using instrumentize script, choices based on rspec extension; also used to add GN 105 106 Next: move towards common approach, to better unify experiment environment 107 108 Suggest: both move towards script, driven by rspec ext; discuss at I&M session 101 * Next: move towards common approach, to better unify experiment environment 102 * Suggest: both move towards script, driven by rspec ext; discuss at I&M session 109 103 110 104 === Current GIMI use of post boot scripts, OMF, to configure/inti services === … … 112 106 5min 113 107 114 2 slides: current config; current capabilities and issues; future possibilities 108 3 slides: key techniques; known challenges [[BR]] 115 109 116 110 === Current GEMINI use of instrumentize script, to configure/init services === … … 118 112 5min 119 113 120 2 slides: current config; current capabilities and issues; future possibilities 114 3 slides: key techniques; known challenges [[BR]] 121 115 122 116 === Discussion === 123 10min 124 Cong Wang; Hussam Nasir; Aaron Helsinger; Jeanne Ohren [[BR]] 117 15min 118 Cong Wang; Hussam Nasir; Marshall Brinn; Jeanne Ohren [[BR]] 119 120 How do we move towards a common approach to configure and initialize I&M tools, to better unify experiment environment? 121 122 Consider: move towards script, driven by rspec ext; or is there a better solution? 123 125 124 126 125 [Any topics, suggestions and issues suggested AHEAD OF TIME by members of roundtable] 127 126 128 [At the end: any conclusions, list of issues, team to continue discussion] 127 At the end: 128 * List of conclusions 129 * List of issues 130 * Team to continue discussion 129 131 130 132 131 133 == 5) Options for further measurement data analysis and presentation == 132 9: 40am134 9:35am 133 135 134 === Overview===136 === Introduction === 135 137 Harry Mussman [[BR]] 136 2min137 138 138 Step 6: Analyze 139 140 GENI experiment management Step 6: Analyze 139 141 * Now: Both GEMINI and GIMI push measurement data objects (files) to GENI Storage Service (iRODS) 140 142 * Now: GEMINI provides dump of mongo DB, plus separate file of metadata 141 143 * Now: GIMI (will) provide SQLdump of PostgreSQL DB, which includes metadata 142 143 144 * Now: Both use portal on GENI Storage Service (iRODS) to curate files (objects) 144 145 145 Both: Pull measurement data files from GENI Storage Service (iRODS) back to user workspace, where DBs can be reconstituted, and data pulled for further analysis and presentation. 146 Both: Pull measurement data files from GENI Storage Service (iRODS) back to user workspace, where DBs can be reconstituted, and data pulled for further analysis and presentation. [[BR]] 146 147 147 Both: Many options for further analysis and presentation, not being developed as part of tools. 148 Both: Many options for further analysis and presentation, not being developed as part of tools. [[BR]] 148 149 149 Next: Consider possible ways to unify data formats, analysis and presentation 150 Next: Consider possible ways to unify data formats, analysis and presentation; what commonly available tools might be useful? [[BR]] 150 151 151 Suggest: Discuss what might be possible, and potential approaches at I&M session 152 152 153 153 154 === Current GIMI measurement data object schema === 154 (Christoph Dwertmann)[[BR]]155 Charles Glass [[BR]] 155 156 10min 156 157 … … 160 161 161 162 === Discussion === 162 (Christoph Dwertmann); Ezra Kissel; Marshall Brinn; Fraida Fund [[BR]]163 Charles Glass; Ezra Kissel; Marshall Brinn; Fraida Fund [[BR]] 163 164 10min 165 166 What are possible ways to unify data formats? [[BR]] 167 168 How could we unify further analysis and presentation? [[BR]] 169 170 What commonly available tools might be useful? [[BR]] 171 164 172 165 173 [Any topics, suggestions and issues suggested AHEAD OF TIME by members of roundtable] 166 174 167 [At the end: any conclusions, list of issues, team to continue discussion] 175 At the end: 176 * List of conclusions 177 * List of issues 178 * Team to continue discussion 168 179 169 180