Changes between Version 29 and Version 30 of GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-3


Ignore:
Timestamp:
03/06/13 10:09:38 (11 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-3

    v29 v30  
    11[[PageOutline]]
    22
    3 = Detailed test plan for IG-MON-3: GENI Active Experiment Inspection Test =
    4 
    5 ''This page is GPO's working page for performing IG-MON-3.  It is public for informational purposes, but it is not an official status report.  See [wiki:GENIRacksHome/InstageniRacks/AcceptanceTestStatus] for the current status of InstaGENI acceptance tests.''
    6 
    7 ''Last substantive edit of this page: 2012-07-26''
    8 
    9 == Page format ==
    10 
    11  * The status chart summarizes the state of this test
    12  * The high-level description from test plan contains text copied exactly from the public test plan and acceptance criteria pages.
    13  * The steps contain things i will actually do/verify:
    14    * Steps may be composed of related substeps where i find this useful for clarity
    15    * Each step is either a preparatory step (identified by "(prep)") or a verification step (the default):
    16      * Preparatory steps are just things we have to do.  They're not tests of the rack, but are prerequisites for subsequent verification steps
    17      * Verification steps are steps in which we will actually look at rack output and make sure it is as expected.  They contain a '''Using:''' block, which lists the steps to run the verification, and an '''Expect:''' block which lists what outcome is expected for the test to pass.
    18 
    19 == Status of test ==
    20 
    21 || '''Step''' || '''State'''                               || '''Date completed''' || '''Open Tickets''' || '''Closed Tickets/Comments'''                                                                                                              ||
    22 || 1          || [[Color(yellow,Completed)]]               ||                      ||                    || needs retesting when 3 is retested                                                                                                         ||
    23 || 2          ||                                           ||                      ||                    || needs retesting when 3 is retested                                                                                                         ||
    24 || 3          || [[Color(yellow,Completed)]]               ||                      ||                    || needs retesting once OpenFlow resources are available from InstaGENI AM                                                                    ||
    25 || 4          || [[Color(green,Pass)]]                     || 2013-02-28           ||                    || ([instaticket:35], [instaticket:26]) blocked on resolution of MAC reporting issue                                                          ||
    26 || 5          || [[Color(lightgreen,Pass: most criteria)]] || 2013-02-28           ||                    || ([instaticket:26], [instaticket:31]) terminated experiments display format is a little hard to use, but contains the requested information ||
    27 || 6          || [[Color(orange,Blocked)]]                 ||                      ||                    || blocked on availability of OpenFlow functionality                                                                                          ||
    28 || 7          ||                                           ||                      ||                    || ready to test non-OpenFlow functionality                                                                                                   ||
    29 || 8          ||                                           ||                      ||                    || ready to test non-OpenFlow functionality                                                                                                   ||
    30 
    31 == High-level description from test plan ==
    32 
    33 This test inspects the state of the rack data plane and control networks when experiments are running, and verifies that a site administrator can find information about running experiments.
    34 
    35 === Procedure ===
     3= IG-MON-3: GENI Active Experiment Inspection Test =
     4
     5This page captures status for the test case IG-MON-3, which verifies the ability to start, stop, and terminate experiments by experimenters and administrators.   For overall status see the [wiki:GENIRacksHome/InstageniRacks/AcceptanceTestStatus InstaGENI Acceptance Test Status] page.
     6
     7''Last update: 2013-03-06''
     8
     9== Test Status ==
     10
     11|| '''Step''' || '''State'''                ||  '''Tickets''' ||    '''Notes'''                      ||
     12|| 1          || [[Color(yellow,Completed)]]||                || needs retesting when 3 is retested   ||
     13|| 2          ||                            ||                || needs retesting when 3 is retested   ||
     14|| 3          ||[[Color(yellow,Completed)]] ||                || needs retesting once OpenFlow resources are available from InstaGENI AM            ||
     15|| 4          || [[Color(green,Pass)]]      ||                ||2013-02-28([instaticket:35], [instaticket:26]) blocked on resolution of MAC reporting issue ||
     16|| 5          ||[[Color(lightgreen,Pass: most criteria)]]||   ||2013-02-28 ([instaticket:26], [instaticket:31]) terminated experiments display format is a little hard to use, but contains the requested information ||
     17|| 6          || [[Color(orange,Blocked)]] ||                 || blocked on availability of OpenFlow functionality  ||
     18|| 7          ||                           ||                 || ready to test non-OpenFlow functionality ||
     19|| 8          ||                           ||                 || ready to test non-OpenFlow functionality ||
     20
     21[[BR]]
     22|| '''State Legend'''                     || '''Description'''                                                    ||
     23|| [[Color(green,Pass)]]                  || Test completed and met all criteria                                  ||
     24|| [[Color(#98FB98,Pass: most criteria)]] || Test completed and met most criteria. Exceptions documented          ||
     25|| [[Color(red,Fail)]]                    || Test completed and failed to meet criteria.                          ||
     26|| [[Color(yellow,Complete)]]             || Test completed but will require re-execution due to expected changes ||
     27|| [[Color(orange,Blocked)]]              || Blocked by ticketed issue(s).                                        ||
     28|| [[Color(#63B8FF,In Progress)]]         || Currently under test.                                                ||
     29[[BR]]
     30
     31= Test Plan Steps =
    3632
    3733 * An experimenter from the GPO starts up experiments to ensure there is data to look at:
     
    4844   * For some experimental data path which is actively sending traffic on the data plane switch, do changes in interface counters show approximately the expected amount of traffic into and out of the switch?
    4945
    50 === Criteria to verify as part of this test ===
    51 
    52  * VII.09. A site administrator can determine the MAC addresses of all physical host interfaces, all network device interfaces, all active experimental VMs, and all recently-terminated experimental VMs. (C.3.f)
    53  * VII.11. A site administrator can locate current configuration of flowvisor, FOAM, and any other OpenFlow services, and find logs of recent activity and changes. (D.6.a)
    54  * VII.18. Given a public IP address and port, an exclusive VLAN, a sliver name, or a piece of user-identifying information such as e-mail address or username, a site administrator or GMOC operator can identify the email address, username, and affiliation of the experimenter who controlled that resource at a particular time. (D.7)
     46
    5547
    5648== Step 1 (prep): start a VM experiment and terminate it ==
    5749
    58  * An experimenter requests an experiment from the InstaGENI AM containing two rack VMs and a dataplane VLAN
    59  * The experimenter logs into a VM, and sends dataplane traffic
    60  * The experimenter terminates the experiment
    61 
    62 === Results of testing step 1: 2012-05-18 ===
    63 
    64  * I'll use the following rspec to get two VMs:
    65 {{{
    66 jericho,[~],05:29(0)$ cat IG-MON-nodes-C.rspec
     50As experimenter create a 2 VMs experiment in the GPO InstaGENI rack. RSpec used:
     51{{{
    6752<?xml version="1.0" encoding="UTF-8"?>
    68 <!-- This rspec will reserve two openvz nodes, each with no OS specified,
    69      and create a single dataplane link between them.  It should work
    70      on any Emulab which has nodes available and supports OpenVZ.  -->
    71 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    72        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    73        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    74                            http://www.geni.net/resources/rspec/3/request.xsd"
    75        type="request">
    76 
    77   <node client_id="virt1" exclusive="false">
    78     <sliver_type name="emulab-openvz" />
    79     <interface client_id="virt1:if0" />
     53<!--
     54This example RSpec shows how to request 2 VMs at the GPO InstaGENI Rack.
     55-->
     56<rspec type="request"
     57        xmlns="http://www.geni.net/resources/rspec/3"
     58        xmlns:flack="http://www.protogeni.net/resources/rspec/ext/flack/1"
     59        xmlns:planetlab="http://www.planet-lab.org/resources/sfa/ext/planetlab/1"
     60        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
     61        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
     62        http://www.geni.net/resources/rspec/3/request.xsd"> 
     63
     64  <node client_id="VM-1" component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="false">
     65    <sliver_type name="emulab-openvz"/>
     66    <interface client_id="VM-1:if0">
     67      <ip address="192.168.1.1" netmask="255.255.255.0" type="ipv4"/>
     68    </interface>
    8069  </node>
    81   <node client_id="virt2" exclusive="false">
    82     <sliver_type name="emulab-openvz" />
    83     <interface client_id="virt2:if0" />
     70  <node client_id="VM-2" component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="false">
     71    <sliver_type name="emulab-openvz"/>
     72    <interface client_id="VM-2:if0">
     73      <ip address="192.168.1.2" netmask="255.255.255.0" type="ipv4"/>
     74    </interface>
    8475  </node>
    85 
    86   <link client_id="virt1-virt2-0">
    87     <interface_ref client_id="virt1:if0"/>
    88     <interface_ref client_id="virt2:if0"/>
    89     <property source_id="virt1:if0" dest_id="virt2:if0"/>
    90     <property source_id="virt2:if0" dest_id="virt1:if0"/>
     76  <link client_id="lan0">
     77    <component_manager name="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm"/>
     78    <interface_ref client_id="VM-1:if0"/>
     79    <interface_ref client_id="VM-2:if0"/>
     80    <link_type name="lan"/>
    9181  </link>
    9282</rspec>
    9383}}}
    94  * Then create a slice:
    95 {{{
    96 omni createslice ecgtest2
    97 }}}
    98  * Then create a sliver using that rspec:
    99 {{{
    100 jericho,[~],05:31(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest2 ~/IG-MON-nodes-C.rspec
    101 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
     84
     85Create a slice and sliver:
     86{{{
     87
     88$ omni.py createslice EG-MON-3
     89INFO:omni:Loading config file /home/lnevers/.gcf/omni_config
    10290INFO:omni:Using control framework pg
    103 ERROR:omni.protogeni:Call for Get Slice Cred for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 failed.: Exception: PG Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 does not exist.
    104 ERROR:omni.protogeni:    ..... Run with --debug for more information
    105 ERROR:omni:Cannot create sliver urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2: Could not get slice credential: Exception: PG Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 does not exist.
    106 }}}
    107  * It looks like the slice just wasn't ready yet.  Trying again after a minute, the same thing worked:
    108 {{{
    109 jericho,[~],05:31(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest2 ~/IG-MON-nodes-C.rspec
    110 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
     91INFO:omni:Created slice with Name EG-MON-3, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-MON-3, Expiration 2013-03-07 15:09:24+00:00
     92INFO:omni: ------------------------------------------------------------
     93INFO:omni: Completed createslice:
     94  Options as run:
     95                framework: pg
     96
     97  Args: createslice EG-MON-3
     98  Result Summary: Created slice with Name EG-MON-3, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-MON-3, Expiration 2013-03-07 15:09:24+00:00
     99INFO:omni: ============================================================
     100
     101$ omni.py createsliver -a ig-gpo EG-MON-3  ./instageni-2vm-at-gpo.rspec
     102INFO:omni:Loading config file /home/lnevers/.gcf/omni_config
    111103INFO:omni:Using control framework pg
    112 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-05-19 10:30:51 UTC
    113 INFO:omni:Creating sliver(s) from rspec file /home/chaos/IG-MON-nodes-C.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2
    114 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    115 INFO:omni:<?xml version="1.0" ?>
     104INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN
     105INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-MON-3 expires on 2013-03-07 15:09:24 UTC
     106INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN
     107INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN
     108INFO:omni:Creating sliver(s) from rspec file ./instageni-2vm-at-gpo.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+EG-MON-3
     109INFO:omni: (PG log url - look here for details on any failures: https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=388177e82b203e84aa3694dda7bf441d)
     110INFO:omni:Got return from CreateSliver for slice EG-MON-3 at https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0:
    116111INFO:omni:<!-- Reserved resources for:
    117         Slice: ecgtest2
    118         At AM:
    119         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
     112        Slice: EG-MON-3
     113        at AM:
     114        URN: unspecified_AM_URN
     115        URL: https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0
    120116 -->
    121 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    122 
    123     <node client_id="virt1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc2" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+372">   
    124         <sliver_type name="emulab-openvz"/>   
    125         <interface client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc2:eth1" mac_address="00000a0a0101" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+375">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    126       <rs:vnode name="pcvm2-1" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt1.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc2.utah.geniracks.net" port="30266" username="chaos"/>    </services>  </node> 
    127     <node client_id="virt2" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc5" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+373">   
    128         <sliver_type name="emulab-openvz"/>   
    129         <interface client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:eth1" mac_address="00000a0a0102" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+376">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    130       <rs:vnode name="pcvm5-2" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt2.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc5.utah.geniracks.net" port="30266" username="chaos"/>    </services>  </node> 
    131 
    132     <link client_id="virt1-virt2-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+374" vlantag="260">   
    133         <interface_ref client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc2:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+375"/>   
    134         <interface_ref client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+376"/>   
    135         <property dest_id="virt2:if0" source_id="virt1:if0"/>   
    136         <property dest_id="virt1:if0" source_id="virt2:if0"/>   
    137     </link> 
     117INFO:omni:<rspec xmlns="http://www.geni.net/resources/rspec/3" xmlns:flack="http://www.protogeni.net/resources/rspec/ext/flack/1" xmlns:planetlab="http://www.planet-lab.org/resources/sfa/ext/planetlab/1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" type="manifest" xsi:schemaLocation="http://www.geni.net/resources/rspec/3   http://www.geni.net/resources/rspec/3/manifest.xsd"> 
     118
     119  <node client_id="VM-1" component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="false" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+node+pc2" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2048">
     120    <sliver_type name="emulab-openvz"/>
     121    <interface client_id="VM-1:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc2:lo0" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2052" mac_address="02104639f347">
     122      <ip address="192.168.1.1" netmask="255.255.255.0" type="ipv4"/>
     123    </interface>
     124  <rs:vnode xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1" name="pcvm2-1"/><host name="VM-1.EG-MON-3.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com"/><services><login authentication="ssh-keys" hostname="pc2.instageni.gpolab.bbn.com" port="31290" username="lnevers"/></services></node>
     125  <node client_id="VM-2" component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="false" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+node+pc2" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2049">
     126    <sliver_type name="emulab-openvz"/>
     127    <interface client_id="VM-2:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc2:lo0" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2053" mac_address="020063c74361">
     128      <ip address="192.168.1.2" netmask="255.255.255.0" type="ipv4"/>
     129    </interface>
     130  <rs:vnode xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1" name="pcvm2-6"/><host name="VM-2.EG-MON-3.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com"/><services><login authentication="ssh-keys" hostname="pc2.instageni.gpolab.bbn.com" port="31291" username="lnevers"/></services></node>
     131  <link client_id="lan0" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2051">
     132    <component_manager name="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm"/>
     133    <interface_ref client_id="VM-1:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc2:lo0" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2052"/>
     134    <interface_ref client_id="VM-2:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc2:lo0" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2053"/>
     135    <link_type name="lan"/>
     136  </link>
    138137</rspec>
    139138INFO:omni: ------------------------------------------------------------
    140139INFO:omni: Completed createsliver:
    141 
    142140  Options as run:
    143                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    144                 configfile: /home/chaos/omni/omni_pgeni
    145                 framework: pg
    146                 native: True
    147 
    148   Args: createsliver ecgtest2 /home/chaos/IG-MON-nodes-C.rspec
    149 
    150   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-05-19 10:30:51 UTC
    151 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
     141                aggregate: ['ig-gpo']
     142                framework: pg
     143  Args: createsliver EG-MON-3 ./instageni-2vm-at-gpo.rspec
     144  Result Summary: Got Reserved resources RSpec from instageni-gpolab-bbn-com-protogeniv2
    152145INFO:omni: ============================================================
    153 }}}
    154  * According to sliverstatus, my nodes are:
    155 {{{
    156 pc2.utah.geniracks.net port 30266
    157 pc5.utah.geniracks.net port 30266
    158 }}}
    159  * However, pc2 needs to run frisbee before this is ready.  Wait awhile.
    160  * Login to pc2.utah.geniracks.net on port 30266 with agent forwarding
    161  * Find that it is virt1 and has eth1=10.10.1.1
    162  * Find a big file:
    163 {{{
    164 [chaos@virt1 ~]$ ls -l /usr/lib/locale/locale-archive-rpm
    165 -rw-r--r-- 1 root root 99154656 May 20  2011 /usr/lib/locale/locale-archive-rpm
    166 }}}
    167  * Copy the big file over the dataplane:
    168 {{{
    169 [chaos@virt1 ~]$ scp /usr/lib/locale/locale-archive 10.10.1.2:/tmp/
    170 The authenticity of host '10.10.1.2 (10.10.1.2)' can't be established.
    171 RSA key fingerprint is 6d:1d:76:53:a5:25:99:39:e2:89:ea:b0:99:e3:d3:b9.
    172 Are you sure you want to continue connecting (yes/no)? yes
    173 Warning: Permanently added '10.10.1.2' (RSA) to the list of known hosts.
    174 locale-archive                                100%   95MB  11.8MB/s   00:08   
    175 }}}
    176  * Look at the arps table on virt1 and virt2:
    177 {{{
    178 [chaos@virt1 ~]$ /sbin/arp -a
    179 virt2-virt1-virt2-0 (10.10.1.2) at 82:02:0a:0a:01:02 [ether] on mv1.1
    180 pc2.utah.geniracks.net (155.98.34.12) at 00:01:ac:11:02:01 [ether] on eth999
    181 boss.utah.geniracks.net (155.98.34.4) at 00:01:ac:11:02:01 [ether] on eth999
    182 
    183 [chaos@virt1 ~]$ ssh 10.10.1.2
    184 Last login: Fri May 18 13:35:41 2012 from capybara.bbn.com
    185 
    186 [chaos@virt2 ~]$ /sbin/arp -a
    187 virt1-virt1-virt2-0 (10.10.1.1) at 82:01:0a:0a:01:01 [ether] on mv2.2
    188 boss.utah.geniracks.net (155.98.34.4) at 00:01:ac:11:05:02 [ether] on eth999
    189 pc5.utah.geniracks.net (155.98.34.15) at 00:01:ac:11:05:02 [ether] on eth999
    190 }}}
    191  * Delete the sliver:
    192 {{{
    193 jericho,[~],05:53(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am deletesliver ecgtest2
    194 }}}
    195 
    196 === Results of testing step 1: 2012-05-21 ===
    197 
    198 ''Note: repeating this test for continuation of IG-MON-3 testing on 2012-05-21.''
    199 
    200  * I'll use the following rspec to get two VMs:
    201 {{{
    202 jericho,[~],11:33(0)$ cat omni/rspecs/request/rack-testing/acceptance-tests/IG-M
    203 ON-nodes-C.rspec
     146
     147}}}
     148
     149Determine login information for the VM resources assigned and that the VMs are "ready" for use:
     150{{{
     151$ readyToLogin.py -a ig-gpo EG-MON-3                               
     152<...>
     153VM-2's geni_status is: ready (am_status:ready)
     154User lnevers logins to VM-2 using:
     155        xterm -e ssh -p 31291  -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com &
     156
     157VM-1's geni_status is: ready (am_status:ready)
     158User lnevers logins to VM-1 using:
     159        xterm -e ssh -p 31290  -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com &
     160}}}
     161
     162Login to VM-1, verify hostname, address assignment and initial ARP table entries:
     163{{{
     164$ ssh -p 31290  -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com
     165
     166[lnevers@VM-1 ~]$ /sbin/ifconfig mv1.12
     167mv1.12    Link encap:Ethernet  HWaddr 02:10:46:39:F3:47 
     168          inet addr:192.168.1.1  Bcast:192.168.1.255  Mask:255.255.255.0
     169          inet6 addr: fe80::10:46ff:fe39:f347/64 Scope:Link
     170          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     171          RX packets:6 errors:0 dropped:0 overruns:0 frame:0
     172          TX packets:0 errors:0 dropped:6 overruns:0 carrier:0
     173          collisions:0 txqueuelen:0
     174          RX bytes:552 (552.0 b)  TX bytes:0 (0.0 b)
     175
     176[lnevers@VM-1 ~]$ /sbin/arp -a
     177pc2.instageni.gpolab.bbn.com (192.1.242.141) at 10:60:4b:9b:82:14 [ether] on eth999
     178boss.instageni.gpolab.bbn.com (192.1.242.132) at 02:9e:26:f1:52:99 [ether] on eth999
     179
     180}}}
     181Login to VM-2, verify hostname, address assignment, MAC address for data plane interface, and initial ARP table entries:
     182{{{
     183$ ssh -p 31291  -i /home/lnevers/.ssh/id_rsa lnevers@pc2.instageni.gpolab.bbn.com
     184[lnevers@VM-2 ~]$ /sbin/ifconfig mv6.13
     185mv6.13    Link encap:Ethernet  HWaddr 02:00:63:C7:43:61 
     186          inet addr:192.168.1.2  Bcast:192.168.1.255  Mask:255.255.255.0
     187          inet6 addr: fe80::63ff:fec7:4361/64 Scope:Link
     188          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     189          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
     190          TX packets:0 errors:0 dropped:6 overruns:0 carrier:0
     191          collisions:0 txqueuelen:0
     192          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
     193
     194[lnevers@VM-2 ~]$ /sbin/arp -a
     195pc2.instageni.gpolab.bbn.com (192.1.242.141) at 10:60:4b:9b:82:14 [ether] on eth999
     196boss.instageni.gpolab.bbn.com (192.1.242.132) at 02:9e:26:f1:52:99 [ether] on eth999
     197}}}
     198
     199Install iperf on both VMs and exchange TCP traffic from VM-1 client to VM-2 server over the data plane interface and look at ARP table entries:
     200
     201{{{
     202[lnevers@VM-1 ~]$ /usr/bin/iperf -c 192.168.1.2 -t 60
     203------------------------------------------------------------
     204Client connecting to 192.168.1.2, TCP port 5001
     205TCP window size: 16.0 KByte (default)
     206------------------------------------------------------------
     207[  3] local 192.168.1.1 port 55185 connected with 192.168.1.2 port 5001
     208[ ID] Interval       Transfer     Bandwidth
     209[  3]  0.0-60.0 sec   687 MBytes  96.0 Mbits/sec
     210
     211[lnevers@VM-1 ~]$  /sbin/arp -a
     212pc2.instageni.gpolab.bbn.com (192.1.242.141) at 10:60:4b:9b:82:14 [ether] on eth999
     213boss.instageni.gpolab.bbn.com (192.1.242.132) at 02:9e:26:f1:52:99 [ether] on eth999
     214VM-2-lan0 (192.168.1.2) at 02:00:63:c7:43:61 [ether] on mv1.12
     215}}}
     216
     217Show ARP entries on VM2 (iperf server):
     218{{{
     219[lnevers@VM-2 ~]$ /sbin/arp -a
     220pc2.instageni.gpolab.bbn.com (192.1.242.141) at 10:60:4b:9b:82:14 [ether] on eth999
     221boss.instageni.gpolab.bbn.com (192.1.242.132) at 02:9e:26:f1:52:99 [ether] on eth999
     222VM-1-lan0 (192.168.1.1) at 02:10:46:39:f3:47 [ether] on mv6.13
     223
     224}}}
     225
     226Leave sliver running.
     227
     228== Step 2 (prep): start a bare metal node experiment and terminate it ==
     229
     230As experimenter create a 2 Raw PCs experiment in the GPO InstaGENI rack. RSpec used:
     231{{{
    204232<?xml version="1.0" encoding="UTF-8"?>
    205 <!-- This rspec will reserve two openvz nodes, each with no OS specified,
    206      and create a single dataplane link between them.  It should work
    207      on any Emulab which has nodes available and supports OpenVZ.  -->
    208 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    209        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    210        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    211                            http://www.geni.net/resources/rspec/3/request.xsd"
    212        type="request">
    213 
    214   <node client_id="virt1" exclusive="false">
    215     <sliver_type name="emulab-openvz" />
    216     <interface client_id="virt1:if0" />
     233<rspec type="request"
     234        xmlns="http://www.geni.net/resources/rspec/3"
     235        xmlns:flack="http://www.protogeni.net/resources/rspec/ext/flack/1"
     236        xmlns:planetlab="http://www.planet-lab.org/resources/sfa/ext/planetlab/1"
     237        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
     238        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
     239        http://www.geni.net/resources/rspec/3/request.xsd"> 
     240
     241  <node client_id="PC-1" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+node+pc5"         
     242        component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="true">
     243    <sliver_type name="raw-pc"/>
     244    <interface client_id="PC-1:if0">
     245      <ip address="192.168.1.1" netmask="255.255.255.0" type="ipv4"/>
     246    </interface>
    217247  </node>
    218   <node client_id="virt2" exclusive="false">
    219     <sliver_type name="emulab-openvz" />
    220     <interface client_id="virt2:if0" />
     248
     249  <node client_id="PC-2" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+node+pc4" 
     250        component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="true">
     251    <sliver_type name="raw-pc"/>
     252    <interface client_id="PC-2:if0">
     253      <ip address="192.168.1.2" netmask="255.255.255.0" type="ipv4"/>
     254    </interface>
    221255  </node>
    222 
    223   <link client_id="virt1-virt2-0">
    224     <interface_ref client_id="virt1:if0"/>
    225     <interface_ref client_id="virt2:if0"/>
    226     <property source_id="virt1:if0" dest_id="virt2:if0"/>
    227     <property source_id="virt2:if0" dest_id="virt1:if0"/>
     256  <link client_id="lan0">
     257    <component_manager name="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm"/>
     258    <interface_ref client_id="PC-1:if0"/>
     259    <interface_ref client_id="PC-2:if0"/>
     260    <link_type name="lan"/>
    228261  </link>
    229262</rspec>
    230 }}}
    231  * Then create a slice:
    232 {{{
    233 omni createslice ecgtest2
    234 }}}
    235  * Then create a sliver using that rspec:
    236 {{{
    237 jericho,[~],14:16(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest2 ~/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    238 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
     263
     264}}}
     265
     266Create a slice and sliver:
     267
     268{{{
     269$ omni.py createslice IG-MON-3
     270INFO:omni:Loading config file /home/lnevers/.gcf/omni_config
    239271INFO:omni:Using control framework pg
    240 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-05-22 19:16:43 UTC
    241 INFO:omni:Creating sliver(s) from rspec file /home/chaos/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2
    242 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    243 INFO:omni:<?xml version="1.0" ?>
     272INFO:omni:Created slice with Name IG-MON-3, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-MON-3, Expiration 2013-03-07 15:47:53+00:00
     273INFO:omni: ------------------------------------------------------------
     274INFO:omni: Completed createslice:
     275  Options as run:
     276                framework: pg
     277
     278  Args: createslice IG-MON-3
     279  Result Summary: Created slice with Name IG-MON-3, URN urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-MON-3, Expiration 2013-03-07 15:47:53+00:00
     280INFO:omni: ============================================================
     281
     282$ omni.py createsliver -a ig-gpo IG-MON-3 ./instageni-2rawpc-at-gpo.rspec
     283INFO:omni:Loading config file /home/lnevers/.gcf/omni_config
     284INFO:omni:Using control framework pg
     285INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN
     286INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-MON-3 expires on 2013-03-07 15:47:53 UTC
     287INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN
     288INFO:omni:Substituting AM nickname ig-gpo with URL https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0, URN unspecified_AM_URN
     289INFO:omni:Creating sliver(s) from rspec file ./instageni-2rawpc-at-gpo.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-MON-3
     290INFO:omni: (PG log url - look here for details on any failures: https://boss.instageni.gpolab.bbn.com/spewlogfile.php3?logfile=deb52735b826a50320d5274e8e4c6c8e)
     291INFO:omni:Got return from CreateSliver for slice IG-MON-3 at https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0:
    244292INFO:omni:<!-- Reserved resources for:
    245         Slice: ecgtest2
    246         At AM:
    247         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
     293        Slice: IG-MON-3
     294        at AM:
     295        URN: unspecified_AM_URN
     296        URL: https://instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0
    248297 -->
    249 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    250 
    251     <node client_id="virt1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc3" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+773">   
    252         <sliver_type name="emulab-openvz"/>   
    253         <interface client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+776">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    254       <rs:vnode name="pcvm3-1" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt1.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc3.utah.geniracks.net" port="30010" username="chaos"/>    </services>  </node> 
    255     <node client_id="virt2" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc3" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+774">   
    256         <sliver_type name="emulab-openvz"/>   
    257         <interface client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+777">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    258       <rs:vnode name="pcvm3-2" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt2.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc3.utah.geniracks.net" port="30011" username="chaos"/>    </services>  </node> 
    259 
    260     <link client_id="virt1-virt2-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+775">   
    261         <interface_ref client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+776"/>   
    262         <interface_ref client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+777"/>   
    263         <property dest_id="virt2:if0" source_id="virt1:if0"/>   
    264         <property dest_id="virt1:if0" source_id="virt2:if0"/>   
    265     </link> 
     298INFO:omni:<rspec xmlns="http://www.geni.net/resources/rspec/3" xmlns:flack="http://www.protogeni.net/resources/rspec/ext/flack/1" xmlns:planetlab="http://www.planet-lab.org/resources/sfa/ext/planetlab/1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" type="manifest" xsi:schemaLocation="http://www.geni.net/resources/rspec/3   http://www.geni.net/resources/rspec/3/manifest.xsd"> 
     299
     300  <node client_id="PC-1" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+node+pc5" component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2042">
     301    <sliver_type name="raw-pc"/>
     302    <interface client_id="PC-1:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc5:eth1" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2046" mac_address="10604B9C476A">
     303      <ip address="192.168.1.1" netmask="255.255.255.0" type="ipv4"/>
     304    </interface>
     305  <rs:vnode xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1" name="pc5"/><host name="PC-1.IG-MON-3.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com"/><services><login authentication="ssh-keys" hostname="pc5.instageni.gpolab.bbn.com" port="22" username="lnevers"/></services></node>
     306
     307  <node client_id="PC-2" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+node+pc4" component_manager_id="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2043">
     308    <sliver_type name="raw-pc"/>
     309    <interface client_id="PC-2:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc4:eth1" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2047" mac_address="10604B9600D6">
     310      <ip address="192.168.1.2" netmask="255.255.255.0" type="ipv4"/>
     311    </interface>
     312  <rs:vnode xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1" name="pc4"/><host name="PC-2.IG-MON-3.pgeni-gpolab-bbn-com.instageni.gpolab.bbn.com"/><services><login authentication="ssh-keys" hostname="pc4.instageni.gpolab.bbn.com" port="22" username="lnevers"/></services></node>
     313  <link client_id="lan0" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2045" vlantag="258">
     314    <component_manager name="urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm"/>
     315    <interface_ref client_id="PC-1:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc5:eth1" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2046"/>
     316    <interface_ref client_id="PC-2:if0" component_id="urn:publicid:IDN+instageni.gpolab.bbn.com+interface+pc4:eth1" sliver_id="urn:publicid:IDN+instageni.gpolab.bbn.com+sliver+2047"/>
     317    <link_type name="lan"/>
     318  </link>
    266319</rspec>
    267320INFO:omni: ------------------------------------------------------------
    268321INFO:omni: Completed createsliver:
    269 
    270322  Options as run:
    271                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    272                 configfile: /home/chaos/omni/omni_pgeni
    273                 framework: pg
    274                 native: True
    275 
    276   Args: createsliver ecgtest2 /home/chaos/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    277 
    278   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-05-22 19:16:43 UTC
    279 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
     323                aggregate: ['ig-gpo']
     324                framework: pg
     325  Args: createsliver IG-MON-3 ./instageni-2rawpc-at-gpo.rspec
     326  Result Summary: Got Reserved resources RSpec from instageni-gpolab-bbn-com-protogeniv2
    280327INFO:omni: ============================================================
    281328}}}
    282  * Hmm, i got a busy failure on sliverstatus:
    283 {{{
    284 jericho,[~],14:17(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am sliverstatus ecgtest2                                                           INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
    285 INFO:omni:Using control framework pg
    286 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-05-22 19:16:43 UTC
    287 INFO:omni:Status of Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2:
    288 ERROR:omni.protogeni:Call for Sliver status of urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 at http://www.utah.geniracks.net/protogeni/xmlrpc/am failed. Server says: <Fault 14: 'resource is busy; try again later'>
    289 INFO:omni.protogeni: ... pausing 10 seconds and retrying ....
    290 ERROR:omni.protogeni:Call for Sliver status of urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 at http://www.utah.geniracks.net/protogeni/xmlrpc/am failed. Server says: <Fault 14: 'resource is busy; try again later'>
    291 INFO:omni.protogeni: ... pausing 10 seconds and retrying ....
    292 ERROR:omni.protogeni:Call for Sliver status of urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 at http://www.utah.geniracks.net/protogeni/xmlrpc/am failed. Server says: <Fault 14: 'resource is busy; try again later'>
    293 INFO:omni: ------------------------------------------------------------
    294 INFO:omni: Completed sliverstatus:
    295 
    296   Options as run:
    297                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    298                 configfile: /home/chaos/omni/omni_pgeni
    299                 framework: pg
    300                 native: True
    301 
    302   Args: sliverstatus ecgtest2
    303 
    304   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-05-22 19:16:43 UTC
    305 
    306 Failed to get SliverStatus on ecgtest2 at AM http://www.utah.geniracks.net/protogeni/xmlrpc/am: <Fault 14: 'resource is busy; try again later'>
    307 Returned status of slivers on 0 of 1 possible aggregates.
    308 INFO:omni: ============================================================
    309 }}}
    310  * Getversion succeeded, though, and after awhile, sliverstatus succeeded again.
    311  * According to sliverstatus, my nodes are:
    312 {{{
    313 pc3.utah.geniracks.net port 30010
    314 pc3.utah.geniracks.net port 30011
    315 }}}
    316  * Login to pc3.utah.geniracks.net on port 30010 with agent forwarding
    317  * Find that it is virt1 and has eth1=10.10.1.1
    318  * Find a big file:
    319 {{{
    320 [chaos@virt1 ~]$ ls -l /usr/lib/locale/locale-archive-rpm
    321 -rw-r--r-- 1 root root 99154656 May 20  2011 /usr/lib/locale/locale-archive-rpm
    322 }}}
    323  * Copy the big file over the dataplane:
    324 {{{
    325 [chaos@virt1 ~]$ scp /usr/lib/locale/locale-archive 10.10.1.2:/tmp/
    326 locale-archive                                100%   95MB  10.5MB/s   00:09   
    327 }}}
    328  * Look at the arps table on virt1 and virt2:
    329 {{{
    330 [chaos@virt1 ~]$ /sbin/arp -a
    331 virt2-virt1-virt2-0 (10.10.1.2) at 82:02:0a:0a:01:02 [ether] on mv1.1
    332 pc3.utah.geniracks.net (155.98.34.13) at 00:01:ac:11:03:01 [ether] on eth999
    333 boss.utah.geniracks.net (155.98.34.4) at 00:01:ac:11:03:01 [ether] on eth999
    334 
    335 [chaos@virt1 ~]$ ssh 10.10.1.2
    336 
    337 [chaos@virt2 ~]$ /sbin/arp -a
    338 virt1-virt1-virt2-0 (10.10.1.1) at 82:01:0a:0a:01:01 [ether] on mv2.2
    339 pc3.utah.geniracks.net (155.98.34.13) at 00:01:ac:11:03:02 [ether] on eth999
    340 boss.utah.geniracks.net (155.98.34.4) at 00:01:ac:11:03:02 [ether] on eth999
    341 }}}
    342  * Hmm, incidentally, the sliverstatus doesn't contain mac addresses at all:
    343 {{{
    344 jericho,[~],14:38(0)$ grep mac_address ecgtest2-sliverstatus-www-utah-geniracks-net-protogeni.json
    345 jericho,[~],14:39(1)$
    346 }}}
    347  * Delete the sliver:
    348 {{{
    349 omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am deletesliver ecgtest2
    350 }}}
    351 
    352 === Results of testing step 1: 2012-06-07 ===
    353 
    354 ''Note: repeating this test for continuation of IG-MON-3 testing on 2012-06-07.''
    355 
    356  * I'll use the following rspec to get two VMs:
    357 {{{
    358 jericho,[~],10:54(0)$ cat omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    359 <?xml version="1.0" encoding="UTF-8"?>
    360 <!-- This rspec will reserve two openvz nodes, each with no OS specified,
    361      and create a single dataplane link between them.  It should work
    362      on any Emulab which has nodes available and supports OpenVZ.  -->
    363 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    364        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    365        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    366                            http://www.geni.net/resources/rspec/3/request.xsd"
    367        type="request">
    368 
    369   <node client_id="virt1" exclusive="false">
    370     <sliver_type name="emulab-openvz" />
    371     <interface client_id="virt1:if0" />
    372   </node>
    373   <node client_id="virt2" exclusive="false">
    374     <sliver_type name="emulab-openvz" />
    375     <interface client_id="virt2:if0" />
    376   </node>
    377 
    378   <link client_id="virt1-virt2-0">
    379     <interface_ref client_id="virt1:if0"/>
    380     <interface_ref client_id="virt2:if0"/>
    381     <property source_id="virt1:if0" dest_id="virt2:if0"/>
    382     <property source_id="virt2:if0" dest_id="virt1:if0"/>
    383   </link>
    384 </rspec>
    385 }}}
    386  * Then create a slice:
    387 {{{
    388 omni createslice ecgtest2
    389 }}}
    390  * Then create a sliver using that rspec:
    391 {{{
    392 jericho,[~],11:22(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest2 ~/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    393 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
    394 INFO:omni:Using control framework pg
    395 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-06-08 16:22:42 UTC
    396 INFO:omni:Creating sliver(s) from rspec file /home/chaos/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2
    397 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    398 INFO:omni:<?xml version="1.0" ?>
    399 INFO:omni:<!-- Reserved resources for:
    400         Slice: ecgtest2
    401         At AM:
    402         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    403  -->
    404 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    405 
    406     <node client_id="virt1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc5" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+4237">   
    407         <sliver_type name="emulab-openvz"/>   
    408         <interface client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+4240">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    409       <rs:vnode name="pcvm5-3" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt1.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc5.utah.geniracks.net" port="30266" username="chaos"/>    </services>  </node> 
    410     <node client_id="virt2" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc5" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+4238">   
    411         <sliver_type name="emulab-openvz"/>   
    412         <interface client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+4241">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    413       <rs:vnode name="pcvm5-4" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt2.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc5.utah.geniracks.net" port="30267" username="chaos"/>    </services>  </node> 
    414 
    415     <link client_id="virt1-virt2-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+4239">   
    416         <interface_ref client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+4240"/>   
    417         <interface_ref client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+4241"/>   
    418         <property dest_id="virt2:if0" source_id="virt1:if0"/>   
    419         <property dest_id="virt1:if0" source_id="virt2:if0"/>   
    420     </link> 
    421 </rspec>
    422 INFO:omni: ------------------------------------------------------------
    423 INFO:omni: Completed createsliver:
    424 
    425   Options as run:
    426                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    427                 configfile: /home/chaos/omni/omni_pgeni
    428                 framework: pg
    429                 native: True
    430 
    431   Args: createsliver ecgtest2 /home/chaos/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    432 
    433   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-06-08 16:22:42 UTC
    434 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
    435 INFO:omni: ============================================================
    436 }}}
    437  * According to sliverstatus, my nodes are:
    438 {{{
    439 pc5.utah.geniracks.net port 30266
    440 pc5.utah.geniracks.net port 30267
    441 }}}
    442  * Login to pc5.utah.geniracks.net on port 30266 with agent forwarding
    443  * Find that it is virt1 and has mv3.3=10.10.1.1 (huh, my notes say this used to be eth1.  Did something change?  Ah, no, looking at the arp tables, it was always mvN.N: i was just being sloppy before.)
    444  * Find a big file:
    445 {{{
    446 [chaos@virt1 ~]$ ls -l /usr/lib/locale/locale-archive-rpm
    447 -rw-r--r-- 1 root root 99154656 May 20  2011 /usr/lib/locale/locale-archive-rpm
    448 }}}
    449  * Copy the big file over the dataplane:
    450 {{{
    451 [chaos@virt1 ~]$ scp /usr/lib/locale/locale-archive 10.10.1.2:/tmp/
    452 The authenticity of host '10.10.1.2 (10.10.1.2)' can't be established.
    453 RSA key fingerprint is 6d:1d:76:53:a5:25:99:39:e2:89:ea:b0:99:e3:d3:b9.
    454 Are you sure you want to continue connecting (yes/no)? yes
    455 Warning: Permanently added '10.10.1.2' (RSA) to the list of known hosts.
    456 locale-archive                                100%   95MB  10.5MB/s   00:09   
    457 }}}
    458  * Look at the arps table on virt1 and virt2:
    459 {{{
    460 [chaos@virt1 ~]$ /sbin/arp -a
    461 pc5.utah.geniracks.net (155.98.34.15) at 00:01:ac:11:05:03 [ether] on eth999
    462 boss.utah.geniracks.net (155.98.34.4) at 00:01:ac:11:05:03 [ether] on eth999
    463 virt2-virt1-virt2-0 (10.10.1.2) at 02:00:83:cf:e6:09 [ether] on mv3.3
    464 
    465 [chaos@virt1 ~]$ ssh 10.10.1.2
    466 
    467 [chaos@virt2 ~]$ /sbin/arp -a
    468 pc5.utah.geniracks.net (155.98.34.15) at 00:01:ac:11:05:04 [ether] on eth999
    469 boss.utah.geniracks.net (155.98.34.4) at 00:01:ac:11:05:04 [ether] on eth999
    470 virt1-virt1-virt2-0 (10.10.1.1) at 02:00:70:b7:95:54 [ether] on mv4.4
    471 }}}
    472  * Sliverstatus still doesn't contain mac addresses at all:
    473 {{{
    474 jericho,[~],11:33(0)$ grep mac ecgtest2-sliverstatus-www-utah-geniracks-net-protogeni.json
    475 jericho,[~],11:33(1)$
    476 }}}
    477  * The original spec for this step said to delete the sliver, but let's leave it running to demonstrate the lack of MAC addresses in sliverstatus.
    478 
    479 === Results of testing step 1: 2012-07-26 ===
    480 
    481 ''Note: repeating this test for continuation of IG-MON-3 testing on 2012-07-26.''
    482 
    483  * I'll use the following rspec to get two VMs:
    484 {{{
    485 jericho,[~],10:51(0)$ cat omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    486 <?xml version="1.0" encoding="UTF-8"?>
    487 <!-- This rspec will reserve two openvz nodes, each with no OS specified,
    488      and create a single dataplane link between them.  It should work
    489      on any Emulab which has nodes available and supports OpenVZ.  -->
    490 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    491        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    492        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    493                            http://www.geni.net/resources/rspec/3/request.xsd"
    494        type="request">
    495 
    496   <node client_id="virt1" exclusive="false">
    497     <sliver_type name="emulab-openvz" />
    498     <interface client_id="virt1:if0" />
    499   </node>
    500   <node client_id="virt2" exclusive="false">
    501     <sliver_type name="emulab-openvz" />
    502     <interface client_id="virt2:if0" />
    503   </node>
    504 
    505   <link client_id="virt1-virt2-0">
    506     <interface_ref client_id="virt1:if0"/>
    507     <interface_ref client_id="virt2:if0"/>
    508     <property source_id="virt1:if0" dest_id="virt2:if0"/>
    509     <property source_id="virt2:if0" dest_id="virt1:if0"/>
    510   </link>
    511 </rspec>
    512 }}}
    513  * Then create a slice:
    514 {{{
    515 omni createslice ecgtest2
    516 }}}
    517  * Then create a sliver using that rspec:
    518 {{{
    519 jericho,[~],10:51(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest2 ~/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    520 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
    521 INFO:omni:Using control framework pg
    522 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-07-27 15:51:50 UTC
    523 INFO:omni:Creating sliver(s) from rspec file /home/chaos/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2
    524 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    525 INFO:omni:<?xml version="1.0" ?>
    526 INFO:omni:<!-- Reserved resources for:
    527         Slice: ecgtest2
    528         At AM:
    529         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    530  -->
    531 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    532 
    533     <node client_id="virt1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc3" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+7162">   
    534         <sliver_type name="emulab-openvz"/>   
    535         <interface client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" mac_address="023f9c5ff6fc" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+7165">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    536       <rs:vnode name="pcvm3-2" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt1.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc3.utah.geniracks.net" port="30778" username="chaos"/>    </services>  </node> 
    537     <node client_id="virt2" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc3" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+7163">   
    538         <sliver_type name="emulab-openvz"/>   
    539         <interface client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" mac_address="02b1730e88f9" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+7166">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    540       <rs:vnode name="pcvm3-3" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt2.ecgtest2.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc3.utah.geniracks.net" port="30779" username="chaos"/>    </services>  </node> 
    541 
    542     <link client_id="virt1-virt2-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+7164">   
    543         <interface_ref client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+7165"/>   
    544         <interface_ref client_id="virt2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:lo0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+7166"/>   
    545         <property dest_id="virt2:if0" source_id="virt1:if0"/>   
    546         <property dest_id="virt1:if0" source_id="virt2:if0"/>   
    547     </link> 
    548 </rspec>
    549 INFO:omni: ------------------------------------------------------------
    550 INFO:omni: Completed createsliver:
    551 
    552   Options as run:
    553                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    554                 configfile: /home/chaos/omni/omni_pgeni
    555                 framework: pg
    556                 native: True
    557 
    558   Args: createsliver ecgtest2 /home/chaos/omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-C.rspec
    559 
    560   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest2 expires on 2012-07-27 15:51:50 UTC
    561 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
    562 INFO:omni: ============================================================
    563 }}}
    564  * According to sliverstatus, my nodes are:
    565 {{{
    566 pc3.utah.geniracks.net port 30778
    567 pc3.utah.geniracks.net port 30779
    568 }}}
    569  * Login to pc3.utah.geniracks.net on port 30778 with agent forwarding
    570  * Find that it is virt1 and has mv2.2=10.10.1.1
    571  * Find a big file:
    572 {{{
    573 [chaos@virt1 ~]$ ls -l /usr/lib/locale/locale-archive-rpm
    574 -rw-r--r-- 1 root root 99154656 May 20  2011 /usr/lib/locale/locale-archive-rpm
    575 }}}
    576  * Copy the big file over the dataplane:
    577 {{{
    578 [chaos@virt1 ~]$ scp /usr/lib/locale/locale-archive 10.10.1.2:/tmp/
    579 The authenticity of host '10.10.1.2 (10.10.1.2)' can't be established.
    580 RSA key fingerprint is 6d:1d:76:53:a5:25:99:39:e2:89:ea:b0:99:e3:d3:b9.
    581 Are you sure you want to continue connecting (yes/no)? yes
    582 Warning: Permanently added '10.10.1.2' (RSA) to the list of known hosts.
    583 locale-archive                                100%   95MB  10.5MB/s   00:09   
    584 }}}
    585  * Look at the arps table on virt1 and virt2:
    586 {{{
    587 [chaos@virt1 ~]$ /sbin/arp -a
    588 virt2-virt1-virt2-0 (10.10.1.2) at 02:b1:73:0e:88:f9 [ether] on mv2.2
    589 pc3.utah.geniracks.net (155.98.34.13) at e8:39:35:b1:4e:88 [ether] on eth999
    590 boss.utah.geniracks.net (155.98.34.4) at 00:00:9b:62:24:df [ether] on eth999
    591 
    592 [chaos@virt1 ~]$ ssh 10.10.1.2
    593 
    594 [chaos@virt2 ~]$ /sbin/arp -a
    595 virt1-virt1-virt2-0 (10.10.1.1) at 02:3f:9c:5f:f6:fc [ether] on mv3.3
    596 pc3.utah.geniracks.net (155.98.34.13) at e8:39:35:b1:4e:88 [ether] on eth999
    597 boss.utah.geniracks.net (155.98.34.4) at 00:00:9b:62:24:df [ether] on eth999
    598 }}}
    599  * Sliverstatus still doesn't contain mac addresses at all:
    600 {{{
    601 jericho,[~],11:33(0)$ grep -i mac ecgtest2-sliverstatus-www-utah-geniracks-net-protogeni.json
    602 jericho,[~],11:33(1)$
    603 }}}
    604  * The original spec for this step said to delete the sliver, but let's leave it running to demonstrate the lack of MAC addresses in sliverstatus.
    605 
    606 == Step 2 (prep): start a bare metal node experiment and terminate it ==
    607 
    608  * An experimenter requests an experiment from the InstaGENI AM containing two rack hosts and a dataplane VLAN
    609  * The experimenter logs into a host, and sends dataplane traffic
    610  * The experimenter terminates the experiment
    611 
    612 === Results of testing step 2: 2012-05-18 ===
    613 
    614  * Here is an rspec for two physical nodes with no OS specified:
    615 {{{
    616 jericho,[~],05:39(0)$ cat IG-MON-nodes-D.rspec
    617 <?xml version="1.0" encoding="UTF-8"?>
    618 <!-- This rspec will reserve two physical node, each with no OS specified,
    619      and create a single dataplane link between them.  It should work
    620      on any Emulab which has nodes available and supports OpenVZ.  -->
    621 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    622        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    623        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    624                            http://www.geni.net/resources/rspec/3/request.xsd"
    625        type="request">
    626 
    627   <node client_id="phys1" exclusive="true">
    628     <sliver_type name="raw" />
    629     <interface client_id="phys1:if0" />
    630   </node>
    631   <node client_id="phys2" exclusive="true">
    632     <sliver_type name="raw" />
    633     <interface client_id="phys2:if0" />
    634   </node>
    635 
    636   <link client_id="phys1-phys2-0">
    637     <interface_ref client_id="phys1:if0"/>
    638     <interface_ref client_id="phys2:if0"/>
    639     <property source_id="phys1:if0" dest_id="phys2:if0"/>
    640     <property source_id="phys2:if0" dest_id="phys1:if0"/>
    641   </link>
    642 </rspec>
    643 }}}
    644  * Create a slice for this experiment:
    645 {{{
    646 omni createslice ecgtest3
    647 }}}
    648  * Create a sliver using this rspec:
    649 {{{
    650 jericho,[~],05:40(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest3 ~/IG-MON-nodes-D.rspec
    651 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
    652 INFO:omni:Using control framework pg
    653 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest3 expires on 2012-05-19 10:40:34 UTC
    654 INFO:omni:Creating sliver(s) from rspec file /home/chaos/IG-MON-nodes-D.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest3
    655 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    656 INFO:omni:<?xml version="1.0" ?>
    657 INFO:omni:<!-- Reserved resources for:
    658         Slice: ecgtest3
    659         At AM:
    660         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    661  -->
    662 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    663 
    664     <node client_id="phys1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc4" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+378">   
    665         <sliver_type name="raw-pc"/>   
    666         <interface client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc4:eth1" mac_address="e83935b1ec9e" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+381">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    667       <rs:vnode name="pc4" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="phys1.ecgtest3.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc4.utah.geniracks.net" port="22" username="chaos"/>    </services>  </node> 
    668     <node client_id="phys2" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc1" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+379">   
    669         <sliver_type name="raw-pc"/>   
    670         <interface client_id="phys2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc1:eth1" mac_address="e83935b10f96" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+382">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    671       <rs:vnode name="pc1" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="phys2.ecgtest3.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc1.utah.geniracks.net" port="22" username="chaos"/>    </services>  </node> 
    672 
    673     <link client_id="phys1-phys2-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+380" vlantag="261">   
    674         <interface_ref client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc4:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+381"/>   
    675         <interface_ref client_id="phys2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc1:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+382"/>   
    676         <property dest_id="phys2:if0" source_id="phys1:if0"/>   
    677         <property dest_id="phys1:if0" source_id="phys2:if0"/>   
    678     </link> 
    679 </rspec>
    680 INFO:omni: ------------------------------------------------------------
    681 INFO:omni: Completed createsliver:
    682 
    683   Options as run:
    684                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    685                 configfile: /home/chaos/omni/omni_pgeni
    686                 framework: pg
    687                 native: True
    688 
    689   Args: createsliver ecgtest3 /home/chaos/IG-MON-nodes-D.rspec
    690 
    691   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest3 expires on 2012-05-19 10:40:34 UTC
    692 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
    693 INFO:omni: ============================================================
    694 }}}
    695  * According to sliverstatus, my nodes are pc1 and pc4.
    696  * Login to pc1.utah.geniracks.net with agent forwarding
    697  * Find that it is phys2 and has eth1=10.10.1.2
    698  * Find a big file:
    699 {{{
    700 [chaos@phys2 ~]$ ls -l /usr/lib/locale/locale-archive
    701 -rw-r--r-- 1 root root 104997424 Aug 10  2011 /usr/lib/locale/locale-archive
    702 }}}
    703  * Copy the big file over the dataplane in a loop:
    704 {{{
    705 [chaos@phys2 ~]$ while [ 1 ]; do scp /usr/lib/locale/locale-archive 10.10.1.1:/tmp/; done
    706 locale-archive                                100%  100MB  50.1MB/s   00:02
    707 locale-archive                                100%  100MB  50.1MB/s   00:02
    708 locale-archive                                100%  100MB  50.1MB/s   00:02
    709 ...
    710 }}}
    711  * After a bit of that, delete the sliver:
    712 {{{
    713 jericho,[~],05:53(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am deletesliver ecgtest3
    714 }}}
    715 
    716 === Results of testing step 2: 2012-05-21 ===
    717 
    718  * Here is an rspec for two physical nodes with no OS specified:
    719 {{{
    720 jericho,[~],14:40(0)$ cat omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-D.rspec
    721 <?xml version="1.0" encoding="UTF-8"?>
    722 <!-- This rspec will reserve two physical node, each with no OS specified,
    723      and create a single dataplane link between them.  It should work
    724      on any Emulab which has nodes available and supports OpenVZ.  -->
    725 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    726        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    727        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    728                            http://www.geni.net/resources/rspec/3/request.xsd"
    729        type="request">
    730 
    731   <node client_id="phys1" exclusive="true">
    732     <sliver_type name="raw" />
    733     <interface client_id="phys1:if0" />
    734   </node>
    735   <node client_id="phys2" exclusive="true">
    736     <sliver_type name="raw" />
    737     <interface client_id="phys2:if0" />
    738   </node>
    739 
    740   <link client_id="phys1-phys2-0">
    741     <interface_ref client_id="phys1:if0"/>
    742     <interface_ref client_id="phys2:if0"/>
    743     <property source_id="phys1:if0" dest_id="phys2:if0"/>
    744     <property source_id="phys2:if0" dest_id="phys1:if0"/>
    745   </link>
    746 </rspec>
    747 }}}
    748  * Create a slice for this experiment:
    749 {{{
    750 omni createslice ecgtest3
    751 }}}
    752  * Create a sliver using this rspec:
    753 {{{
    754 jericho,[~],14:50(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest3 omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-D.rspec
    755 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
    756 INFO:omni:Using control framework pg
    757 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest3 expires on 2012-05-22 19:50:36 UTC
    758 INFO:omni:Creating sliver(s) from rspec file omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-D.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest3
    759 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    760 INFO:omni:<?xml version="1.0" ?>
    761 INFO:omni:<!-- Reserved resources for:
    762         Slice: ecgtest3
    763         At AM:
    764         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    765  -->
    766 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    767 
    768     <node client_id="phys1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc5" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+779">   
    769         <sliver_type name="raw-pc"/>   
    770         <interface client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:eth1" mac_address="e4115bed1cb6" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+782">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    771       <rs:vnode name="pc5" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="phys1.ecgtest3.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc5.utah.geniracks.net" port="22" username="chaos"/>    </services>  </node> 
    772     <node client_id="phys2" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc4" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+780">   
    773         <sliver_type name="raw-pc"/>   
    774         <interface client_id="phys2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc4:eth1" mac_address="e83935b1ec9e" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+783">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    775       <rs:vnode name="pc4" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="phys2.ecgtest3.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc4.utah.geniracks.net" port="22" username="chaos"/>    </services>  </node> 
    776 
    777     <link client_id="phys1-phys2-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+781" vlantag="259">   
    778         <interface_ref client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc5:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+782"/>   
    779         <interface_ref client_id="phys2:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc4:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+783"/>   
    780         <property dest_id="phys2:if0" source_id="phys1:if0"/>   
    781         <property dest_id="phys1:if0" source_id="phys2:if0"/>   
    782     </link> 
    783 </rspec>
    784 INFO:omni: ------------------------------------------------------------
    785 INFO:omni: Completed createsliver:
    786 
    787   Options as run:
    788                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    789                 configfile: /home/chaos/omni/omni_pgeni
    790                 framework: pg
    791                 native: True
    792 
    793   Args: createsliver ecgtest3 omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-D.rspec
    794 
    795   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest3 expires on 2012-05-22 19:50:36 UTC
    796 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
    797 INFO:omni: ============================================================
    798 }}}
    799  * According to sliverstatus, my nodes are pc4 and pc5.
    800  * Incidentally, sliverstatus here does include MAC addresses.
    801  * Login to pc4.utah.geniracks.net with agent forwarding
    802  * Find that it is phys2 and has eth1=10.10.1.2
    803  * Find a big file:
    804 {{{
    805 [chaos@phys2 ~]$ ls -l /usr/lib/locale/locale-archive
    806 -rw-r--r-- 1 root root 104997424 Aug 10  2011 /usr/lib/locale/locale-archive
    807 }}}
    808  * Copy the big file over the dataplane in a loop:
    809 {{{
    810 [chaos@phys2 ~]$ bash
    811 [chaos@phys2 ~]$ while [ 1 ]; do scp /usr/lib/locale/locale-archive 10.10.1.1:/tmp/; done
    812 The authenticity of host '10.10.1.1 (10.10.1.1)' can't be established.
    813 RSA key fingerprint is 46:63:92:67:c8:75:20:4e:52:9f:2d:f6:cb:58:16:77.
    814 Are you sure you want to continue connecting (yes/no)? yes
    815 Warning: Permanently added '10.10.1.1' (RSA) to the list of known hosts.
    816 locale-archive                                100%  100MB  33.4MB/s   00:03   
    817 locale-archive                                100%  100MB  50.1MB/s   00:02   
    818 locale-archive                                100%  100MB  50.1MB/s   00:02   
    819 locale-archive                                100%  100MB  50.1MB/s   00:02   
    820 ...
    821 }}}
    822  * After a bit of that, delete the sliver:
    823 {{{
    824 jericho,[~],14:56(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am deletesliver ecgtest3
    825 }}}
    826 
    827 == Step 3 (prep): start an experiment and leave it running ==
    828 
    829  * An experimenter requests an experiment from the InstaGENI AM containing two rack VMs connected by an OpenFlow-controlled dataplane VLAN
    830  * The experimenter configures a simple OpenFlow controller to pass dataplane traffic between the VMs
    831  * The experimenter logs into one VM, and begins sending a continuous stream of dataplane traffic
    832 
    833 === Results of testing step 3: 2012-05-18 ===
    834 
    835 ''Note: per discussion on instageni-design on 2012-05-17, request of an OpenFlow-controlled dataplane is not yet possible.  So this will need to be retested once OpenFlow control is available.''
    836 
    837  * Not creating a new experiment here, but instead reusing my experiment, ecgtest, created yesterday for `IG-MON-1`.
    838  * Login to pc3, whose eth1 is 10.10.1.1
    839  * Make a bigger dataplane file by catting the other a few times, then start copying it around again:
    840 {{{
    841 [chaos@phys1 ~]$ ls -l /tmp/locale-archive
    842 -rw-r--r-- 1 chaos pgeni-gpolab-bbn 3149922720 May 18 04:14 /tmp/locale-archive
    843 
    844 while [ 1 ]; do scp /tmp/locale-archive 10.10.1.2:/tmp/; done
    845 }}}
    846  * This lets me see that the first instance of the file copy takes about a minute, at about 55MBps:
    847 {{{
    848 [chaos@phys1 ~]$ while [ 1 ]; do scp /tmp/locale-archive 10.10.1.2:/tmp/; done
    849 locale-archive                                100% 3004MB  55.6MB/s   00:54   
    850 }}}
    851  * Leave this running.
    852 
    853 === Results of testing step 3: 2012-05-21 ===
    854 
    855 ''Note: per discussion on instageni-design on 2012-05-17, request of an OpenFlow-controlled dataplane is not yet possible.  So this will need to be retested once OpenFlow control is available.''
    856 
    857  * Recreating the experiment, ecgtest, which was initially used for IG-MON-1.
    858  * Here is the rspec:
    859 {{{
    860 jericho,[~],15:05(0)$ cat omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec
    861 <?xml version="1.0" encoding="UTF-8"?>
    862 <!-- This rspec will reserve one physical node and one openvz node, each
    863      with no OS specified, and create a single dataplane link between
    864      them.  It should work on any Emulab which has nodes available and
    865      supports OpenVZ.  -->
    866 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    867        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    868        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    869                            http://www.geni.net/resources/rspec/3/request.xsd"
    870        type="request">
    871 
    872   <node client_id="phys1" exclusive="true">
    873     <sliver_type name="raw" />
    874     <interface client_id="phys1:if0" />
    875   </node>
    876   <node client_id="virt1" exclusive="false">
    877     <sliver_type name="emulab-openvz" />
    878     <interface client_id="virt1:if0" />
    879   </node>
    880 
    881   <link client_id="phys1-virt1-0">
    882     <interface_ref client_id="phys1:if0"/>
    883     <interface_ref client_id="virt1:if0"/>
    884     <property source_id="phys1:if0" dest_id="virt1:if0"/>
    885     <property source_id="virt1:if0" dest_id="phys1:if0"/>
    886   </link>
    887 </rspec>
    888 }}}
    889  * Create the sliver:
    890 {{{
    891 jericho,[~],15:18(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec
    892 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
    893 INFO:omni:Using control framework pg
    894 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest expires within 1 day on 2012-05-22 16:02:36 UTC
    895 INFO:omni:Creating sliver(s) from rspec file omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest
    896 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    897 INFO:omni:<?xml version="1.0" ?>
    898 INFO:omni:<!-- Reserved resources for:
    899         Slice: ecgtest
    900         At AM:
    901         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    902  -->
    903 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    904 
    905     <node client_id="phys1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc4" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+785">   
    906         <sliver_type name="raw-pc"/>   
    907         <interface client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc4:eth1" mac_address="e83935b1ec9e" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+788">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    908       <rs:vnode name="pc4" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="phys1.ecgtest.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc4.utah.geniracks.net" port="22" username="chaos"/>    </services>  </node> 
    909     <node client_id="virt1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc3" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+786">   
    910         <sliver_type name="emulab-openvz"/>   
    911         <interface client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:eth1" mac_address="00000a0a0102" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+789">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    912       <rs:vnode name="pcvm3-1" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt1.ecgtest.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc3.utah.geniracks.net" port="30010" username="chaos"/>    </services>  </node> 
    913 
    914     <link client_id="phys1-virt1-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+787" vlantag="259">   
    915         <interface_ref client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc4:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+788"/>   
    916         <interface_ref client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+789"/>   
    917         <property dest_id="virt1:if0" source_id="phys1:if0"/>   
    918         <property dest_id="phys1:if0" source_id="virt1:if0"/>   
    919     </link> 
    920 </rspec>
    921 INFO:omni: ------------------------------------------------------------
    922 INFO:omni: Completed createsliver:
    923 
    924   Options as run:
    925                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    926                 configfile: /home/chaos/omni/omni_pgeni
    927                 framework: pg
    928                 native: True
    929 
    930   Args: createsliver ecgtest omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec
    931 
    932   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest expires within 1 day(s) on 2012-05-22 16:02:36 UTC
    933 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
    934 INFO:omni: ============================================================
    935 }}}
    936  * My physical node is pc4
    937  * My virtual node is pc3 port 30010
    938  * Huh, and now sliverstatus ''does'' contain the MACs for both hosts, though the virtual one is still wrong.  Updated [instaticket:26], which Jon is looking at.  That is not a blocker for this test.
    939  * Login to pc4, whose eth1 is 10.10.1.1
    940  * Make a bigger dataplane file by catting the other a few times, then start copying it around again:
    941 {{{
    942 bash
    943 touch /tmp/locale-archive
    944 for i in {1..40}; do cat /usr/lib/locale/locale-archive >> /tmp/locale-archive; done
    945 
    946 [chaos@phys1 ~]$ ls -l /tmp/locale-archive
    947 -rw-r--r-- 1 chaos pgeni-gpolab-bbn 4199896960 May 21 13:32 /tmp/locale-archive
    948 
    949 [chaos@phys1 ~]$ while [ 1 ]; do scp /tmp/locale-archive 10.10.1.2:/tmp/; done
    950 locale-archive                                100% 4005MB  51.4MB/s   01:18   
    951 ...
    952 }}}
    953  * The first instance of the file copy takes somewhat over a minute, at about 51MBps
    954  * Leave this running.
    955 
    956 === Results of testing step 3: 2012-05-26 ===
    957 
    958 ''Note: per discussion on instageni-design on 2012-05-17, request of an OpenFlow-controlled dataplane is not yet possible.  So this will need to be retested once OpenFlow control is available.''
    959 
    960  * Recreating the experiment, ecgtest, which was initially used for IG-MON-1.
    961  * Here is the rspec again:
    962 {{{
    963 jericho,[~],07:29(0)$ cat omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec
    964 <?xml version="1.0" encoding="UTF-8"?>
    965 <!-- This rspec will reserve one physical node and one openvz node, each
    966      with no OS specified, and create a single dataplane link between
    967      them.  It should work on any Emulab which has nodes available and
    968      supports OpenVZ.  -->
    969 <rspec xmlns="http://www.geni.net/resources/rspec/3"
    970        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    971        xsi:schemaLocation="http://www.geni.net/resources/rspec/3
    972                            http://www.geni.net/resources/rspec/3/request.xsd"
    973        type="request">
    974 
    975   <node client_id="phys1" exclusive="true">
    976     <sliver_type name="raw" />
    977     <interface client_id="phys1:if0" />
    978   </node>
    979   <node client_id="virt1" exclusive="false">
    980     <sliver_type name="emulab-openvz" />
    981     <interface client_id="virt1:if0" />
    982   </node>
    983 
    984   <link client_id="phys1-virt1-0">
    985     <interface_ref client_id="phys1:if0"/>
    986     <interface_ref client_id="virt1:if0"/>
    987     <property source_id="phys1:if0" dest_id="virt1:if0"/>
    988     <property source_id="virt1:if0" dest_id="phys1:if0"/>
    989   </link>
    990 </rspec>
    991 }}}
    992  * Create the sliver:
    993 {{{
    994 jericho,[~],07:29(0)$ omni -a http://www.utah.geniracks.net/protogeni/xmlrpc/am createsliver ecgtest omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec
    995 INFO:omni:Loading config file /home/chaos/omni/omni_pgeni
    996 INFO:omni:Using control framework pg
    997 INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest expires on 2012-06-30 00:00:00 UTC
    998 INFO:omni:Creating sliver(s) from rspec file omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec for slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest
    999 INFO:omni:Asked http://www.utah.geniracks.net/protogeni/xmlrpc/am to reserve resources. Result:
    1000 INFO:omni:<?xml version="1.0" ?>
    1001 INFO:omni:<!-- Reserved resources for:
    1002         Slice: ecgtest
    1003         At AM:
    1004         URL: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    1005  -->
    1006 INFO:omni:<rspec type="manifest" xmlns="http://www.geni.net/resources/rspec/3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.geni.net/resources/rspec/3                            http://www.geni.net/resources/rspec/3/manifest.xsd"> 
    1007 
    1008     <node client_id="phys1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc2" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="true" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+2993">   
    1009         <sliver_type name="raw-pc"/>   
    1010         <interface client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc2:eth1" mac_address="e83935b10c7e" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+2996">      <ip address="10.10.1.1" type="ipv4"/>    </interface>   
    1011       <rs:vnode name="pc2" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="phys1.ecgtest.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc2.utah.geniracks.net" port="22" username="chaos"/>    </services>  </node> 
    1012     <node client_id="virt1" component_id="urn:publicid:IDN+utah.geniracks.net+node+pc3" component_manager_id="urn:publicid:IDN+utah.geniracks.net+authority+cm" exclusive="false" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+2994">   
    1013         <sliver_type name="emulab-openvz"/>   
    1014         <interface client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:eth1" mac_address="00000a0a0102" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+2997">      <ip address="10.10.1.2" type="ipv4"/>    </interface>   
    1015       <rs:vnode name="pcvm3-1" xmlns:rs="http://www.protogeni.net/resources/rspec/ext/emulab/1"/>    <host name="virt1.ecgtest.pgeni-gpolab-bbn-com.utah.geniracks.net"/>    <services>      <login authentication="ssh-keys" hostname="pc3.utah.geniracks.net" port="30010" username="chaos"/>    </services>  </node> 
    1016 
    1017     <link client_id="phys1-virt1-0" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+2995" vlantag="260">   
    1018         <interface_ref client_id="phys1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc2:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+2996"/>   
    1019         <interface_ref client_id="virt1:if0" component_id="urn:publicid:IDN+utah.geniracks.net+interface+pc3:eth1" sliver_id="urn:publicid:IDN+utah.geniracks.net+sliver+2997"/>   
    1020         <property dest_id="virt1:if0" source_id="phys1:if0"/>   
    1021         <property dest_id="phys1:if0" source_id="virt1:if0"/>   
    1022     </link> 
    1023 </rspec>
    1024 INFO:omni: ------------------------------------------------------------
    1025 INFO:omni: Completed createsliver:
    1026 
    1027   Options as run:
    1028                 aggregate: http://www.utah.geniracks.net/protogeni/xmlrpc/am
    1029                 configfile: /home/chaos/omni/omni_pgeni
    1030                 framework: pg
    1031                 native: True
    1032 
    1033   Args: createsliver ecgtest omni/rspecs/request/rack-testing/acceptance-tests/IG-MON-nodes-B.rspec
    1034 
    1035   Result Summary: Slice urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+ecgtest expires on 2012-06-30 00:00:00 UTC
    1036 Reserved resources on http://www.utah.geniracks.net/protogeni/xmlrpc/am. 
    1037 INFO:omni: ============================================================
    1038 }}}
    1039  * My physical node is pc2
    1040  * My virtual node is pc3 port 30010
    1041  * Login to pc2 using ssh -A, whose eth1 is 10.10.1.1
    1042  * Make a bigger dataplane file by catting the other a few times, then start copying it around again:
    1043 {{{
    1044 bash
    1045 touch /tmp/locale-archive
    1046 for i in {1..40}; do cat /usr/lib/locale/locale-archive >> /tmp/locale-archive; done
    1047 
    1048 [chaos@phys1 ~]$ ls -l /tmp/locale-archive
    1049 -rw-r--r-- 1 chaos pgeni-gpolab-bbn 4199896960 May 26 05:38 /tmp/locale-archive
    1050 
    1051 [chaos@phys1 ~]$ while [ 1 ]; do scp /tmp/locale-archive 10.10.1.2:/tmp/; done
    1052 ...
    1053 }}}
    1054  * Leave this running.
     329
     330Determine login information for the sliver resources:
     331{{{
     332$ readyToLogin.py -a ig-gpo IG-MON-3                   
     333<...>
     334PC-1's geni_status is: ready (am_status:ready)
     335User lnevers logins to PC-1 using:
     336        xterm -e ssh -i /home/lnevers/.ssh/id_rsa lnevers@pc5.instageni.gpolab.bbn.com &
     337
     338PC-2's geni_status is: ready (am_status:ready)
     339User lnevers logins to PC-2 using:
     340        xterm -e ssh -i /home/lnevers/.ssh/id_rsa lnevers@pc4.instageni.gpolab.bbn.com &
     341}}}
     342
     343Login to PC-1, verify hostname, address assignment and initial ARP table entries:
     344{{{
     345$ ssh -i /home/lnevers/.ssh/id_rsa lnevers@pc5.instageni.gpolab.bbn.com
     346[lnevers@pc-1 ~]$ /sbin/ifconfig eth1
     347eth1      Link encap:Ethernet  HWaddr 10:60:4B:9C:47:6A 
     348          inet addr:192.168.1.1  Bcast:192.168.1.255  Mask:255.255.255.0
     349          inet6 addr: fe80::1260:4bff:fe9c:476a/64 Scope:Link
     350          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     351          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
     352          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
     353          collisions:0 txqueuelen:1000
     354          RX bytes:0 (0.0 b)  TX bytes:492 (492.0 b)
     355          Interrupt:37 Memory:f2000000-f2012800
     356
     357[lnevers@pc-1 ~]$ /sbin/arp -a
     358ops.instageni.gpolab.bbn.com (192.1.242.133) at 02:07:2d:51:f4:6a [ether] on eth0
     359boss.instageni.gpolab.bbn.com (192.1.242.132) at 02:9e:26:f1:52:99 [ether] on eth0
     360? (192.1.242.129) at cc:ef:48:7a:7a:a9 [ether] on eth0
     361}}}
     362
     363
     364Login to PC-2, verify hostname, address assignment and initial ARP table entries:
     365{{{
     366$ ssh -i /home/lnevers/.ssh/id_rsa lnevers@pc4.instageni.gpolab.bbn.com
     367[lnevers@pc-2 ~]$ /sbin/ifconfig eth1
     368eth1      Link encap:Ethernet  HWaddr 10:60:4B:96:00:D6 
     369          inet addr:192.168.1.2  Bcast:192.168.1.255  Mask:255.255.255.0
     370          inet6 addr: fe80::1260:4bff:fe96:d6/64 Scope:Link
     371          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     372          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
     373          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
     374          collisions:0 txqueuelen:1000
     375          RX bytes:0 (0.0 b)  TX bytes:492 (492.0 b)
     376          Interrupt:37 Memory:f2000000-f2012800
     377
     378[lnevers@pc-2 ~]$ /sbin/arp -a
     379ops.instageni.gpolab.bbn.com (192.1.242.133) at 02:07:2d:51:f4:6a [ether] on eth0
     380boss.instageni.gpolab.bbn.com (192.1.242.132) at 02:9e:26:f1:52:99 [ether] on eth0
     381? (192.1.242.129) at cc:ef:48:7a:7a:a9 [ether] on eth0
     382}}}
     383
     384Install iperf on both PCs and exchange TCP traffic from PC-1 client to PC-2 server over the data plane interface and look at ARP table entries:
     385{{{
     386[lnevers@pc-1 ~]$ /usr/bin/iperf -c 192.168.1.2 -i 1
     387------------------------------------------------------------
     388Client connecting to 192.168.1.2, TCP port 5001
     389TCP window size: 16.0 KByte (default)
     390------------------------------------------------------------
     391[  3] local 192.168.1.1 port 58436 connected with 192.168.1.2 port 5001
     392[ ID] Interval       Transfer     Bandwidth
     393[  3]  0.0- 1.0 sec   113 MBytes   947 Mbits/sec
     394[  3]  1.0- 2.0 sec   112 MBytes   940 Mbits/sec
     395[  3]  2.0- 3.0 sec   112 MBytes   943 Mbits/sec
     396[  3]  3.0- 4.0 sec   112 MBytes   942 Mbits/sec
     397[  3]  4.0- 5.0 sec   112 MBytes   940 Mbits/sec
     398}}}
     399
     400Leave sliver running.
    1055401
    1056402== Step 4: view running VMs ==
     403
     404
     405
     406
    1057407
    1058408'''Using:'''