Changes between Initial Version and Version 1 of GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusMay2013/OG-EXP-3


Ignore:
Timestamp:
05/23/14 11:35:35 (10 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/OpenGENIRacks/AcceptanceTestStatusMay2013/OG-EXP-3

    v1 v1  
     1= GR-EXP-3: GRAM Single Site 100 VM Test =
     2
     3This page captures status for the test case GR-EXP-3. For additional information see the [wiki:GENIRacksHome/GRAMRacks/AcceptanceTestStatusMay2013 Acceptance Test Status - May 2013] page overall status, or the [wiki:GENIRacksHome/AcceptanceTests/GRAMAcceptanceTestsPlan GRAM Acceptance Test Plan] for details about the planned evaluation.
     4
     5
     6
     7''Last Update: 2013/05/20"
     8
     9
     10||   ''' Test Scenario'''               ||'''State'''  || '''Tickets'''|| '''Notes''' ||
     11||Scenario 1: 1 Slice with 100 VMs      ||             ||              ||             ||
     12||Scenario 2: 2 Slices with 50 VMs each ||             ||              ||             ||
     13||Scenario 3: 4 Slices with 25 VMs each ||             ||              ||             ||
     14||Scenario 6: 20 Slices with 5 VMs each ||[[span(Fail, style=background-color: red)]] ||  #63 #62    ||
     15||Scenario 4: 50 Slices with 2 VMs each ||[[span(Fail, style=background-color: red)]] ||  #64        ||             ||
     16||Scenario 5: 100 Slices with 1 VM each ||             ||              ||             ||
     17 
     18             
     19[[BR]]
     20|| '''State Legend'''                                   || '''Description'''                                                    ||
     21||[[span(Pass, style=background-color: green )]]        || Test completed and met all criteria                                  ||
     22||[[span(Pass: most criteria, style=background-color: #98FB98)]]|| Test completed and met most criteria. Exceptions documented  ||
     23||[[span(Fail, style=background-color: red)]]           || Test completed and failed to meet criteria.                          ||
     24||[[span(Complete, style=background-color: yellow)]]    || Test completed but will require re-execution due to expected changes ||
     25||[[span(Blocked, style=background-color: orange)]]     || Blocked by ticketed issue(s).                                        ||
     26||[[span(In Progress, style=background-color: #63B8FF)]]|| Currently under test.                                                ||
     27
     28= Test Plan Steps =
     29This test case  uses the following aggregate nick_names:
     30{{{
     31gram=,https://128.89.91.170:5001
     32}}}
     33
     34''Evaluation Notes:'' The test "Scenario 4: 50 Slices with 2 VMs each" failed, ticket #64
     35
     36
     37
     38== Scenario 4: 50 Slices with 2 VMs each ==
     39
     40Started evaluation with 2 VM slivers and initially started with 10 slices.  The following was executed:
     41{{{
     42COUNT=10
     43
     44j=1
     45while [ $j -le $COUNT ];
     46do
     47echo Experiment$j
     48date
     49omni.py createslice lnslice$j
     50            if [ $? -ne 0 ] ; then
     51                echo "Unable to start the slice"
     52                exit
     53            fi
     54sleep 4
     55omni.py -a gram2 -V2 createsliver lnslice$j 2vm-1lan.rspec  -o
     56            if [ $? -ne 0 ] ; then
     57                echo "Unable to start the sliver"
     58                exit
     59            fi
     60
     61sleep 30;
     62j=`expr $j + 1`
     63done
     64
     65}}}
     66
     67The login information for the first  20 VMs:
     68{{{
     69lnslice1-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3001" username="lnevers"/>
     70lnslice1-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3002" username="lnevers"/>
     71lnslice2-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3005" username="lnevers"/>
     72lnslice2-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3006" username="lnevers"/>
     73lnslice3-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3007" username="lnevers"/>
     74lnslice3-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3008" username="lnevers"/>
     75lnslice4-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3009" username="lnevers"/>
     76lnslice4-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3010" username="lnevers"/>
     77lnslice5-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3011" username="lnevers"/>
     78lnslice5-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3012" username="lnevers"/>
     79lnslice6-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3013" username="lnevers"/>
     80lnslice6-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3014" username="lnevers"/>
     81lnslice7-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3015" username="lnevers"/>
     82lnslice7-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3016" username="lnevers"/>
     83lnslice8-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3017" username="lnevers"/>
     84lnslice8-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3018" username="lnevers"/>
     85lnslice9-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3019" username="lnevers"/>
     86lnslice9-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3020" username="lnevers"/>
     87lnslice10-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3021" username="lnevers"/>
     88lnslice10-manifest-rspec-128-89-91-170-5002.xml:            <login authentication="ssh-keys" hostname="boscontroller" port="3022" username="lnevers"/>
     89}}}
     90
     91Verified ability to login to each of the 20 VMs allocated, by executing "uptime" and ifconfig eth1 via ssh, but found that some hosts did not have addresses:
     92{{{
     93+ ssh -p 3001 128.89.91.170 uptime; ifconfig eth1
     94 18:30:15 up  1:16,  0 users,  load average: 0.00, 0.01, 0.04
     95eth1      Link encap:Ethernet  HWaddr fa:16:3e:c4:4d:94 
     96          inet addr:10.0.39.101  Bcast:10.0.39.255  Mask:255.255.255.0
     97          inet6 addr: fe80::f816:3eff:fec4:4d94/64 Scope:Link
     98          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     99          RX packets:414 errors:0 dropped:0 overruns:0 frame:0
     100          TX packets:442 errors:0 dropped:0 overruns:0 carrier:0
     101          collisions:0 txqueuelen:1000
     102          RX bytes:75280 (75.2 KB)  TX bytes:114096 (114.0 KB)
     103
     104+ ssh -p 3002 128.89.91.170 uptime; ifconfig eth1
     105 18:30:16 up  1:16,  0 users,  load average: 0.00, 0.01, 0.03
     106eth1      Link encap:Ethernet  HWaddr fa:16:3e:e2:13:86 
     107          inet addr:10.0.39.100  Bcast:10.0.39.255  Mask:255.255.255.0
     108          inet6 addr: fe80::f816:3eff:fee2:1386/64 Scope:Link
     109          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     110          RX packets:473 errors:0 dropped:0 overruns:0 frame:0
     111          TX packets:518 errors:0 dropped:0 overruns:0 carrier:0
     112          collisions:0 txqueuelen:1000
     113          RX bytes:76868 (76.8 KB)  TX bytes:113838 (113.8 KB)
     114
     115+ ssh -p 3005 128.89.91.170 uptime; ifconfig eth1
     116 18:30:15 up  1:15,  0 users,  load average: 0.00, 0.01, 0.04
     117eth1      Link encap:Ethernet  HWaddr fa:16:3e:d6:03:d2 
     118          inet addr:10.0.40.101  Bcast:10.0.40.255  Mask:255.255.255.0
     119          inet6 addr: fe80::f816:3eff:fed6:3d2/64 Scope:Link
     120          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     121          RX packets:454 errors:0 dropped:0 overruns:0 frame:0
     122          TX packets:482 errors:0 dropped:0 overruns:0 carrier:0
     123          collisions:0 txqueuelen:1000
     124          RX bytes:76484 (76.4 KB)  TX bytes:110016 (110.0 KB)
     125
     126+ ssh -p 3006 128.89.91.170 uptime; ifconfig eth1
     127 18:30:17 up  1:15,  0 users,  load average: 0.00, 0.01, 0.05
     128eth1      Link encap:Ethernet  HWaddr fa:16:3e:4e:f2:af 
     129          inet addr:10.0.40.100  Bcast:10.0.40.255  Mask:255.255.255.0
     130          inet6 addr: fe80::f816:3eff:fe4e:f2af/64 Scope:Link
     131          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     132          RX packets:371 errors:0 dropped:0 overruns:0 frame:0
     133          TX packets:414 errors:0 dropped:0 overruns:0 carrier:0
     134          collisions:0 txqueuelen:1000
     135          RX bytes:67024 (67.0 KB)  TX bytes:105420 (105.4 KB)
     136
     137+ ssh -p 3007 128.89.91.170 uptime; ifconfig eth1
     138 18:30:19 up  1:14,  0 users,  load average: 0.08, 0.03, 0.05
     139eth1      Link encap:Ethernet  HWaddr fa:16:3e:fb:94:5f 
     140          inet addr:10.0.41.100  Bcast:10.0.41.255  Mask:255.255.255.0
     141          inet6 addr: fe80::f816:3eff:fefb:945f/64 Scope:Link
     142          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     143          RX packets:410 errors:0 dropped:0 overruns:0 frame:0
     144          TX packets:416 errors:0 dropped:0 overruns:0 carrier:0
     145          collisions:0 txqueuelen:1000
     146          RX bytes:75343 (75.3 KB)  TX bytes:105804 (105.8 KB)
     147
     148+ ssh -p 3008 128.89.91.170 uptime; ifconfig eth1
     149 18:30:22 up  1:14,  0 users,  load average: 0.00, 0.01, 0.05
     150eth1      Link encap:Ethernet  HWaddr fa:16:3e:19:66:83 
     151          inet addr:10.0.41.101  Bcast:10.0.41.255  Mask:255.255.255.0
     152          inet6 addr: fe80::f816:3eff:fe19:6683/64 Scope:Link
     153          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     154          RX packets:359 errors:0 dropped:0 overruns:0 frame:0
     155          TX packets:397 errors:0 dropped:0 overruns:0 carrier:0
     156          collisions:0 txqueuelen:1000
     157          RX bytes:66844 (66.8 KB)  TX bytes:102606 (102.6 KB)
     158
     159+ ssh -p 3009 128.89.91.170 uptime; ifconfig eth1
     160 18:30:22 up  1:12,  0 users,  load average: 0.00, 0.01, 0.04
     161eth1      Link encap:Ethernet  HWaddr fa:16:3e:da:f9:89 
     162          inet addr:10.0.42.100  Bcast:10.0.42.255  Mask:255.255.255.0
     163          inet6 addr: fe80::f816:3eff:feda:f989/64 Scope:Link
     164          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     165          RX packets:384 errors:0 dropped:0 overruns:0 frame:0
     166          TX packets:408 errors:0 dropped:0 overruns:0 carrier:0
     167          collisions:0 txqueuelen:1000
     168          RX bytes:68542 (68.5 KB)  TX bytes:103702 (103.7 KB)
     169
     170+ ssh -p 3010 128.89.91.170 uptime; ifconfig eth1
     171 18:30:25 up  1:12,  0 users,  load average: 0.00, 0.01, 0.05
     172eth1      Link encap:Ethernet  HWaddr fa:16:3e:b3:79:32 
     173          inet addr:10.0.42.101  Bcast:10.0.42.255  Mask:255.255.255.0
     174          inet6 addr: fe80::f816:3eff:feb3:7932/64 Scope:Link
     175          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     176          RX packets:401 errors:0 dropped:0 overruns:0 frame:0
     177          TX packets:454 errors:0 dropped:0 overruns:0 carrier:0
     178          collisions:0 txqueuelen:1000
     179          RX bytes:69103 (69.1 KB)  TX bytes:108590 (108.5 KB)
     180
     181+ ssh -p 3011 128.89.91.170 uptime; ifconfig eth1
     182 18:30:26 up  1:11,  0 users,  load average: 0.00, 0.01, 0.05
     183eth1      Link encap:Ethernet  HWaddr fa:16:3e:4c:59:84 
     184          inet6 addr: fe80::f816:3eff:fe4c:5984/64 Scope:Link
     185          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     186          RX packets:476 errors:0 dropped:0 overruns:0 frame:0
     187          TX packets:200 errors:0 dropped:0 overruns:0 carrier:0
     188          collisions:0 txqueuelen:1000
     189          RX bytes:141868 (141.8 KB)  TX bytes:67632 (67.6 KB)
     190
     191+ ssh -p 3012 128.89.91.170 uptime; ifconfig eth1
     192 18:30:27 up  1:11,  0 users,  load average: 0.00, 0.01, 0.04
     193eth1      Link encap:Ethernet  HWaddr fa:16:3e:b2:ee:25 
     194          inet6 addr: fe80::f816:3eff:feb2:ee25/64 Scope:Link
     195          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     196          RX packets:452 errors:0 dropped:0 overruns:0 frame:0
     197          TX packets:175 errors:0 dropped:0 overruns:0 carrier:0
     198          collisions:0 txqueuelen:1000
     199          RX bytes:137797 (137.7 KB)  TX bytes:59082 (59.0 KB)
     200
     201+ ssh -p 3013 128.89.91.170 uptime; ifconfig eth1
     202Warning: Permanently added '[128.89.91.170]:3013' (RSA) to the list of known hosts.
     203 18:30:43 up  1:10,  0 users,  load average: 0.22, 0.06, 0.06
     204eth1      Link encap:Ethernet  HWaddr fa:16:3e:e2:7a:f5 
     205          inet6 addr: fe80::f816:3eff:fee2:7af5/64 Scope:Link
     206          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     207          RX packets:233 errors:0 dropped:0 overruns:0 frame:0
     208          TX packets:170 errors:0 dropped:0 overruns:0 carrier:0
     209          collisions:0 txqueuelen:1000
     210          RX bytes:67110 (67.1 KB)  TX bytes:57372 (57.3 KB)
     211
     212+ ssh -p 3014 128.89.91.170 uptime; ifconfig eth1
     213 18:30:42 up  1:10,  0 users,  load average: 0.00, 0.01, 0.03
     214eth1      Link encap:Ethernet  HWaddr fa:16:3e:82:7c:c7 
     215          inet6 addr: fe80::f816:3eff:fe82:7cc7/64 Scope:Link
     216          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     217          RX packets:234 errors:0 dropped:0 overruns:0 frame:0
     218          TX packets:173 errors:0 dropped:0 overruns:0 carrier:0
     219          collisions:0 txqueuelen:1000
     220          RX bytes:67722 (67.7 KB)  TX bytes:58398 (58.3 KB)
     221
     222+ ssh -p 3015 128.89.91.170 uptime; ifconfig eth1
     223 18:30:43 up  1:09,  0 users,  load average: 0.00, 0.01, 0.04
     224eth1      Link encap:Ethernet  HWaddr fa:16:3e:92:b2:2f 
     225          inet6 addr: fe80::f816:3eff:fe92:b22f/64 Scope:Link
     226          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     227          RX packets:437 errors:0 dropped:0 overruns:0 frame:0
     228          TX packets:173 errors:0 dropped:0 overruns:0 carrier:0
     229          collisions:0 txqueuelen:1000
     230          RX bytes:129324 (129.3 KB)  TX bytes:58398 (58.3 KB)
     231
     232+ ssh -p 3016 128.89.91.170 uptime; ifconfig eth1
     233 18:30:43 up  1:08,  0 users,  load average: 0.00, 0.01, 0.04
     234eth1      Link encap:Ethernet  HWaddr fa:16:3e:39:d4:61 
     235          inet6 addr: fe80::f816:3eff:fe39:d461/64 Scope:Link
     236          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     237          RX packets:420 errors:0 dropped:0 overruns:0 frame:0
     238          TX packets:170 errors:0 dropped:0 overruns:0 carrier:0
     239          collisions:0 txqueuelen:1000
     240          RX bytes:126758 (126.7 KB)  TX bytes:57372 (57.3 KB)
     241
     242+ ssh -p 3017 128.89.91.170 uptime; ifconfig eth1
     243 18:30:44 up  1:07,  0 users,  load average: 0.08, 0.03, 0.03
     244eth1      Link encap:Ethernet  HWaddr fa:16:3e:f6:1d:c3 
     245          inet6 addr: fe80::f816:3eff:fef6:1dc3/64 Scope:Link
     246          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     247          RX packets:248 errors:0 dropped:0 overruns:0 frame:0
     248          TX packets:188 errors:0 dropped:0 overruns:0 carrier:0
     249          collisions:0 txqueuelen:1000
     250          RX bytes:72762 (72.7 KB)  TX bytes:63528 (63.5 KB)
     251
     252+ ssh -p 3018 128.89.91.170 uptime; ifconfig eth1
     253 18:30:46 up  1:07,  0 users,  load average: 0.08, 0.03, 0.05
     254eth1      Link encap:Ethernet  HWaddr fa:16:3e:3e:f6:da 
     255          inet6 addr: fe80::f816:3eff:fe3e:f6da/64 Scope:Link
     256          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     257          RX packets:230 errors:0 dropped:0 overruns:0 frame:0
     258          TX packets:167 errors:0 dropped:0 overruns:0 carrier:0
     259          collisions:0 txqueuelen:1000
     260          RX bytes:66179 (66.1 KB)  TX bytes:56346 (56.3 KB)
     261
     262+ ssh -p 3019 128.89.91.170 uptime; ifconfig eth1
     263 18:30:48 up  1:06,  0 users,  load average: 0.08, 0.03, 0.05
     264eth1      Link encap:Ethernet  HWaddr fa:16:3e:9a:c8:87 
     265          inet6 addr: fe80::f816:3eff:fe9a:c887/64 Scope:Link
     266          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     267          RX packets:419 errors:0 dropped:0 overruns:0 frame:0
     268          TX packets:159 errors:0 dropped:0 overruns:0 carrier:0
     269          collisions:0 txqueuelen:1000
     270          RX bytes:126095 (126.0 KB)  TX bytes:53610 (53.6 KB)
     271
     272+ ssh -p 3020 128.89.91.170 uptime; ifconfig eth1
     273 18:30:52 up  1:06,  0 users,  load average: 0.00, 0.01, 0.05
     274eth1      Link encap:Ethernet  HWaddr fa:16:3e:7a:ee:0e 
     275          inet6 addr: fe80::f816:3eff:fe7a:ee0e/64 Scope:Link
     276          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     277          RX packets:405 errors:0 dropped:0 overruns:0 frame:0
     278          TX packets:177 errors:0 dropped:0 overruns:0 carrier:0
     279          collisions:0 txqueuelen:1000
     280          RX bytes:124279 (124.2 KB)  TX bytes:59766 (59.7 KB)
     281
     282+ ssh -p 3021 128.89.91.170 uptime; ifconfig eth1
     283 18:30:52 up  1:05,  0 users,  load average: 0.00, 0.01, 0.04
     284eth1      Link encap:Ethernet  HWaddr fa:16:3e:68:c5:71 
     285          inet6 addr: fe80::f816:3eff:fe68:c571/64 Scope:Link
     286          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     287          RX packets:209 errors:0 dropped:0 overruns:0 frame:0
     288          TX packets:148 errors:0 dropped:0 overruns:0 carrier:0
     289          collisions:0 txqueuelen:1000
     290          RX bytes:59276 (59.2 KB)  TX bytes:49848 (49.8 KB)
     291
     292+ ssh -p 3022 128.89.91.170 uptime; ifconfig eth1
     293 18:30:55 up  1:05,  0 users,  load average: 0.00, 0.01, 0.04
     294eth1      Link encap:Ethernet  HWaddr fa:16:3e:5d:05:51 
     295          inet6 addr: fe80::f816:3eff:fe5d:551/64 Scope:Link
     296          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     297          RX packets:244 errors:0 dropped:0 overruns:0 frame:0
     298          TX packets:178 errors:0 dropped:0 overruns:0 carrier:0
     299          collisions:0 txqueuelen:1000
     300          RX bytes:71089 (71.0 KB)  TX bytes:60108 (60.1 KB)
     301}}}
     302
     303
     304Started 10 more sliver (20 VMs), which were allocated properly and logged into each host.
     305
     306'''Note:''' This test case failed, following is a summary of the events witnessed and captured in ticket #64
     307
     308== Scenario 6: 20 Slices with 5 VMs each ==
     309
     310Created First sliver with 5 VMs on one LAN, but upon checking login information found that only 2 of the 5 VMs
     311allocate has SSH ports,  See ticket #63. This may be relate to ticket#62.
     312
     313