| 1 | = Details on BBN-CAM GRAM Rack Installation and Configuration = |
| 2 | |
| 3 | {{{ |
| 4 | #!html |
| 5 | <h1 style="text-align: left; color: red">This is an internal development rack. Not for public use.</h1> |
| 6 | }}} |
| 7 | |
| 8 | [[PageOutline(2-100,Table of Contents,inline,unnumbered)]] |
| 9 | |
| 10 | == Parts List == |
| 11 | |
| 12 | * 3 Dell !PowerEdge R620 |
| 13 | * 1 Dell !PowerConnect 7048 switch |
| 14 | * 1 Dell Force10 S4810P !OpenFlow switch |
| 15 | * 3 SFP cables |
| 16 | * 9 Ethernet cables |
| 17 | * 3 SFP-ethernet converters |
| 18 | * 1 Serial cable |
| 19 | * 230V UPS (Optional) |
| 20 | * Rack Size - Width: 23.8" (605mm), Depth: 42.1" (1070mm), Weight: 298 lbs (135 kg) |
| 21 | |
| 22 | == Power Requirements == |
| 23 | As for power, the racks will come with a 5600W, 230V UPS to power all the components. The power supply has the following technical specs:[[BR]] |
| 24 | |
| 25 | |
| 26 | * Power Rating: 5600 Watts |
| 27 | * Runtimes: 5.5 mins @ full load, 17 mins @ ½ load |
| 28 | * Input Voltages: 220, 230, 240 VAC |
| 29 | * Output Voltages: 220, 230, 240 VAC |
| 30 | * Input Connection: Hardwired |
| 31 | * Output Receptacles: IEC-60320 C13(X6), IEC-60320 C19(X4) |
| 32 | * Physical Specs (w x h x d – wt): 17.2” x 6.75” x 31.1” – 158lbs |
| 33 | * Heat Dissipation in Normal Mode BTU/hr: 956 |
| 34 | |
| 35 | == Hardware Configuration == |
| 36 | |
| 37 | BOS is a rack consisting of the following hardware components: |
| 38 | |
| 39 | * 3 Dell !PowerEdge R620 server hosts. Of these, we have configured |
| 40 | * 1 as the !OpenStack control node (bbn-cam-ctrl-1.bbn.com) |
| 41 | * 2 as !OpenStack compute nodes both act as VM servers (bbn-cam-cmpe-1.bbn.com, bbn-cam-cmpe-2.bbn.com). |
| 42 | * 1 Dell !PowerConnect 7048 Switch for access to the external internet [http://www.dell.com/support/Manuals/us/en/19/product/powerconnect-7048r Manual] |
| 43 | * 1 Dell Force10 S4810P !OpenFlow switch. [http://www.dell.com/support/Manuals/us/en/04/Product/force10-s4810 Manuals] |
| 44 | |
| 45 | There are no bare metal servers on this rack. |
| 46 | == Network Configuration == |
| 47 | |
| 48 | We have established the following addresses for the different servers, and connected them to the following ports on the Force10 switch and !PowerConnect 7048 switch: |
| 49 | |
| 50 | |
| 51 | ||'''Host'''||'''Control Plane Address'''||'''!PowerConnect Port (Control Plane)'''||'''External Address'''||'''!PowerConnect Port (External Plane)'''||'''Management Address'''||'''!PowerConnect Port (Management Plane)'''||'''Data Plane Address'''||'''Force10 Port (Data Plane)'''|| |
| 52 | ||bbn-cam-ctrl-1||10.10.8.100||13||128.89.72.112||25||10.10.6.100||1||10.10.5.100||0|| |
| 53 | ||bbn-cam-cmpe-1||10.10.8.101||14||128.89.72.113||26||10.10.6.101||2||10.10.5.101||1|| |
| 54 | ||bbn-cam-cmpe-2||10.10.8.102||15||128.89.72.114||27||10.10.6.102||3||10.10.5.102||2|| |
| 55 | |
| 56 | The management plane on the VMs use a 192.168.x.x address, which is a Quantum (!OpenStack) network that is running within the management plane and physical network interface above. This network is used for port-forwarding of ssh traffic to/from the VMs. |
| 57 | All VMs created will have an address in this network in addition to any interfaces requested. |
| 58 | |
| 59 | The external gateway from the rack is at 128.89.72.1 |
| 60 | |
| 61 | We use the follow VLAN configuration to define the various networks: |
| 62 | |
| 63 | ||'''Network'''||'''switch'''||'''ports'''|| '''VLANs'''|| |
| 64 | || management || management || 1, 2, 3 || 2500 || |
| 65 | || control || management || 13, 14, 15, 16, 17, 18, 19, 20 || 200 || |
| 66 | || external || management || 25,26,27, 29,37,48 || 300 || |
| 67 | || data (local)|| !OpenFlow || 0, 1, 2 || 1000-2000|| |
| 68 | || data (stitched)|| !OpenFlow || 0, 1, 2, 3 || 2001-2099|| |
| 69 | |
| 70 | We have established the following control plane addresses for the different servers, the Force10 switch and connected them to the following ports on the !PowerConnect 7048 switch: |
| 71 | ||'''Host'''||'''Control Plane Address'''||'''!PowerConnect Port (Control Plane)'''|| |
| 72 | ||bbn-cam-ctrl-iDRAC||10.10.8.10||18|| |
| 73 | ||bbn-cam-ctrl-iDRAC||10.10.8.11||19|| |
| 74 | ||bbn-cam-ctrl-iDRAC||10.10.8.12||20|| |
| 75 | ||Force10 !OpenFlow Switch||10.10.8.200||16|| |
| 76 | ||!PowerConnect 7048 Switch||10.10.8.201||17|| |
| 77 | |
| 78 | The ports on the Dell Force10 switch used for transporting data plane traffic (0, 1, 2) are configured as tagged VLAN's 1000-2099. |
| 79 | {{{ |
| 80 | ! |
| 81 | interface Vlan 1000 of-instance 1 |
| 82 | no ip address |
| 83 | tagged TenGigabitEthernet 0/0-2 |
| 84 | no shutdown |
| 85 | ! |
| 86 | interface Vlan 1001 of-instance 1 |
| 87 | no ip address |
| 88 | tagged TenGigabitEthernet 0/0-2 |
| 89 | no shutdown |
| 90 | ! |
| 91 | ...... |
| 92 | }}} |
| 93 | |
| 94 | == !OpenFlow Resources == |
| 95 | Experimenters can use a POX controller running as a "Learning Switch" at 10.10.8.100:9000 |
| 96 | The syntax for rspecs: |
| 97 | <openflow:controller url="10.10.8.100:900"/> |
| 98 | |
| 99 | == Software Configuration == |
| 100 | |
| 101 | BBN-CAM has a standard GRAM configuration, with one control host (bbn-cam-ctrl-1) and two compute nodes (bbn-cam-cmpe-1, bbn-cam-cmpe-2). The configuration file (/etc/gram/config.json) represent this configuration with the external and control plane addresses and VLAN ranges as described above. |
| 102 | |
| 103 | The BBN-CAM GRAM Rack is currently configured with the following versions of software: |
| 104 | |
| 105 | || '''Software Component''' || '''Version'''|| |
| 106 | || Ubuntu OS || 12.04 || |
| 107 | || Python || 2.7.3 || |
| 108 | || MySQL || 14.14 || |
| 109 | || Quantum || 2.0 || |
| 110 | || Nova || 2013.1.3 || |
| 111 | || Glance || 2013.1.3 || |
| 112 | || Keystone || 2013.1.3 || |
| 113 | || openVSwitch || 1.4.0 || |
| 114 | || Pox || 0.1.0 || |
| 115 | || gcf || 2.4.1 || |
| 116 | |
| 117 | == Administration Procedures == |
| 118 | [wiki:GENIRacksHome/GRAMRacks/PowerUp Powering Up Rack][[BR]] |
| 119 | [wiki:GENIRacksHome/GRAMRacks/PowerDown Powering Down Rack][[BR]] |
| 120 | [wiki:GENIRacksHome/GRAMRacks/iDRAC integrated Dell Remote Access Controller (iDRAC) Configuration][[BR]] |
| 121 | [wiki:GENIRacksHome/GRAMRacks/RackAdminAccounts Rack Administration Accounts][[BR]] |
| 122 | [wiki:GENIRacksHome/GRAMRacks/SoftwareRepository Software Repository][[BR]] |
| 123 | [wiki:GENIRacksHome/GRAMRacks/GRAMUpdates Software Updates][[BR]] |
| 124 | [wiki:GENIRacksHome/GRAMRacks/EmergencyStop Emergency Stop][[BR]] |
| 125 | [wiki:GENIRacksHome/GRAMRacks/Monitoring Remote Monitoring Procedures][[BR]] |