id summary reporter owner description status priority milestone component version resolution keywords cc dependencies 1346 MAX and ION aggregates do not deletesliver even though success is returned for deletesliver lnevers@bbn.com xyang@maxgigapop.net "In a 9 node grid scenario the MAX aggregate reports to have deleted a sliver, but on the next stitcher createsliver attempt the command fails due to a reservation already existing at MAX for the slice: Problem is reproducible. {{{ $ stitcher.py createsliver 9grid /home/lnevers/gcf-test/stitch-test/9grid/stitch-9grid.rspec ... 10:59:31 INFO : Using SCS at http://nutshell.maxgigapop.net:8081/geni/xmlrpc 10:59:31 INFO : Calling SCS... 10:59:41 INFO : Multi-AM reservation will include resources from these aggregates: 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : 10:59:41 INFO : Stitcher doing createsliver at ... 11:00:03 INFO : ... Allocation at complete. 11:00:03 INFO : Stitcher doing createsliver at ... 11:00:34 INFO : ... Allocation at complete. 11:00:34 INFO : Stitcher doing createsliver at ... 11:01:12 INFO : ... Allocation at complete. 11:01:13 INFO : Stitcher doing createsliver at ... 11:01:49 INFO : ... Allocation at complete. 11:01:49 INFO : Stitcher doing createsliver at ... 11:02:41 INFO : DCN AM : must wait for status ready.... 11:02:41 INFO : Pausing 30 seconds to let circuit become ready... 11:03:19 INFO : Pausing 30 seconds to let circuit become ready... 11:03:59 WARNING : sliverstatus: 4084 is (still) failed at . Delete and retry. 11:03:59 WARNING : sliverstatus: 4085 is (still) changing at . Delete and retry. 11:03:59 WARNING : sliverstatus: 4086 is (still) changing at . Delete and retry. 11:04:07 WARNING : says requested VLAN was unavailable at 11:04:07 INFO : Will put back in the pool to allocate. Got: VLAN was unavailable. Retry 2nd time with new suggested 3108 (not 3214) 11:04:07 INFO : Pausing for 600 seconds for Aggregates to free up resources... 11:14:07 INFO : Stitcher doing createsliver at ... 11:14:13 INFO : ... Allocation at complete. 11:14:13 INFO : Stitcher doing createsliver at ... 11:14:24 ERROR : {'output': ': CreateSliver: Existing record: urn:publicid:IDN+ch.geni.net:ln-test+slice+9grid, ', 'geni_api': 2, 'code': {'am_type': 'sfa', 'geni_code': 7, 'am_code': 7}, 'value': ''} 11:14:24 WARNING : Stitching failed but will retry: Reservation request impossible at . You already have a reservation here in this slice: AMAPIError: Error from Aggregate: code 7. sfa AM code: 7: : CreateSliver: Existing record: urn:publicid:IDN+ch.geni.net:... 11:14:24 INFO : Deleting existing reservations... 11:14:24 INFO : Doing deletesliver at ... 11:15:20 INFO : Deleted reservation at . 11:15:20 INFO : Doing deletesliver at ... 11:15:42 INFO : Deleted reservation at . 11:15:42 INFO : Doing deletesliver at ... 11:16:37 INFO : Deleted reservation at . 11:16:37 INFO : Doing deletesliver at ... 11:17:32 INFO : Deleted reservation at . 11:17:32 INFO : Doing deletesliver at ... 11:18:28 INFO : Deleted reservation at . 11:18:28 INFO : Calling SCS for the 2nd time... 11:18:29 ERROR : Root cause error: Reservation request impossible at . You already have a reservation here in this slice: AMAPIError: Error from Aggregate: code 7. sfa AM code: 7: : CreateSliver: Existing record: urn:publicid:IDN+ch.geni.net:... Reservation request impossible at . You already have a reservation here in this slice: AMAPIError: Error from Aggregate: code 7. sfa AM code: 7: : CreateSliver: Existing record: urn:publicid:IDN+ch.geni.net:... which caused StitchingServiceFailedError: Error from Stitching Service: code 3: MxTCE ComputeWorker return error message ' Action_ProcessRequestTopology_MP2P::Finish() Cannot find the set of paths for the RequestTopology. '. }}} Attaching stitcher log and request rspec for MAX" accepted major STITCHING SPIRAL7 GENI Network Stitching