시스코 스위치 stack 에서 제거한 member 스위치의 무한 재부팅 문제.
스택에서 정상적으로 unprovision 하지 않은 스위치는 아래 처럼 무한 재부팅을 하게 된다.
Initializing Hardware... System Bootstrap, Version 17.14.1r [FC1], RELEASE SOFTWARE (P) Compiled Fri 12/15/2023 14:15:51 by rel Current ROMMON image : Primary C9200L-48P-4X platform with 2097152 Kbytes of main memory boot: attempting to boot from [flash:packages.conf] boot: reading file packages.conf ############## Waiting for 120 seconds for other switches to boot ### Switch number is 1 All switches in the stack have been discovered. Accelerating discovery Chassis 1 reloading, reason - Active/standby selection failed in 1+1 Mode Jan 3 01:37:15.267: %PMAN-5-EXITACTION: C0/0: pvp: Process manager is exiting: reload cc action requested Jan 3 01:37:15.799: %PMAN-5-EXITACTION: F0/0: pvp: Process manager is exiting: reload fp action requested Jan 3 01:37:20.612: %PMAN-5-EXITACTION: R0/0: pvp: Process manager is exiting: rp processes exit with reload switch code Initializing Hardware... System Bootstrap, Version 17.14.1r [FC1], RELEASE SOFTWARE (P) Compiled Fri 12/15/2023 14:15:51 by rel Current ROMMON image : Primary C9200L-48P-4X platform with 2097152 Kbytes of main memory boot: attempting to boot from [flash:packages.conf] boot: reading file packages.conf ##############
스위치 앞쪽의 버튼을 누르고 있는 상태로 전원을 켜면, 부트로더 모드를 볼 수 있다.
Initializing Hardware... System Bootstrap, Version 17.12.1r [FC3], RELEASE SOFTWARE (P) Compiled Mon 07/10/2023 04:28:59 by rel Current ROMMON image : Primary C9200L-48T-4X platform with 2097152 Kbytes of main memory switch:
현재 환경 변수를 확인하기 위해 set 을 입력한다.
switch: set ABNORMAL_RESET_COUNT=0 AUTOREBOOT_RESTORE=1 AUTO_SWITCH_CONSOLE_DISABLE=0 BAUD=9600 BOOT=flash:packages.conf; BOOT_DEVICE_MODE=catalyst BSI=-1 DC_COPY=yes MAC_ADDR=F8:E9:4F:81:A4:80 MANUAL_BOOT=yes MODEL_NUM=C9200L-48T-4X MOTHERBOARD_SERIAL_NUM=JAF26271P13 NO_CONSOLE=0 RANDOM_NUM=428519198 ROMMON_BOARDID=0x4315 ReloadReason=Image Install RET_2_RCALTS=1657078312 STACK_1_1=1_2 SWITCH_DISABLE_PASSWORD_RECOVERY=0 SWITCH_NUMBER=3 SWITCH_PRIORITY=12 SYSTEM_SERIAL_NUM=JAF26271P13 TEMPLATE=advanced USB_DISABLE=0
여기서 STACK과 관련된 환경변수를 확인 할 수 있는데, 이것을 모두 unset 명령으로 삭제한다.
switch: unset SWITCH_NUMBER switch: unset SWITCH_PRIORITY switch: unset STACK_1_1
환경변수가 삭제되었는지 확인한다.
switch: set ABNORMAL_RESET_COUNT=0 AUTOREBOOT_RESTORE=1 AUTO_SWITCH_CONSOLE_DISABLE=0 BAUD=9600 BOOT=flash:packages.conf; BOOT_DEVICE_MODE=catalyst BSI=-1 DC_COPY=yes MAC_ADDR=F8:E9:4F:81:A4:80 MANUAL_BOOT=yes MODEL_NUM=C9200L-48T-4X MOTHERBOARD_SERIAL_NUM=JAF26271P13 NO_CONSOLE=0 RANDOM_NUM=428519198 ROMMON_BOARDID=0x4315 ReloadReason=Image Install RET_2_RCALTS=1657078312 SWITCH_DISABLE_PASSWORD_RECOVERY=0 SYSTEM_SERIAL_NUM=JAF26271P13 TEMPLATE=advanced USB_DISABLE=0
boot 명령으로 스위치를 부팅하면, 정상적으로 이용할 수 있다.
switch: boot
boot: attempting to boot from [flash:packages.conf]
boot: reading file packages.conf
##############
Both links down, not waiting for other switches
Switch number is 1
Restricted Rights Legend
Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706
Cisco IOS Software [Dublin], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 17.12.4, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2024 by Cisco Systems, Inc.
Compiled Tue 23-Jul-24 09:41 by mcpre
This software version supports only Smart Licensing as the software licensing mechanism.
PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.
Your use of the Software is subject to Cisco's General Terms and any
relevant supplemental terms found at
https://www.cisco.com/site/us/en/about/legal/contract-experience/index.html.
You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.
FIPS: Flash Key Check : Key Not Found, FIPS Mode Not Enabled
cisco C9200L-48T-4X (ARM64) processor with 502841K/3071K bytes of memory.
Processor board ID JAF26271P13
2048K bytes of non-volatile configuration memory.
1973316K bytes of physical memory.
819200K bytes of Crash Files at crashinfo:.
1941504K bytes of Flash at flash:.
Base Ethernet MAC Address : f8:e9:4f:81:a4:80
Motherboard Assembly Number : 73-102066-04
Motherboard Serial Number : JAF26271P13
Model Revision Number : D0
Motherboard Revision Number : A0
Model Number : C9200L-48T-4X
System Serial Number : JAF26271P13
CLEI Code Number : INM6H00ARX
Press RETURN to get started!
스택이 구성되어 있던 스위치이므로, 아래처럼 실제로 존재하지 않는 3개의 Member가 보인다.
Switch#show switch
Switch/Stack Mac Address : f8e9.4f81.a480 - Local Mac Address
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State
-------------------------------------------------------------------------------------
*1 Active f8e9.4f81.a480 1 V03 Ready
2 Member 0000.0000.0000 0 Provisioned
3 Member 0000.0000.0000 0 Provisioned
4 Member 0000.0000.0000 0 Provisioned
아래 명령으로 멤버 스위치를 제거하고 재부팅한다.
Switch#conf t Enter configuration commands, one per line. End with CNTL/Z. Switch(config)#no switch 4 provision Switch(config)#no switch 3 provision Switch(config)#no switch 2 provision Switch(config)#end
Switch#sh switch
*Jan 3 10:58:56: %SYS-5-CONFIG_I: Configured from console by consolech
Switch/Stack Mac Address : f8e9.4f81.a480 - Local Mac Address
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State
-------------------------------------------------------------------------------------
*1 Active f8e9.4f81.a480 1 V03 Ready
2 Member 0000.0000.0000 0 Unprovisioned
3 Member 0000.0000.0000 0 Unprovisioned
4 Member 0000.0000.0000 0 Unprovisioned
Switch#reload
재부팅 후 스위치 확인하면,
Switch#sh switch
Switch/Stack Mac Address : f8e9.4f81.a480 - Local Mac Address
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State
-------------------------------------------------------------------------------------
*1 Active f8e9.4f81.a480 1 V03 Ready