controller_card_redundancy_test

gNMI-1.17 Controller Card redundnacy test

Summary

• collect inventory data for each controller card
• Verify last restart time is updated

Procedure

test 1 Contyroller Card inventory

• collect following attributes for each component of CONTROLLER_CARD type and verify corectness (mostly non-empty string)

  • /components/component/state/empty

  • /components/component/state/location

  • /components/component/state/oper-status

  • /components/component/state/switchover-ready

  • /components/component/state/redundant-role

  • /components/component/state/last-switchover-time

  • /components/component/state/last-switchover-reason/trigger

  • /components/component/state/last-switchover-reason/details

  • /components/component/state/last-reboot-time

  • /components/component/state/last-reboot-reason

  • /components/component/state/description

  • /components/component/state/hardware-version

  • /components/component/state/id

  • /components/component/state/mfg-name

  • /components/component/state/name

  • /components/component/state/parent

  • /components/component/state/part-no

  • /components/component/state/serial-no

  • /components/component/state/type

• store list of present components of CONTROLLER_CARD type

test 2 switchover

• Verify that all controller_cards have switchover-ready=TRUE
• Collect and store redundant-role for each controller_card as "previous-role"
• Initiate controller-card switchover
• Try periodicaly (60 sec interval) untill sucesfull but no longer then 20 min: Collect redundant-role for each controller_card. Compare it with "previous-role"
  • for controller_card of current "PRIMARY" role, previous role must be "SECONDARY"
  • for controller_card of current "SECONDARY" role, previous role must be "PRIMARY"
• try until (switchover-ready=TRUE on all controller_cards OR last-switchover-time is moret then 20min ago)
  • Wait(5min)
  • Verify that all controller_cards has switchover-ready=TRUE; if so test PASSED

test 2 Redundancy

• Verify that all controller_cards has switchover-ready=TRUE
• Select component with redundant-role=PRIMARY, store name as "previous_primary"
• Perfom Controller_Card switchover and then power down "previous_primary" component. Wait 5s.
• Collect redundant-role and oper-status from all components of CONTROLLER_CARD type as collected in test 1;
  • verify that "previous_primary" controller oper-status is not ACTIVE
  • verify that at exectly one controller_card has redundant-role=PRIMARY and oper-status=ACTIVE
  • if gNMI client can get this information, it is asumed controller card redundancy works. More torough tests of failover are part of forwarding tests.
• Power up "previous_primary" controller card
• Wait untill all controller_cards has switchover-ready=TRUE (cleanup)

test 3 last reboot time

• Select component with redundant-role=SECONDARY
• store last-reboot-time for this component as "previous-reboot-time"
• Power down this component, wait 60 sec.
• Power up this component
• Wait
• get last-reboot-time and compare with "previous-reboot-time"
  • "previous-reboot-time" must be smaller (earlier) then recently collected last-reboot-time

Config Parameter coverage

• /components/component/controller_card/config/power-admin-state

Telemetry Parameter coverage

• /components/component/controller-card/state/power-admin-state
• /components/component/state/empty
• /components/component/state/location
• /components/component/state/oper-status
• /components/component/state/switchover-ready
• /components/component/state/redundant-role
• /components/component/state/last-switchover-time
• /components/component/state/last-switchover-reason/trigger
• /components/component/state/last-switchover-reason/details
• /components/component/state/last-reboot-time
• /components/component/state/last-reboot-reason
• /components/component/state/description
• /components/component/state/hardware-version
• /components/component/state/id
• /components/component/state/mfg-name
• /components/component/state/name
• /components/component/state/parent
• /components/component/state/part-no
• /components/component/state/serial-no
• /components/component/state/type

Minimum DUT platform requirement

• MFF