MVP - Endpoint Monitoring and Updates: Issue Reporting and Continuous Improvement

[jennb33]

User Story

As the Managers and Developers of the VA Platform,
We need to implement a process for reporting and tracking issues,
So that when there is a problem with endpoint monitoring, the issue is not lost and can be added to a workflow quickly.

Issue Description

The objective is to ensure continuous awareness of the performance of http://va.gov/ systems and to be promptly notified of any system behavior that negatively impacts Veterans. It is important to ensure there is an awareness around show traffic levels, error rates, system latency, etc. To effectively address issues in a timely manner, teams should implement dashboards, monitors, and alerts for their systems. High priority applications may need to be integrated into the Watchtower program, which provides oversight for critical systems. Teams can mark specific monitors for Watch Officer review by using the watchtower tag, and all monitors included in Watchtower must have clear, actionable instructions for the Watch Officer to follow. This ensures that the necessary information is readily available to address any problems quickly and efficiently.

See the discovery document that was stood up for this effort.

The vision for this work would be to leverage discovery work that was done for the Zero Silent Failures effort. There should be lists of the endpoints and APIs in these tickets (92876, 92926)

The scope of this ticket is to create and implement a process for reporting issues that includes monitoring related issues (perhaps through governance or OCTO Watchtower), and there are clear guidelines for reporting an issue post-rollout.

Tasks

• Implement a process for reporting issues that includes a centralized platform for tracking and resolving monitoring related issues (e.g. through governance team or watchtower). This reporting process needs to include clear guidelines on how and where issues should be reported during and after the rollout.
• Document process and share with other Platform and VFS teams

Success Metrics

A process for reporting issues is established for the Platform and VFS teams.

Acceptance Criteria

• Platform will have a documented process for reporting issues

---

Validation

Assignee to add steps to this section. List the actions that need to be taken to confirm this issue is complete. Include any necessary links or context. State the expected outcome.