Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create new Experience Standard for notifications #94416

Closed
16 of 24 tasks
shiragoodman opened this issue Oct 7, 2024 · 24 comments
Closed
16 of 24 tasks

Create new Experience Standard for notifications #94416

shiragoodman opened this issue Oct 7, 2024 · 24 comments
Assignees
Labels
governance-team Platform Governance Team new-unplanned Unplanned work (beta sprint test) Ready Gov Team - Tickets ready for sprint zero-silent-failures Work related to eliminating silent failures

Comments

@shiragoodman
Copy link
Contributor

shiragoodman commented Oct 7, 2024

User Story

As a Governance team member, I want to ensure our Experience Standards include proper notification coverage for Veterans so that VFS teams are encouraged to build products that meet the notification coverage standards.

Assignee: @erinrwhite @allison0034
Peer Reviewer: @KKitagawa-Bosch

Description

On October 1 and 2, the OCTO Team Zero Errors check-in meetings occurred. The purpose of these meeting were for OCTO-DE to check in with VFS teams to ensure their products on VA.gov had zero silent failures, and teams had plans in place to remediate any known errors. While we were glad to learn that there were few instances of silent failures, we did learn that there were some instances within VFS products where the UI/UX had some inconsistencies. For example, we learned that if the VA cancels a Veterans appointment (for example, due to facilities closures) that the cancellation will be visible on VA.gov, however a Veteran isn't sent a notification via email or text message to communicate the cancelled appointment. This is not ideal as Veteran's shouldn't have to log into VA.gov everyday just to confirm that there appointment hasn't been cancelled.

The purpose of this ticket is for Governance team to create a new VA.gov Experience Standard focused on proper notifications. Per @humancompanion-usds, "...if it’s worthy showing in the UI, then it’s possibly worth sending as a notification too. " VFS teams must notify veterans in both paths (belts and suspenders). The secondary path is email, or text, and needs to happen for critical points in the experience.

Updates post conversation with @humancompanion-usds on 10/25: At this time, the priority for Governance is to add the new standard to the VA.gov Experience Standards so that it is visible and hopefully adhered to by VFS teams. Also within the scope of this ticket, Governance team will modify the operational process at Design Intent and Midpoint Review for the Design and IA practice areas to help guide the VFS into using appropriate notifications by asking intentional questions about the flow for the Veteran outside of the VA.gov experience. Governance team has several larger initiatives planned to better determine how notification standards can be incorporated into Collab Cycle, and where/how our processes and learnings may need to change to support notifications standards

Impacted Artifacts

Live pages

Drafted pages

Tasks

Changes to standards

  • Before defining anything, please read through the Updating Experience Standards and descriptive tags guidance
  • Using the description above as well as Matt's comment, propose a new standard for VFS teams building on VA.gov
  • Share standard with peer reviewer for feedback
  • Once assignee and peer reviewer are in agreement, share with Governance team and Matt Dingee via the #platform-governance-team channel in Slack

Changes to operational guidance

  • Update the IA and Design operational guidance for both Design Intent and Midpoint Review to include guidance for asking the VFS teams questions about the Veteran experience for notifications outside of VA.gov (I won't be overly prescriptive here wrt how you do this, however I do really like the IA Evaluation Criteria for Design Intent)

Publishing and announcing

  • Write a change announcement for Slack following the Slack change announcement format
  • Write a new post for the Platform Website/Collaboration Cycle Change history page
  • Submit a pull request to update the Experience Standards page on VADS and work with @it-harrison to get it approved and merged
  • Once Governance and Matt sign off on new standard, publish pages and post change announcement

Peer Review

To be completed by peer reviewer

  • User story and acceptance criteria are met

Acceptance Criteria

  • Governance team has published a new VA.gov Experience Standard for ensuring notifications (email, text) are sent if/when a critical action occurs on VA.gov
  • Governance team operational guidance at DI and MPR has been modified to help direct VFS teams to build products that meet our new notification standard
  • VFS teams have been made aware of the changes to the VA.gov Experience Standards

Team Notification

  • Slack post on #platform-governance-team
  • Presentation at Weekly Initiative Meeting
  • No notification needed

How to prepare this issue

Refinement

  • Ticket has user story, description, tasks, and acceptance criteria
  • Ticket has been sized
  • Once all above items are checked, add the 'Ready' label.

Planning

If this ticket is picked up from the Backlog mid-sprint, connect with Shira to ensure the below items are completed correctly

  • Ticket has been discussed as a team at Planning
  • Ticket has been assigned to appropriate initiative or quarterly epic
  • Ticket has been assigned to a Sprint
  • Ticket has been moved to the Planned pipeline in the Governance team board
  • Ticket as an assignee and peer reviewer
@shiragoodman shiragoodman added governance-team Platform Governance Team needs-refinement Identifies tickets that need to be refined zero-silent-failures Work related to eliminating silent failures labels Oct 7, 2024
@humancompanion-usds humancompanion-usds self-assigned this Oct 18, 2024
@shiragoodman
Copy link
Contributor Author

shiragoodman commented Oct 21, 2024

Notes from the team at refinement on 10/21:

  • This is related to Service Design, which is new territory for us.
  • How do we know/determine when a notification is necessary?
  • We want to talk to Matt to better understand the scope
  • is VA Notify the only way that emails are generated by VA.gov?

@humancompanion-usds
Copy link
Contributor

Visibility of system status” is number one on the list of the “10 Usability Heuristics for User Interface Design” from the Nielsen Norman Group. The rule states that “the system should always keep users informed about what is going on, through appropriate feedback within a reasonable time.”

Our system will do this in 2 ways at critical touch points when a user submits data/makes a request to the VA:

  1. Notifications via SMS and email
  2. Providing status in the UI

This allows us to provide system status of a request such that if the user misses one they will (hopefully) see the other.

First and foremost, we've asked all VFS teams to send 3 types of notifications for asynchronous form submissions as detailed in an update to the VA Design System pattern Help users to stay informed of their form submission status by 11/11/24. Governance currently enforces patterns in the Design System and will be expected to enforce this one as well.

After that deadline, from my perspective, the next step is the addition of an experience standard to cover notifications that go beyond this pattern as notifications are a critical part of the user experience on VA.gov and the mobile application. Not all silent failures are form submissions. Creating an Experience standard in the Design System is how we achieve this which gives the Governance team some leeway in how they make sure teams are providing an excellent user experience.

Since I filed this, we discussed with Dave Conlon that the standard could exist in VA Notify's documentation. I'm agnostic as to where it lives so long as it gets created quickly as we have an impending deadline and need to ensure that teams do not ship new work that allows for silent failures.

@shiragoodman shiragoodman added Ready Gov Team - Tickets ready for sprint zero-silent-failures Work related to eliminating silent failures new-unplanned Unplanned work (beta sprint test) and removed needs-refinement Identifies tickets that need to be refined zero-silent-failures Work related to eliminating silent failures labels Oct 28, 2024
@erinrwhite
Copy link
Contributor

Started a documentation draft - @allison0034 and I are meeting tomorrow to talk more

@erinrwhite
Copy link
Contributor

hi @KKitagawa-Bosch!

@allison0034 and I just came up with a few options for wording for the new experience standard. Here's our current thinking:

User has timely and appropriate information about their account status.

Can you review this, and the other ideas we had in the doc, and let us know what you think?

We are also curious what you think about the "account status" language. We batted around a few different options - really want to clarify that this standard is about Veterans having information about their individual access to VA services, rather than being on a broadcast text notification list.

@KKitagawa-Bosch
Copy link
Contributor

I agree "timely and appropriate information about their ___ status" is probably the best option here

My concern about "account status" is that, at least in my mental model, account status tends to refer to like...if you are in good standing with the organization? Like if your account is banned or if you have an outstanding issue with the account, and I think these notifications cover more ground than that?

But if my mental model is not representative of others', that's fine lol

@erinrwhite
Copy link
Contributor

@KKitagawa-Bosch this was our thinking too! What might be some good replacements?

User has timely and appropriate information about their _______.

  • submission status
  • request status
  • form status
  • changes to their account
  • access to VA services
    ?

@KKitagawa-Bosch
Copy link
Contributor

I kinda like changes to their account, though that may suggest it's only when the account itself changes. Maybe "changes impacting their account?" So it's nice and vague.

@shiragoodman
Copy link
Contributor Author

chiming in here after reading the comments. I haven't viewed the draft doc.

It appears that the goal you all are trying to achieve is to introduce this new standard with the same level of granularity as the existing standards...ie a very broad, high-level standard. I'm wondering if we should be more specific. For example, "User has timely and appropriate information about their ___" (whatever the blank ends up being) doesn't state anything about notifications or anything about the experience outside of VA.gov. As far as I'm concerned, most teams (including Appointments) are currently meeting this standard bc the "timely and appropriate information" does exist within the VA.gov experience. We need this standard to communicate that the notification must occur OUTSIDE of the VA.gov experience too. Also, I'm not sure "information" is the right choice. If I were a VFS, I could interpret this to mean that the page loaded in a timely manner.

Please take into consideration my comments and lmk if you have any questions. I imagine Matt will be looking for something a bit more on the nose. Keep in mind we can always change the standard later on after our research is completed. Thank you!

@erinrwhite
Copy link
Contributor

@shiragoodman @allison0034 @KKitagawa-Bosch thanks Shira, I think a good next step is to get Matt's take on this. We had a much more specific option in the doc as well - I'll ask if he prefers that, or the more broad one.

Option 1: more specific

User receives appropriate notification about events that affect their access to VA or VA.gov services.

This wording is specifically about notifications and explicitly names that it includes experiences outside of VA.gov.

Option 2: more broad

User has timely and appropriate information about changes impacting their account.

With this wording, the new standard would include both notifications and being able to verify information or check status after form submission - another thing we’ve been asked to verify recently at Design Intent/Midpoint.

@erinrwhite
Copy link
Contributor

Chatted through this on Slack and landed on:

User receives appropriate notification from the VA or VA.gov about the status of their request.

Proceeding...

@erinrwhite
Copy link
Contributor

@allison0034 next steps for us:

I can start on my docs, and create the pull request.

Can you do your docs, and start a change history post?

@allison0034
Copy link
Contributor

Updated these docs to include "service design" blurb

@allison0034
Copy link
Contributor

allison0034 commented Nov 4, 2024

Took a shot at change history post and tagged @KKitagawa-Bosch to see if they could improve content : )

@shiragoodman
Copy link
Contributor Author

@erinrwhite @allison0034 per discussion from standup yesterday, Matt would like all teams building out a form to use the Stay informed of their form submission status pattern. I think it might make sense for you to include this in the operational guidance for your practice areas at DI and MPR. Please lmk if you have any questions.

@allison0034
Copy link
Contributor

@shiragoodman that is very hyper focused. My guidance does not get that granular. I don't think we should start to get that specific otherwise we would be listing every piece of guidance we have. Instead, I point to the design system as a resource.

If we do start listing these things at this level, it will also be a maintenance nightmare. The DS is very fluid and ever changing.

@erinrwhite
Copy link
Contributor

@shiragoodman that is very hyper focused. My guidance does not get that granular. I don't think we should start to get that specific otherwise we would be listing every piece of guidance we have. Instead, I point to the design system as a resource.

If we do start listing these things at this level, it will also be a maintenance nightmare. The DS is very fluid and ever changing.

@shiragoodman agree - our guidance is varying fidelity so it could be awkward to add links to specific VADS guidance where there is none already. My DI guidance is more broad and does not link directly to the design system, but the IA midpoint guidance is very specific (linking to several components/patterns already) so I added the link on the midpoint page.

@erinrwhite
Copy link
Contributor

@shiragoodman Should we include changes to the Drafting Template as part of this work, or can that be a follow-up next sprint? We have this new standard and the new pattern guidance we mention above. There've also been a few other adds/edits to VADS in the past few months that should be reflected in the drafting template - could bundle 'em together.

erinrwhite added a commit to department-of-veterans-affairs/vets-design-system-documentation that referenced this issue Nov 5, 2024
Per department-of-veterans-affairs/va.gov-team#94416 updating our list of Experience Standards to include a new notification standard.
@erinrwhite
Copy link
Contributor

erinrwhite commented Nov 5, 2024

@allison0034 @KKitagawa-Bosch PR for updated experience standards page ready for your eyeballs!

thanks to our shiny new preview environment you can see how the changes will look too.

@shiragoodman
Copy link
Contributor Author

@erinrwhite @allison0034 totally fine with me if you don't want to include the specific pattern reference in your operational guidance. It was just a suggestion, and if you think it would do more harm than good, then I stand by you. I've said this a million times, but I try and stay away from being overly prescriptive with how your practice area specific operational guidance is handled.

@erinrwhite thank you for calling out updates to the DraftingTemplate. I'm all for bundling them, and can get a ticket written up for this upcoming sprint.

@erinrwhite
Copy link
Contributor

@allison0034
Copy link
Contributor

allison0034 commented Nov 6, 2024

@KKitagawa-Bosch we are just waiting for the pages to post, can you confirm you reviewed everything in Erin's comment? I believe you have.

@KKitagawa-Bosch
Copy link
Contributor

I did!

@erinrwhite
Copy link
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
governance-team Platform Governance Team new-unplanned Unplanned work (beta sprint test) Ready Gov Team - Tickets ready for sprint zero-silent-failures Work related to eliminating silent failures
Projects
None yet
Development

No branches or pull requests

5 participants