QA checklist for production release: 8/22/25

[ccostino]

Sign In

• notify-staging.app.cloud.gov resolves
• Clicking sign in takes you to Login.gov
• Can sign in via Login.gov
• After successful login, you are brought to the “choose service” screen
• Choosing a service brings you to the dashboard for that service

Create a template and send

• Clicking “Send messages” brings you to templates page
• When “Create a template” button is clicked, the option to create new or copy existing template appears
• Uploading a csv is quick and automatically directs you to the preview/send page
• Formatting looks clean and in place
• Message dashboard populates and shows “pending” until call is made to AWS for delivery receipt

Send a message from copied template

• When “Create a template” button is clicked, the option to create new or copy existing template appears
• Clicking “copy an existing template” allows you to choose from pre-existing template
• After editing, the new template saves and you prepare to send

Send a message from existing template

• Clicking on existing template brings you to preview screen with prepare to send button
• All else above persists as true (formatting, send, dashboard, etc)

Checking template folder permissions

• Only the template creator and platform admins should be able to see a new template folder
• Adding a non platform admin user to a folder should grant them access to see and copy the templates
• Removing a non platform admin user to a folder should remove their access to see and copy the templates
• Platform admins should not be able to be added or removed from template folders, since they have full access regardless

Download the CSV delivery reports

• Clicking on the CSV download directly after a message send downloads a report that contains the data we expect
• Clicking on the CSV download links from the main dashboard downloads a report that contains the data we expect
• The daily generated batch reports appear at the bottom of the main dashboard batch table with accurate information
• The daily generated batch report buttons are highlighted appropriately based on which reports are available (1, 3, 5, and 7 day)
• Downloading the generated batch reports that are available work properly and contain the data that we expect

Invite a team member

• Clicking on “Team” in settings brings you to team member screen
• Clicking “Invite a team member” brings you to email and permissions screen
• Clicking invite team member sends an invite and shows confirmation
• Invite email provides live link that works to register new team member

Delete a team member

• From team member screen, clicking “Change Details” on a specific profile brings you to that person’s profile
• Clicking on “Remove this team member” prompts a confirmation
• Clicking the confirmation removes the team member

Sign Out

• Clicking “Sign Out” takes you back to the homepage and logs you out

[heyitsmebev]

Something to consider: In the UI, users will see all templates they’re associated with, even when they’re within a specific service. Do we want to show users only the templates they have access to within the specific service they’re currently in and not all?

One thing I’ve noticed is that navigating to an individual job from the homepage is very slow, it takes about 30.6 seconds to load the next page. It's only slow when I click on the jobs with 20+ notifications.

[heyitsmebev]

Everything looks good in the QA except for the issue we already noted:

Bug: Job details page not loading for a bulk send job #2854

[CathyBeil]

I'd never noticed that about seeing templates across services when copying an existing template! I don't think it's a user issue right now because State's still only using the one service. Plus, I think this could actually be a good thing going forward, since it would enable easy copying of templates across services if/when we have orgs with more than one (including if State ever uses the other ones we set up for them, they're not right now).

[ccostino]

Thanks for calling this out, @heyitsmebev! I agree with @CathyBeil that it's probably a good thing for right now as it would let an individual copy any template they've used across services.

Perhaps it's something we revisit with fine-grained permissions in the future if need be, but for now we should be good!

And also noted about the individual job page, we have a bug filed ready to go here to look into it: #2854 🙂

[ccostino]

Latest release is now officially out the door and done! 🎉