How to Preview, Review, and Monitor BusyBee Chats

When you open the preview, your own test chat is displayed, allowing you to test the student experience.

1. The Show chat for field reads Myself, meaning that the chats are your interactions with the chatbot.
2. To test the chat, type in the Enter message field and send.
3. Select Evaluate to see how BusyBee would evaluate your test chat. Students are able to evaluate their chats, too.
4. Select Reset to start the chat over.
5. If you have multiple chats because you have reset one, the Selected chat field appears. Open it to review your past chats.
6. Open the More menu and select Class performance for an overview of all students' performance in the activity. BusyBee generates this overview by evaluating all student chats and highlighting trends.

To review a student's chats:

1. Select the Choose student button in the Show chat for field.

2. Students who have chatted at all in the activity have a Last message date listed, and you can sort this list.
3. Select a student's name to see their chats.

4. The Selected chat field allows you to review chats that have been reset or blocked.
5. You can Reset the chat for the student. If you do this, the student is no longer able to send messages in it.
6. Select Evaluate for an evaluation of the student's performance in the chat.
7. From the More menu, you can:
   • Block a chat for the student if you notice content related to Self-harm, Sexual content, or Illicit activity. This disallows the student from sending messages in the chat, but they can still access it.  
   • Unblock blocked chat (not shown).
   • Add a comment about the chat. These comments are internal to teachers and administrators.
   • Hide reset (ended) chat from the student (not shown).
   • Open Chat History to review the Blocks, Hides, and Comments connected with the chat.
   • Select Class performance for an overview of all students' performance in the activity. BusyBee generates this overview by evaluating all student chats and highlighting trends.

8. Status messages appear above the student's conversation to indicate when a chat has ended, blocked, or hidden.
9. To return to your own teacher preview, clear the student's name by selecting the X.

BusyBee's automated monitoring conducts continuous, real-time scanning of student conversations to ensure that content deemed inappropriate is promptly detected and flagged for review for teachers and administrators.

If inappropriate content related to self-harm, sexual content, or illicit activities is identified:

1. The chat is ended for the student and a popup appears explaining that the chat has been blocked, why it was blocked, and what the student can do.

2. When the pop-up is closed, a status message remains, explaining the reason for the block.
3. The student can select Dispute if they think they were blocked by mistake. Doing this adds another status message to the chat and sends an email to their teacher about the error.
4. The student can Reset the chat to begin again.

An automated email notification about any block is sent to all users enrolled as teachers in the course and to additional recipients, like principals, that administrators have added to these emails. Email notifications include:

• Student name and ID
• Course title and ID
• Activity title and ID
• The reason for the block
• Up to the last five messages of the chat

Teachers and administrators with access to the course can manually block chats:

1. Select the More menu on the activity toolbar.
2. Select Block.

3. Select a reason for the block (Self-harm, Sexual content, Illicit activity, or Other).
4. Select Block.

4. The same status message appears in the chat as with an automated block, and the same notification emails are sent.
5. You can select Add comment in the More menu to add additional context around the block for other teachers and administrators to see (these are not visible to students).

A teacher can review a blocked chat. If they decide it was blocked in error, they can Unblock it from the More menu and the student can continue the chat if they haven't already reset it.