Merge pull request #27149 from MicrosoftDocs/main

main to live publish, 12/6/24, 3:30 PM PT

copilot/TOC.yml

@@ -41,6 +41,8 @@
           href: microsoft-365-copilot-page.md
         - name: Pin Microsoft Copilot to the navigation bar
           href: pin-copilot.md
+        - name: Manage Scheduled prompts
+          href: scheduled-prompts.md
         - name: Enable Facilitator in Microsoft Teams
           href: /microsoftteams/facilitator-teams?toc=%2Fcopilot%2Fmicrosoft-365%2Ftoc.json&bc=%2Fcopilot%2Fmicrosoft-365%2Fbreadcrumb%2Ftoc.json
         - name: Manage Copilot for Microsoft Teams meetings and events

copilot/scheduled-prompts.md

@@ -0,0 +1,99 @@
+---
+title: "Manage Scheduled prompts for Microsoft 365 Copilot"
+f1.keywords:
+- NOCSH
+ms.author: camillepack
+author: camillepack
+manager: scotv
+ms.date: 12/06/2024
+audience: Admin
+ms.topic: how-to
+ms.service: microsoft-365-copilot
+ms.localizationpriority: medium
+ms.collection: 
+- scotvorg
+- m365copilot
+- magic-ai-copilot
+description: "Learn about managing Scheduled prompts for Microsoft 365 Copilot, admin controls, data policies, and user management steps."
+---
+
+# Manage Scheduled prompts for Microsoft 365 Copilot
+
+Scheduled prompts in Microsoft 365 Copilot allow users to automate Copilot prompts to run at set times and frequencies in Microsoft Teams, Office.com/chat, and Microsoft Outlook for the web and Desktop. As an admin, you can manage this feature for your organization.
+
+>[!NOTE]
+> This feature is in preview. As an admin, you can opt-in to making this feature available to your organization. To learn more, see [Opt in or out of preview](#opt-in-or-out-of-preview).
+
+## Before you begin
+
+You must have both of the following licenses to manage Scheduled prompts:
+
+- Microsoft 365 Copilot license (in the Copilot subscription)
+- Standard Microsoft Power Automate license
+
+Before you start using the Scheduled prompts feature, ensure that the Optional connected experiences setting is on in your tenant admin portal. This setting should be on by default, but you can double-check by accessing the Optional connected experiences setting at [config.office.com](https://config.office.com/).
+
+Additionally, if you block all new connectors by default using Power Platform Data Loss Prevention (DLP) policies, you need to run the following command to explicitly reclassify the connector:
+
+```powershell
+$connectorsToReclassify = @([pscustomobject]@{
+ id = "/providers/Microsoft.PowerApps/apis/shared_bizchat"
+ name = "Copilot for Microsoft 365"
+ type = "providers/Microsoft.PowerApps/apis"
+})
+Add-ConnectorsToPolicy -PolicyName {TENANT_DLP_POLICY_GUID} -Connectors $connectorsToReclassify -Classification {'Confidential'|'General'}
+```
+
+To learn more about adding connectors to policies, see [Add-ConnectorsToPolicy](/powershell/module/microsoft.powerapps.administration.powershell/add-connectorstopolicy).
+
+## Admin controls
+
+To use the Scheduled prompts feature as an admin, no action is required if no DLP policies are in place and if the Optional connected experiences setting is already enabled. This feature is automatically included as part of the Optional Connected Experiences admin setting. However, if you have DLP policies in place that block new connectors, you might need to run the command script mentioned previously. You can check if you have such policies in the [Power Platform admin center](https://admin.powerplatform.microsoft.com).
+
+If you prefer to not have this feature available to your organization, you can disable the Optional connected experiences setting at [config.office.com](https://config.office.com/). For more information, see [Admin controls for optional connected experiences](/microsoft-365-apps/privacy/optional-connected-experiences).
+
+If you turn off the Optional connected experiences setting, this action prevents anyone in your organization from seeing Scheduled prompts in Copilot.
+
+### Data policies
+
+To prevent exposing organizational data, you should also create a data policy in the [Power Platform admin center](https://admin.powerplatform.microsoft.com). Creating a data policy in the center allows you to control access to these connectors in various ways to help reduce risk in your organization. To learn more, see [Data policies - Power Platform](/microsoft-365-apps/privacy/optional-connected-experiences).
+
+## Disabling Scheduled prompts
+
+:::image type="content" source="media/prompts-org-policy.png" alt-text="Screenshot showing the pop-up that informs users of their organization's data policy." lightbox="media/prompts-org-policy.png":::
+
+If you disable this feature after someone in your organization has already used it:
+
+- Users will no longer be able to manage previously scheduled prompts.
+- Sessions for previously run scheduled prompts continue to exist.
+- Users will no longer see the Scheduled prompts feature or the prompt management pane if the Optional Connected Experiences setting is disabled.
+
+Users will still see the feature if the Optional Connected Experiences setting is enabled and DLP policies are in place, but they won't be able to successfully create a scheduled prompt, and will be made aware that this failure is a result of their organization’s data policy.
+
+## User controls
+
+:::image type="content" source="media/prompt-set-up.png" alt-text="Screenshot showing the setup text for a new scheduled prompt in Copilot." lightbox="media/prompt-set-up.png":::
+
+Your users can find the Scheduled prompts feature by hovering over a prompt they have submitted to Copilot. When a user selects the Save and activate button to confirm the scheduled prompt, a user's prompt information will be sent to the Power Automate and Power Platform system, and the [Power Automate terms of service and privacy policy](/power-platform/admin/wp-compliance-data-privacy) apply.
+
+To manage their Scheduled prompts, users can follow these steps:
+
+1. Hover over the prompt they have submitted to Copilot.
+2. Select the prompt management pane.
+3. From there, users can view and delete their scheduled prompts.
+
+Users can schedule up to 10 prompts to run at specific times, with responses delivered to the right rail of their Bizchat experience. These prompts can be set to run on a recurring basis, ensuring users receive necessary information aligned with their workflow. Responses from scheduled prompts are bolded and have a recurring icon to help users identify them easily.
+
+To learn more about prompts for your users, see [Learn about Copilot prompts](https://support.microsoft.com/topic/learn-about-copilot-prompts-f6c3b467-f07c-4db1-ae54-ffac96184dd5).
+
+## Opt in or out of preview
+
+If you’re interested in joining the preview, you must opt in. To be eligible, you must have:
+
+- Copilot license
+- Optional connected experiences admin toggle enabled
+- DLP policies configured to allow the Microsoft 365 Copilot connector in your default Power Platform environment
+
+You can start the opt-in process by submitting a support ticket and stating that you would like to join the Scheduled Prompts preview. Our engineers can help validate eligibility criteria and enroll you into the preview program.
+
+To opt out of the preview, you can similarly submit a customer support ticket requesting to opt out. To learn more about how to do this, see [Get support for Microsoft 365 for business](/microsoft-365/admin/get-help-support).

microsoft-365/admin/TOC.yml

@@ -277,6 +277,8 @@
               href: activity-reports/activity-reports.md
             - name: Active Users
               href: activity-reports/active-users-ww.md
+            - name: Agent usage in Microsoft 365 Copilot
+              href: activity-reports/agent-usage.md
             - name: Microsoft browser usage
               href: activity-reports/browser-usage-report.md
             - name: Microsoft 365 Copilot readiness

microsoft-365/admin/activity-reports/agent-usage.md

@@ -0,0 +1,114 @@
+---
+title: "Agent usage in Microsoft 365 Copilot"
+ms.author: camillepack
+author: camillepack
+manager: scotv
+ms.date: 10/02/2024
+audience: Admin
+ms.topic: concept-article
+ms.service: microsoft-365-copilot
+ms.localizationpriority: medium
+ms.collection: 
+- Tier2
+- scotvorg
+- M365-subscription-management
+- Adm_O365
+- Adm_NonTOC
+- m365copilot
+- magic-ai-copilot
+ms.custom: AdminSurgePortfolio
+search.appverid:
+- BCS160
+- MST160
+- MET150
+- MOE150
+description: "Learn about agent usage in Microsoft 365 copilot and gain insights into the Microsoft 365 Copilot activity in your organization."
+---
+
+# Microsoft 365 reports in the admin center – Agent usage in Microsoft 365 Copilot
+
+In the Microsoft 365 Copilot agent usage report, you can view the adoption of agents in Microsoft 365 Copilot in your org. For agent activity on a given day, the report becomes available within 72 hours of the end of that day (in UTC).
+
+> [!NOTE]
+> The report is currently limited to agents built by your org through Microsoft Copilot Studio or Teams Tool Kit (including admin-approved agents and agents created by users through agent builder). The report captures usage of agents in Business Chat (work) and Copilot in Word and PowerPoint. SharePoint agents and agents built by Microsoft and Microsoft partners are not yet included but will be added at a later date.
+
+## How do I get to the agent usage in Microsoft 365 Copilot report?
+
+1. In the admin center, go to Reports > Usage.
+1. Select the Microsoft 365 Copilot page.
+1. Select the Agent tab to view adoption and usage metrics.
+
+## Interpret the Microsoft 365 Copilot agent report
+
+You can use this report to see the usage of Copilot agents in your organization that were built by your organization and include agents that are approved by an admin and agents created via agent builder and shared with users in your org. Admins can manage agents in the same way as they manage any other app in the Integrated apps section of the Microsoft 365 admin center. Learn more in [Manage Copilot agents in Integrated Apps](/microsoft-365/admin/manage/manage-copilot-agents-integrated-apps).
+
+At the top, you can filter by different periods. The Microsoft 365 Copilot agent report can be viewed over the last 7 days, 30 days, 90 days, or 180 days:
+
+> [!NOTE]
+> Copilot agent data is only available starting Nov 1, 2024.
+
+:::image type="content" source="../../media/agents-hero-metrics.png" alt-text="Screenshot showing the active agents metrics for Microsoft 365 Copilot.":::
+
+**Active agents** shows the distinct number of apps with a declarative agent element in that app with at least one active user over the selected time period. For more information, see [Declarative agents FAQ](/microsoft-365/admin/manage/manage-copilot-agents-integrated-apps). As defined earlier, only agents that have been created by your org including both admin approved and shared by users in your org are included.  
+
+End-users interact with agents in two ways: either by at-mentioning the agent in a chat experience or by selecting the agent from the right-side panel in Business Chat or from the hamburger menu on the top left corner in Copilot in Word or PowerPoint. An active user of an agent is a user who sends a prompt request to an agent and receives a response.
+
+In Recommendations, the recommended action card suggests that admins visit the Integrated apps section of the Microsoft 365 admin center to explore and enable additional agents for users in their org.
+
+:::image type="content" source="../../media/agents-recommendation.png" alt-text="Screenshot showing the recommendation card for the Microsoft 365 Copilot usage report." lightbox="../../media/agents-recommendation.png":::
+
+To learn more about managing and enabling agents in your org, see [Manage Copilot agents in Integrated Apps](/microsoft-365/admin/manage/manage-copilot-agents-integrated-apps).
+
+You can see the following summary charts in this report as default view:
+
+:::image type="content" source="../../media/agents-summary.png" alt-text="Screenshot showing the summary chart for agent usage in Microsoft 365 Copilot." lightbox="../../media/agents-summary.png":::
+
+The definition of active agents is the same as provided earlier.
+
+You can switch between Summary view and Trend view.
+
+**Summary view** shows you the total number of agents that were actively used over the selected time frame.
+
+**Trend view** shows you the count of active agents on a daily basis over the selected time frame.
+
+:::image type="content" source="../../media/agents-trend-chart.png" alt-text="Screenshot showing the trend chart for agent usage in Microsoft 365 Copilot." lightbox="../../media/agents-trend-chart.png":::
+
+## Agent details table
+
+:::image type="content" source="../../media/agents-details.png" alt-text="Screenshot showing the detail table for agent usage in Microsoft 365 Copilot." lightbox="../../media/agents-details.png":::
+
+| Item | Description |
+| --- | --- |
+| Agent ID | An agent is an element of an app. The ID is the app identifier as present in the app manifest. |
+| Agent name | The name of the app as present in the app manifest. |
+| Active users in Copilot | The number of distinct users in your organization that are using the agent. |
+| Last activity date (UTC) | The date when that agent was last used by anyone in your organization. |
+
+> [!NOTE]
+> Due to system limitations, the Agents details table only displays admin-approved agents. Agents created and shared via Agent Builder are not yet included in the table, although usage of these agents does count towards the aggregated metrics displayed above the details section.
+
+## FAQ
+
+### Are agents created from Microsoft Copilot Studio and Teams Tool Kit included?  
+
+Yes. These are the agents that usage is reported for:
+
+- Agents created in Microsoft Copilot studio by users in your org and approved by admin.
+- Agents created in Teams Tool kit by users in your org and approved by admin.
+- Agents created by users through [agent builder](/microsoft-365-copilot/extensibility/copilot-studio-agent-builder) for users that have this feature enabled and shared with other users in your org.
+
+### Are agents published by Microsoft or Microsoft Partners included?
+
+No. Currently, the report does not include the usage of agents built by Microsoft or Partners.  
+
+### Why am I not seeing all the active agents in the Agent details table?  
+
+Due to system limitations, information about agents created by users through [agent builder](/microsoft-365-copilot/extensibility/copilot-studio-agent-builder) is not currently displayed in the details table. However, usage of these agents is included in the aggregated metrics above the table.
+
+### How can I see which users actively used specific agents?
+
+This information is not available in the report at this time, but may be added at a later date.  
+
+### How does agent usage impact overall Microsoft 365 Copilot usage?
+
+Agent usage is already included in the top-line Microsoft 365 Copilot usage number, as agents can only be used via Business Chat and Copilot in Office apps. Usage of these apps is already captured in the all-up Microsoft 365 Copilot usage report, which includes data for all features and functionalities of Copilot.