AppSource / Partner Center test instructions

Use this checklist to validate Per My Last Webhook end-to-end in a Microsoft 365 test tenant. Expected time: about 10 minutes after admin consent.

Prerequisites

• A Microsoft 365 tenant with Teams enabled.
• A Global Administrator or Cloud Application Administrator account to grant admin consent.
• A Teams channel where you can add apps (or a Teams Workflows incoming-webhook URL).

1 · Install and consent

1. Open Microsoft Teams → Apps → search Per My Last Webhook → Add (or use the install link from our website).
2. Complete admin consent when prompted. See admin consent if needed.
3. Assign the Connector Admin role to the account you will test with: Entra admin center → Enterprise applications → Per My Last Webhook → Users and groups → Add user/group → role Connector Admin. Consent does not assign it. (An account we provide for review already holds the role.)
4. Open the app. Confirm the Setup tab loads without sign-in, then open Subscriptions and sign in with SSO.

Expected: No "not installed" or AADSTS consent errors. From the Subscriptions tab, click Diagnostics in the top nav — all checks report green. (Diagnostics is a page inside the admin UI, not a separate Teams tab.)

2 · Create a subscription

1. Go to Subscriptions → New subscription.
2. Name: AppSource validation. Platform: Generic (or any platform).
3. Destination: pick a Teams channel (add the bot to the channel first) or paste a Teams Workflows webhook URL.
4. Save and copy the ingest URL (includes a secret key).

Expected: Ingest URL is shown once; subscription appears in the list.

3 · Fire a test card

1. On the subscription, click Test.
2. Confirm an Adaptive Card appears in the chosen destination within a few seconds.

Expected: Card shows synthetic build metadata (status, branch, duration). No duplicate cards on retry.

4 · Optional: webhook ingest

1. POST a sample JSON body to the ingest URL from step 2 (platform generic with a configured field mapping, or a named platform payload — see platform reference).
2. Confirm a second card is delivered and normalized correctly.

5 · Audit and uninstall

1. From Subscriptions, click Audit log in the top nav — subscription creation should be recorded with your UPN.
2. Delete the test subscription.
3. To fully remove the app: Entra admin center → Enterprise applications → remove Per My Last Webhook.

Expected: Removing the enterprise application stops new sign-ins. It does not delete the tenant's data: that is kept until an admin asks for deletion, as the Privacy Policy describes.

Support during review

If validation fails, email hello@permylastwebhook.com with your tenant id, the failing step, and a screenshot of the Diagnostics page (Subscriptions tab → Diagnostics in the nav). Security: security@permylastwebhook.com.