# ✅ Assess
Totum Assess is where reviewers complete blinded, structured assessments of surgical videos against frameworks published in Totum Forms, and where programme administrators manage cases, settings, and exports.
Assess uses your Totum platform account and organisations. Cases usually start when someone submits a video from Totum Video Library. Assess is a separate product from Totum itself.
# What it is
Assess provides:
- 📋 My Assignments for reviewers — accept or decline cases, score video against a frozen framework, submit
- 📩 My feedback for submitters — when your programme enables submitter results
- ⚙️ An admin hub — cases, programme settings, roles, export, case registry
- 🕶️ Blinding — reviewers do not see the submitter’s identity while scoring
- 🎬 Integration with Video Library — most cases start when a surgeon chooses Assessors and clicks Submit for Assessment
Assess does not author frameworks (use Forms) and does not replace informal Video Library discussion (use Video Library).
flowchart LR VL["Video Library\nSubmit for Assessment"] Case["Case created"] Assign["Assignments"] Score["Blinded scoring"] Done["Completed / feedback"] VL --> Case --> Assign --> Score --> Done
# Who it’s for
| You | Typical use |
|---|---|
| 👁️ Reviewer | Complete assigned assessments |
| ⚙️ Admin | Configure frameworks and roles, oversee cases, export data |
| 🩺 Submitter / surgeon | Usually work in Video Library; may open Assess My feedback when enabled |
Display labels such as “Surgeon”, “Trainee”, or “Reviewer” can be renamed in programme Settings without changing the underlying permissions.
# ⚡ Quick start for reviewers
- Sign in to Assess and confirm the correct organisation.
- Open Assignments (My Assignments).
- Under Pending, open a case and Accept (or Decline with a reason).
- Start the assessment when ready.
- Watch the video and score each required framework item (steps and any GRS items). Progress auto-saves.
- When all required fields are complete, Submit the assessment. It locks as completed.
🕶️ You will not see who submitted the video — that is intentional (blinding).
# ⚡ Quick start for administrators
- Sign in to Assess as an admin.
- Open Settings and select the default published framework version (and any activity/category routing your programme uses).
- Open Roles and map the correct identity groups to Admins and Reviewers.
- Confirm Video Library seats and connections are set up so surgeons can pick assessors (see Video Library).
- Use Cases and the admin Dashboard to monitor progress; use Export when you need programme data.
For enabling submitter-facing results, see Programme settings and Example workflow 4.
# 🖥️ Screens
# For reviewers
| Screen | Purpose |
|---|---|
| 📋 Assignments | Lists Pending, In Progress, and Completed assignments; accept / decline; start review |
| 🎯 Assessment | Side-by-side video and scoring form for one assignment |
# For submitters (when enabled)
| Screen | Purpose |
|---|---|
| 📩 My feedback | Completed reviews for videos you submitted |
# For administrators
| Screen | Purpose |
|---|---|
| 🏠 Dashboard | Overview: case counts, recent activity (peer mode) or workload views (legacy mode) |
| 📁 Cases | Unblinded case list with status filters; expand to see assignments |
| 🔎 Case detail | Single case: video, assignments, framework info; manual assign tools appear only in legacy auto-assign mode |
| ⚙️ Settings | Programme-wide configuration (framework routing, labels, results, legacy toggle, and more) |
| 📤 Export | Download assessment data as CSV or JSON (blinded or unblinded options) |
| 🗂️ Case registry | Programme-wide case list; retag organisations; archive or delete untagged cases as allowed |
| 🔐 Roles | Map identity groups to Admins and Reviewers |
| 👥 Reviewers | Legacy reviewer pool management — only when Legacy auto-assign is enabled; otherwise use Roles + seats |
Landing behaviour: admins typically land on the admin dashboard; reviewers on Assignments; other users may be sent to My feedback when results are enabled.
# 📦 How cases and assignments work
| Concept | Meaning |
|---|---|
| 📁 Case | One video submission under review |
| 📋 Assignment | One reviewer’s job on that case |
| 🎯 Assessment | The completed (or in-progress) scores for an assignment against a framework snapshot |
# Typical case statuses
stateDiagram-v2 [*] --> PendingAssignment: Case created PendingAssignment --> InAssessment: Reviewers engage InAssessment --> Completed: Rules satisfied PendingAssignment --> NeedsAttention: Problem InAssessment --> NeedsAttention: Problem NeedsAttention --> InAssessment: Resolved
| Status | Meaning |
|---|---|
| Pending Assignment | Waiting for reviewers to be in place / to engage |
| In Assessment | Review work is underway |
| Completed | Finished according to programme rules |
| Needs Attention | Something requires an admin (for example assignment problems) |
# Typical assignment statuses
stateDiagram-v2 [*] --> Pending Pending --> Accepted: Accept Pending --> Declined: Decline Accepted --> InProgress: Start InProgress --> Submitted: Submit scores
# How reviewers are chosen
| Mode | Who picks reviewers | Notes |
|---|---|---|
| 👥 Explicit peer (default) | The surgeon in Video Library selects Assessors at submit time | No admin pool “Reviewers” page |
| 🤖 Legacy auto-assign | System assigns from a reviewer pool (with exclusions / workload rules) | Enables the Reviewers admin page and manual / retry assign tools |
Toggle legacy mode carefully in Settings — it changes both behaviour and which admin screens appear.
# 🛠️ How-tos
# Complete an assignment (reviewer)
- Open Assignments.
- Expand Pending and select a case. Read any stage guidance offered on the page.
- Accept to take the assignment, or Decline and provide a reason.
- Choose to start now or continue later.
- On the Assessment page:
- Play the video (streaming where available).
- Complete required Likert / field items for steps and GRS.
- Use auto-save; you can leave and return while In Progress.
- Submit when the form reports complete. The assignment moves to Completed.
# Find your work after switching organisation
Assignments and case lists are scoped to the current organisation. If an assignment you expect is missing, check the organisation switcher. Programme Settings, Roles, and Case registry behaviour is programme-wide (not per-org) — on-screen notices explain this where relevant.
# Configure programme settings
Open Settings as an admin. Typical controls include:
| Area | What it does |
|---|---|
| Default framework version | Which published Forms version to use when a case is created |
| Activity / category routing | Optional mapping so different activity types use different framework versions |
| Reviewers per case | Relevant especially for legacy / pool assignment |
| Display names | Relabel “Reviewer”, “Admin”, “Member / surgeon” style terms in the UI |
| Submitter results | Whether submitters can see pages/APIs for results; Video Library notifications; visibility (full, status only, or hidden) |
| Legacy auto-assign | Switch between peer-pick and pool auto-assign |
| Reference cache refresh | Refresh Totum platform activity reference data used by routing |
After educators publish a new Forms version, update Settings if you want new cases to use it.
# Map roles (access)
- Open Roles.
- Map identity groups to Admin and Reviewer (reviewer-eligible) roles.
- Confirm your own groups appear as expected (“Your groups” style help on the page).
Having a Video Library Assess Reviewer seat and being mapped as a Reviewer in Assess Roles are related but separate — both usually need to be correct for a smooth peer-submit experience. See Roles and permissions.
# Monitor cases
- Open Cases.
- Filter by status.
- Expand a row or open Case detail for assignment-level status (unblinded for admins).
# Export results
- Open Export.
- Choose blinded (pseudonymous reviewers) or unblinded (includes surgeon identity fields as offered).
- Download CSV or JSON for analysis or reporting.
# Use the case registry
Use Case registry for programme-wide oversight: find cases across organisations, retag organisation where supported, and clean up untagged cases according to the tools available on that page.
# 🕶️ Blinding
- Reviewers do not see submitter identity while assessing.
- Admins see unblinded information on Cases and can export unblinded data.
- Submitters see their own feedback when the programme allows it — that is not a blinding break for reviewers.
flowchart TB Reviewer["Reviewer view"] Admin["Admin view"] Submitter["Submitter view"] Reviewer -->|"Blinded video + scores"| Blind["No submitter identity"] Admin -->|"Cases and exports"| Full["Full identity available"] Submitter -->|"Own feedback when enabled"| Own["Sees own results only"]
# 💡 Tips and common gotchas
- Cases usually start in Video Library, not inside Assess. If no cases appear, check that submissions are happening and that you are in the right organisation.
- No framework configured — admin dashboards may warn that a default framework version is missing. Fix this in Settings before expecting clean scoring.
- Wrong framework on new cases — publish in Forms, then update Assess Settings; existing cases keep their original snapshot.
- Legacy vs peer mode — if the Reviewers pool page is missing, legacy auto-assign is probably off (the default). That is expected for peer pick.
- Seat vs Roles — a person may hold an Assess seat but still need the Reviewer mapping (and connections) to appear in Video Library’s assessor picker.
# Related chapters
- Getting started
- Video Library — submit for assessment
- Forms — publish frameworks
- Example workflows
- Roles and permissions
- Glossary