Knowledge Check

Knowledge Check is an AI-powered curriculum content item that assesses how deeply members have understood the content in a module through a live, adaptive conversation.

Overview

Knowledge Check replaces the traditional quiz with a conversation. Once started, Knowledge Check engages each member in a discussion based on the content they just completed to assess the members depth of understanding and ability to apply concepts in context.

With Knowledge Check, each member's experience is unique. Two members in the same Program may receive different questions depending on how they respond during the conversation. When the session ends, Knowledge Check generates a personalized evaluation with specific feedback and lesson recommendations.

Examples/Use Cases

Below are a few examples of when you may want to include a Knowledge Check within your curriculum.

Cohort course: A leadership development cohort uses Knowledge Check at the end of each module to verify that participants can apply frameworks to real workplace scenarios, not just describe them. The instructor reviews the admin report after each module closes to identify who needs additional support before the cohort moves on.

Membership community: A professional association includes Knowledge Check in its certification program. Members complete lessons at their own pace, and the Knowledge Check at the end of each module confirms comprehension before they advance to the next stage of the curriculum.

Bootcamp: A technical training bootcamp uses Knowledge Check after dense concept-heavy modules. Instructors use the per-member report to spot members who are at risk of falling behind and reach out proactively before the next live session.

Add a Knowledge Check to a Module

Knowledge Checks are added as a content item at the end of modules. Each module must contain at least one lesson before the Knowledge Check can function. You can add the item to an empty module, but both the admin and member views will display a warning until lessons are present. To add a knowledge check:

1. Navigate to your Program and open its Curriculum app.
2. Open or create the module where you want the Knowledge Check to live.
3. Click the + icon in the top-right corner of the module.
4. In the content modal, select Knowledge Check under the Content category.
5. The Knowledge Check is added to the end of the module automatically.

Only one Knowledge Check can exist per module. If a module already contains one, the option to add another appears as disabled. The Knowledge Check must remain at the end of the module and cannot be reordered above other content items.

Configure Knowledge Check Settings

Knowledge Check shares the same content settings as other curriculum items. Access these from the content's admin settings sidebar.

• Content label: Customize the display name shown to members. For example, rename "Knowledge Check" to "Comprehension Review" or any term that fits your Program.
• Thumbnail: Upload a custom image for how the item appears in the curriculum list.
• Time estimate: Enable a time estimate and set a custom duration, or use the AI-suggested estimate. This contributes to the module's total time estimate.
• Comments: Toggle comments on or off for the Knowledge Check item.
• Prerequisites: Require members to complete specific content items in the module before they can access the Knowledge Check.

There are no Knowledge Check-specific settings. The AI agent autonomously generates all questions from the module's lesson content. You do not write questions, configure scoring, or set time limits.

POV: Prerequisites are worth enabling if your module builds sequentially and earlier lessons are essential context for later ones. Requiring members to finish those lessons first ensures the Knowledge Check conversation is grounded in a complete picture of the material.

What Content Knowledge Check Uses

Knowledge Check generates questions from all lesson content in the module, including:

• Text and rich content within lesson bodies
• PDFs attached to lessons
• Video and audio transcripts attached to lessons
• Text added to the main body of assignments, quizzes, or surveys

Note: Member submissions, quiz answers, and survey responses are not included as source material.

How to Start a Knowledge Check (as a Member)

1. Navigate to the Program and open the Curriculum.
2. Open the module that contains the Knowledge Check.
3. Click the Knowledge Check item in the module's content list.
4. Read the greeting, which explains what to expect.
5. Click Start Knowledge Check to begin the conversation.
6. When the agent finishes the assessment, a completion message appears with a summary and a button to view the full evaluation.

If you started a Knowledge Check previously but did not finish, click Resume Knowledge Check to pick up where you left off.

You do not need to complete preceding lessons before starting a Knowledge Check unless the admin has configured prerequisites. If you skip lessons, the agent only asks about the content you have already completed.

Session Evaluation Report (as a Member)

When the assessment is complete, the evaluation opens in a drawer to provide feedback on how you're grasping the concepts. It includes:

• Assessment Summary: A narrative summary of your comprehension, written directly to you.
• Concepts Covered: The topics discussed during the session.
• Strengths: Specific areas where you demonstrated understanding.
• Gaps: Areas where understanding was incomplete or missing.
• Recommended Next Steps: Actionable suggestions with links to specific lessons to revisit.
• Session Transcript: A toggle in the drawer header shows or hides the full conversation. The transcript is private to you and is not visible to admins.

The evaluation is qualitative and a member will not see a numeric score or rating badge. The intention behind Knowledge Check is for the purpose of assessing where a member is at and how they can improve, rather than a formal assessment.

View Member Results (as Admin)

Once learners begin completing Knowledge Checks, you can view results from the Knowledge Check Insights button on the Knowledge Check itself. Please note that if you have viewed the Knowledge Check as an Admin using the 'view as Member' feature, your session results will not be populated in the results. 

1. Navigate to the Knowledge Check item in the module's content list.
2. Click View Member Completions.

Program-level report

The report opens in a drawer with the below insights:

• Headline stats: The number of completed sessions out of total enrolled members, a completion percentage, and the average comprehension score with a rating tier indicator.
• Score distribution: A bar chart showing how completed sessions are distributed across five comprehension tiers.
• Attention banner. A flag appears when a notable group of members would benefit from follow-up, with quick-action buttons to message those members directly.
• Per-member sessions table: A searchable, filterable, and sortable list of all enrolled members. Each row shows the member's status and comprehension score. You can filter, sort, and select members in bulk to send a message or add them to a group, Program, or pathway. Click any row to open that member's individual report.

Individual Member Report

When you open a specific member's report, you see the same insights the member sees, except for the session transcript. The report includes the member's comprehension rating badge, assessment summary, strengths, gaps, recommended next steps with links to specific lessons, and the concepts covered.

Click Send a Message to send the member an email or Slack message, or click their avatar to send them a direct message in Disco.

How comprehension is scored

Every Knowledge Check session is scored on a 1–5 comprehension tier, generated by the AI agent based on the full conversation rather than a single right/wrong answer.

Numerical scores are not visible to learners. Learners only see qualitative feedback (assessment summary, strengths, gaps, and recommended next steps). This keeps the experience coaching-oriented rather than pass/fail.

Note: The report is available before any sessions are completed. All enrolled members appear with a "Not Started" status until they begin.

FAQ

Can I add a Knowledge Check to an empty module? 

You can add the item, but the AI agent requires lesson content to generate questions. Both the admin and member views display a warning if the module has no lessons. Add at least one lesson before members access the Knowledge Check.

Can I add more than one Knowledge Check per module? 

No. Only one Knowledge Check can exist per module. If a module already contains one, the option to add another is disabled.

Can I move the Knowledge Check to a different position in the module? 

No. A Knowledge Check must be positioned at the end of a module. It cannot be reordered above other content items.

Do members need to complete all lessons before taking the Knowledge Check? 

Not by default. The agent only asks about content the member has already completed. If a member skips to the Knowledge Check without finishing all lessons, the session covers only what they have done. To enforce order, enable prerequisites on the Knowledge Check.

How is completion recorded? 

Completion is automatic. When the agent finishes the assessment, the content item is marked complete for the member. There is no manual "mark as complete" action.

Can a member retake a Knowledge Check? 

No. Each Knowledge Check produces one assessment per member. Once complete, it cannot be retaken.

What happens if a member leaves mid-session? 

The session is saved and the member can resume where they left off. Incomplete sessions expire after 30 days, at which point the member can start a new session. Completed assessments do not expire.

Who can see the conversation transcript? 

Only the member can see the session transcript. Admins can view the assessment summary, strengths, gaps, and recommended next steps, but the conversation itself is private to the member.

Can I customize the questions the agent asks? 

No. The AI agent generates all questions autonomously from the module's lesson content. Admins do not write questions or configure the assessment logic.

Is Knowledge Check available on mobile? 

Yes. Members can complete a Knowledge Check on the Disco mobile app.

Is there a passing score requirement? 

No. There is no passing threshold for a Knowledge Check. Completion is recorded automatically when the agent finishes the conversation, regardless of the member's comprehension level. The evaluation provides qualitative feedback, not a pass or fail result.