A training course may end in what appears to be an ideal way: high engagement, correct answers, good post-test results, high satisfaction with the trainer, and a clear feeling among participants that they acquired new knowledge and skills.

But the more important question begins after the program ends:

Did the trainee actually learn?

The question may seem simple, yet it touches one of the most complex issues in learning science and training: good performance during training does not necessarily mean that durable learning has occurred, and a trainee’s feeling that they understood the content does not necessarily mean they can recall or apply it when needed in the workplace.

This is where the phenomenon known as the “Illusion of Competence” appears: a state in which a person’s estimate of their knowledge or ability becomes higher than their actual level of mastery.

This phenomenon is especially important in institutional training because it can make a program appear successful according to visible indicators while failing to produce the expected level of change in performance.

This article therefore raises a fundamental question:

In our training programs, are we measuring what the trainee actually learned, or only what they were able to perform while the content was still fresh and present before them?

In the context of learning, the illusion of competence refers to a mismatch between Perceived Competence and Actual Competence.

In other words, a trainee may believe they know something or can perform a particular task to a greater degree than their actual ability reveals under independent assessment.

This does not necessarily mean that the trainee is deliberately exaggerating their abilities; their estimate may be entirely sincere but based on inaccurate cues.

They may feel that they have mastered the content because they:

• ✓Understood the trainer’s explanation easily.
• ✓Recognized the correct answer when they saw it.
• ✓Performed the activity while instructions and guidance were available.
• ✓Watched the trainer perform the skill professionally.
• ✓Repeated the task immediately after it was explained.
• ✓Scored highly on a test administered soon after the content was presented.

Yet these indicators may measure processing fluency, familiarity, or immediate performance more than durable learning.

This reveals one of the most important distinctions training designers should understand:

Recognizing knowledge is not the same as being able to recall it, and recall is not the same as being able to use it in a new situation.

Learning science distinguishes between two concepts that are often confused:

What the learner can demonstrate during practice or immediately after training.

A more enduring change in knowledge or ability that can be inferred from retention of performance or transfer to later situations.

Soderstrom and Bjork have shown that conditions that improve performance during practice are not always the same conditions that produce the best long-term learning.

This is critically important in training.

A trainer may provide an exceptionally clear explanation, followed by graduated examples, and then allow trainees to complete an exercise that closely resembles the example.

The results will often look good.

But what happens if, two weeks later, the trainee is asked to solve a different problem without assistance?

That is where the real test of learning begins.

Accordingly, the following equation can be stated:

A training program may produce a Performance Gain during the session without necessarily producing the same degree of Durable Learning.

1. Familiarity

When a trainee sees a concept or model repeatedly, they begin to feel that they know it.

But seeing information and knowing it when it appears is different from being able to produce it from memory.

This is the difference between:

A trainee may know the correct answer when it appears among four options, yet be unable to produce the same answer when asked without choices.

2. Processing Fluency

The easier content becomes to read and understand, the more a learner may feel they have mastered it.

This creates an important paradox:

Perceived ease of learning is not always evidence of strong actual learning.

A well-organized presentation, a capable trainer, and clear examples are all important, but removing every difficulty from the learning experience can turn the trainee into a comfortable recipient rather than an active learner.

3. Excessive Support During Training

A trainee may perform a task extremely well when the following are available:

the steps, the model, the trainer, peers, instructions, and previous examples.

But the question is:

What remains of this performance when those supports are removed?

The more a trainee’s success depends on external support, the more cautious we should be about interpreting that success as mastery.

One important distinction in this field, introduced by Bjork and Bjork, is between:

The strength with which knowledge is stored in memory.

How easily that knowledge can be accessed at a particular moment.

Information may feel familiar and be easy to recall immediately after training because the trainee encountered it only minutes earlier, so retrieval strength is temporarily high.

But as time passes and retrieval becomes less easy, it becomes clearer whether the knowledge has been consolidated strongly enough to be recovered.

For this reason, testing a trainee immediately after an explanation may produce a very different picture from testing them after a period of time.

Time therefore becomes part of the validity of training assessment, not merely an organizational matter.

The illusion of competence is closely related to Metacognition—the ability of a person to monitor, evaluate, and judge their own knowledge and learning.

An important concept here is:

the degree of correspondence between:

what a person believes they know

and what they can actually demonstrate that they know.

The closer these two are, the better the calibration.

For example, a trainee may say:

“I am 90% sure that I have mastered this skill.”

Then an independent assessment may reveal that their performance does not exceed 55%, showing a clear calibration gap.

That gap itself can become a meaningful and measurable training datum.

One important shift in learning science is that testing is no longer viewed only as a way to assess learning; it can also be a way to improve learning.

Research on Retrieval Practice has shown that attempting to retrieve knowledge from memory can, in many circumstances, support retention better than simply restudying the material.

This means that asking a trainee:

“Close the material and write the five steps from memory.”

may be more valuable for learning than:

“Read the five steps again.”

Testing here becomes a Learning Event, not merely an Assessment Event.

It may appear through a number of indicators, such as:

• ✓High confidence with weak independent recall.
• ✓Success on multiple-choice questions but failure on open-ended questions.
• ✓Successful task performance with a model, followed by failure when the model is removed.
• ✓Success on a familiar example but failure in a new situation.
• ✓A high immediate post-test score followed by lower performance weeks later.
• ✓Knowing a concept theoretically but being unable to use it in a professional decision.

Therefore, the only question should not be:

Did the trainee answer correctly?

Rather:

Under what conditions were they able to answer?

A practical diagnostic approach can be built through five sequential stages:

Before the assessment, the trainee rates their confidence in mastering the skill from 0 to 100%.

They are asked to retrieve the knowledge or perform the task without referring to the training material.

The models, guidance, and examples that were available during training are removed.

The trainee faces a new situation that differs from the example used in training but requires the same principle or skill.

Part of the assessment is repeated after an appropriate period, such as 7, 30, or 60 days, depending on the nature of the skill.

True mastery can therefore be viewed as the result of four dimensions coming together:

rather than merely succeeding on an immediate post-test.

Organizations can add a simple indicator to their training-evaluation system:

Example:

Perceived confidence = 90%

Actual performance = 62%

Therefore:

Calibration gap = +28 percentage points

The wider the positive gap, the greater the possibility that confidence exceeds demonstrated competence.

However, this indicator should be treated as a diagnostic tool rather than a final judgment, because the quality of the assessment itself, the nature of the skill, and the measurement context all affect the result.

This article proposes a shift in the philosophy of training evaluation.

Instead of asking:

Can the trainee perform the task?

we ask a more precise question:

Can the trainee perform it correctly and independently, after time has passed, and in a context different from the training context?

Four levels can be envisioned:

The trainee recognizes the concept when they see it.

The trainee can retrieve it without an external source.

The trainee can use it without direct guidance.

The trainee can use it in a new or unfamiliar situation.

This fourth level comes closest to the professional value of training.

The aim is not to complicate content or deliberately exhaust the trainee.

However, some carefully designed learning difficulties can be beneficial; this is related to the concept of Desirable Difficulties.

Examples include:

• ✓Spacing practice over time.
• ✓Attempting retrieval before returning to the material.
• ✓Varying the contexts of application.
• ✓Interleaving different types of problems.
• ✓Requiring the learner to generate and solve before being given the complete answer.

Immediate performance may decline in some of these conditions, while later retention and transfer may improve.

This changes the philosophy of training design:

The goal is not for the trainee to feel that everything is easy, but to create conditions that make learning more durable and usable.

A professional trainer should not rely solely on their impression of trainee engagement.

During the program, the trainer can ask:

Am I testing recall or recognition?

Can the trainee solve the task without the model?

Have I given them a new situation?

Did I provide the answer too quickly?

Am I measuring their confidence before revealing the result?

Will I know what remains of their learning after the course ends?

These questions shift the trainer’s role from content presenter to engineer of learning conditions.

The issue becomes even more important at the institutional level.

If an organization measures training success through:

attendance, number of hours, program completion, participant satisfaction, and the immediate post-test;

it may in fact be measuring the quality of the training experience more than the durability of learning.

This does not make those indicators worthless, but they are not sufficient on their own to judge mastery.

Organizations therefore need to add indicators such as:

• ✓Knowledge retention after a period of time.
• ✓Independent application.
• ✓Transfer of the skill to new situations.
• ✓Accuracy of the employee’s estimate of their competence.
• ✓Error rate after training.
• ✓Need for support after the program.
• ✓Sustained performance over time.

The central idea of this article can be summarized in one training rule:

Do not judge the strength of learning while the information, examples, guidance, and trainer are still present in the trainee’s memory and environment.

The real test begins when:

time passes,

support disappears,

the situation changes,

and the trainee must recall, decide, and apply independently.

Only then do we come closer to knowing whether the program has produced usable learning.

One of the greatest challenges in training is not that the trainee fails to learn, but that the training experience succeeds in convincing them that they learned more than they can later demonstrate.

Satisfaction is not mastery.

Familiarity is not knowledge.

Recognition is not recall.

Recall is not application.

Immediate performance is not necessarily durable learning.

Improving training therefore requires redefining the question we ask after every program.

Instead of:

Did the training program succeed?

the more scientific question may be:

What can the trainee recall and apply independently after time has passed, circumstances have changed, and support has disappeared?

When this question becomes part of training design and evaluation, we move from measuring the training experience to verifying that learning has occurred, and from focusing on what happened inside the training room to focusing on what remained afterward.

This shift can distinguish training that delivers temporary knowledge from training that builds sustainable professional capability.

Bjork, E. L., & Bjork, R. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In M. A. Gernsbacher et al. (Eds.), Psychology and the real world: Essays illustrating fundamental contributions to society. Worth Publishers.

Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58.

Karpicke, J. D., & Roediger, H. L., III. (2008). The critical importance of retrieval for learning. Science, 319(5865), 966–968.

Roediger, H. L., III, & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255.

Soderstrom, N. C., & Bjork, R. A. (2015). Learning versus performance: An integrative review. Perspectives on Psychological Science, 10(2), 176–199.