ASSESSMENT QUALITY & COMPLIANCE

RTO Assessment Tool Review, Pre-Assessment and Validation Support

A well-designed assessment tool must do more than contain questions, tasks and mapping. It must enable an assessor to gather sufficient evidence and make a valid, reliable and defensible judgement about each student's competency.

Compliwise provides independent assessment system reviews, pre-use assessment tool reviews, mapping reviews, validation and assessment rectification support for Australian RTOs.

Our reviews examine whether assessment requirements are correctly interpreted, translated into appropriate assessment activities and supported by clear instructions, evidence requirements and assessment decision-making guidance.

Discuss your assessment review requirements

Is your assessment system fit for purpose?

An assessment tool may appear comprehensive but still fail to produce the evidence required by the training product.

Common problems include assessment tasks that do not reflect workplace performance, knowledge questions that do not address the required depth, observation tools that rely on generic tick boxes, incomplete assessment conditions and mapping that identifies a location without confirming the requirement has actually been assessed.

These issues may not become visible until the tool is used, validation is conducted or assessment evidence is requested during an audit.

An independent assessment review helps identify these issues before they affect students, assessment judgements or the integrity of certification.

Pre-assessment review before an assessment tool is used

For this service, pre-assessment review means reviewing an assessment tool before it is approved and used to assess students.

Standard 1.3 requires an RTO to demonstrate that:

  • assessment is consistent with the requirements of the training product;

  • assessment tools are reviewed before use to ensure assessment can be conducted consistently with the principles of assessment and rules of evidence; and

  • review findings inform any necessary changes to the assessment tools.

A pre-assessment review provides the RTO with an opportunity to identify and rectify design weaknesses before assessment commences.

It should be more than the completion of a generic checklist. The review needs to examine the actual training product, assessment tasks, evidence requirements, assessor instructions, student instructions, marking guidance and intended assessment environment.

What a pre-assessment review considers

Depending on the training product and assessment context, the review may examine whether:

  • all requirements of the training product have been addressed;

  • the assessment reflects the elements and performance criteria;

  • performance evidence is assessed in full;

  • knowledge evidence is assessed at the required breadth, depth and complexity;

  • assessment conditions are correctly implemented;

  • foundation skills are addressed where relevant;

  • practical skills are demonstrated through appropriate performance;

  • required observations occur in the correct environment;

  • the tool reflects current workplace practices;

  • assessment activities are suitable for the relevant student cohort;

  • reasonable adjustment can be implemented without compromising competency requirements;

  • student instructions clearly explain what must be completed;

  • assessor instructions support consistent implementation;

  • decision-making criteria explain what satisfactory performance looks like;

  • evidence requirements support valid, sufficient, authentic and current evidence;

  • mapping accurately reflects what is contained within the assessment tool;

  • supporting resources, scenarios, templates and equipment are available;

  • reassessment arrangements are clear; different delivery methods maintain the same competency standard; and the tool can be implemented consistently across different assessors and locations

Pre-assessment review methods

The method used should reflect the nature, risk and complexity of the assessment. A review may include:

Technical review

Detailed analysis of the assessment tool against the unit of competency, qualification, skill set, accredited course or other relevant training product requirements.

Assessment trial

Trialling the assessment with people who have characteristics or abilities similar to the intended student cohort to identify unclear instructions, unrealistic expectations or implementation difficulties.

Industry review

Consultation with people who understand current workplace practices to confirm that assessment activities are realistic, current and relevant to the work being assessed.

Mapping verification

Independent checking that mapping is accurate and that every mapped requirement is actually assessed to the required standard.

Assessor moderation

Review by trainers and assessors with current vocational knowledge to examine how the tool will be interpreted and implemented.

Implementation review

Review of the proposed assessment environment, timing, resources, equipment, workplace access, placement arrangements and assessor responsibilities.

The review method and findings should be documented, and identified changes should be completed before the tool is approved for use.

Assessment tool review services

Full assessment tool review

A detailed review of the complete assessment tool, including:

Student Instructions

Assessor Instructions

Assessment Tasks

Practical Activities

Observation Tools

Evidence Requirements

Reasonable Adjustment Guidance

Knowledge Questions

Benchmarks & Model Answers

Mapping

Supporting Resources

Marking Guides

Reassessment instructions

Third-party Reports

Assessment mapping review

A mapping review examines more than whether a training product reference has been entered into a table. It considers whether:

  • the mapped task genuinely assesses the requirement;

  • the entire requirement has been addressed;

  • the evidence is observable or measurable;

  • the expected response or performance is defined;

  • requirements are assessed in the correct context;

  • knowledge and performance are integrated where appropriate;

  • assessment conditions are reflected in the tool; and

  • the mapping is consistent with the student and assessor materials.

Knowledge assessment review

Practical assessment must allow students to demonstrate the required skills under the conditions described by the training product. The review may consider:

  • whether direct observation is required;

  • whether the assessment environment is suitable;

  • whether equipment, resources and workplace conditions are available;

  • whether the student must perform the task on more than one occasion;

  • whether different situations, contexts or people must be involved;

  • whether the observation criteria are measurable;

  • whether the assessor can record the quality of the performance;

  • whether each student can be assessed individually;

  • whether simulation is permitted and sufficiently realistic; and

  • whether the assessment establishes a direct link between the student's performance and the competency judgement.

Knowledge questions are reviewed to determine whether they require students to demonstrate the knowledge described by the training product. The review may examine:

  • the breadth and depth of required knowledge;

  • whether questions are clear and unambiguous;

  • whether the expected response is measurable;

  • whether model answers are accurate and complete;

  • whether assessor guidance supports consistent judgement;

  • whether questions merely repeat performance tasks;

  • whether the assessment requires understanding rather than guessing; and

  • whether the knowledge is assessed within an appropriate vocational context.

Project and Case Studies

Practical and observation assessment review

Generic tick-box observation checklists may not provide sufficient information to confirm what the student did, how effectively it was performed or whether the required standard was achieved.

Purchased assessment tool review

Purchasing an assessment resource does not transfer the RTO's responsibility for ensuring that it is fit for purpose. Compliwise can review purchased or externally developed assessment tools to determine whether they:

  • align with the current training product;

  • are complete and technically accurate;

  • suit the RTO's delivery model;

  • reflect the relevant student cohort;

  • align with industry and workplace contexts;

  • include the resources required for implementation;

  • support the principles of assessment and rules of evidence; and

  • require contextualisation or redevelopment before use

Online and blended assessment review

Assessment tools designed for face-to-face delivery may not automatically be suitable for online or blended delivery. The review can examine:

  • student identity and authentication;

  • authenticity of submitted evidence;

  • online observation arrangements;

  • practical skill demonstration;

  • assessor access to required evidence;

  • technological requirements;

  • accessibility;

  • student instructions;

  • assessment security;

  • academic integrity controls; and

  • whether the same competency standard is maintained across delivery modes.

Recognition of prior learning is an assessment pathway and must still produce valid, sufficient, authentic and current evidence. An RPL review may examine:

  • candidate information;

  • assessor information;

  • workplace supervisor information;

  • evidence guidance;

  • assessor interview questions;

  • competency conversations;

  • challenge activities;

  • practical observation;

  • third-party evidence;

  • evidence mapping;

  • assessor decision-making guidance;

  • gap assessment processes; and

  • how the final competency judgement is documented.

RPL assessment review

Employment history, résumés, position descriptions and workplace documents may support an RPL application, but they do not automatically confirm that the candidate can currently perform every requirement of the training product.

Assessment validation

Validation is different from a pre-assessment review.

A pre-assessment review examines whether an assessment tool appears capable of producing valid assessment before it is used. Validation examines assessment practices and judgements after the assessment system has been implemented. This includes reviewing completed assessment evidence and determining whether the assessment system produced judgements that were consistent with the training product and applicable assessment requirements.

Compliwise can support:

  • validation planning;

  • training product risk assessment;

  • selection of units and assessment components;

  • determination of appropriate sample sizes;

  • selection and preparation of validators;

  • validation facilitation;

  • review of completed student assessment evidence;

  • review of assessment practices and judgements;

  • documentation of findings;

  • analysis of patterns or systemic issues;

  • development of validation actions; and

  • monitoring of identified improvements.

Under Standard 1.5, each training product on an RTO's scope must be validated at least once every five years and more frequently where risks, training product changes or stakeholder feedback indicate that additional validation is required. The scope and sample are to be determined using a risk-based approach.

What validation examines

A validation activity may consider whether:

  • assessment was implemented as designed;

  • assessment evidence was retained and available;

  • students received clear instructions;

  • assessment conditions were met;

  • reasonable adjustments maintained assessment integrity;

  • assessors applied the benchmarks consistently;

  • practical evidence demonstrated the required skills;

  • knowledge evidence was adequate;

  • evidence was valid, sufficient, authentic and current;

  • assessment judgements were justified;

  • different assessors made comparable judgements;

  • the sample reflects relevant student, assessor and delivery variations;

  • issues are isolated or systemic; and

  • previous validation actions were implemented and effective.

Validators need access to the same evidence used by the assessor to make the original assessment judgement. Reviewing only a blank assessment tool does not validate completed assessment practices and judgements.

Assessment system health checks

An assessment system includes more than individual assessment tools. A broader review may examine:

Assessment policies and procedures

Design and approval processes

Pre-assessment review controls

Assessment tool register

Version control

Reassessment

Risk assessment

Corrective actions

Moderation

Assessment retention

Validation records

Risk assessment

Assessor implementation

Student identity

Governance oversight

Validation planning

Contextualisation arrangements

Assessor allocation

Appeals

Academic integrity

This helps determine whether assessment quality is supported systematically rather than relying on the knowledge and diligence of individual assessors.

Assessment rectification support

Where a review or validation identifies a problem, the RTO needs to determine the extent of the issue and the action required. Compliwise can assist with:

  • prioritising findings;

  • identifying affected units, cohorts or students;

  • determining whether the issue is limited or systemic;

  • increasing the assessment sample where necessary;

  • revising assessment tools and mapping;

  • strengthening assessor guidance;

  • developing supplementary assessment;

  • reviewing previous competency judgements;

  • updating policies and procedures;

  • recording actions in the continuous improvement system;

  • assigning responsibilities and completion dates; and

  • checking whether implemented changes are effective.

Changes should be controlled so the RTO can identify which version was used for each student and when the revised tool was approved.

How the review process works

2
1

Confirm the scope

We identify the training products, assessment tools, delivery contexts, student cohorts and concerns to be reviewed.

Examine the training product

The applicable unit requirements, assessment requirements, packaging rules, companion guidance and relevant industry expectations are identified.

3

Review the assessment materials

The assessment tasks, instructions, benchmarks, evidence requirements, mapping and supporting resources are examined

Test assessment coverage and implementation

We determine whether the tool can produce the evidence needed and whether it can be implemented consistently in the intended environment.

4
5

Report the findings

Findings distinguish between critical gaps, compliance risks, usability problems and improvement opportunities.

6

Support rectification

Where required, Compliwise can help revise the assessment materials, strengthen mapping, develop actions and complete a final quality review.

Information and materials that may be reviewed

Depending on the scope, we may review:

Training and assessment strategies

Units of competency

Qualifications and skill sets

Accredited course documents

Companion volume guidance

Marking guides

Risk assessment

Assessment version registers

Assessment appeals

Continuous improvement records

Validation schedules

Completed student assessments

Simulation arrangements

Workplace assessment requirements

Validation reports

Reasonable adjustment guidance

Mapping documents

Assessor guides

Projects and case studies

RPL tools

Assessment plans

Student assessment tools

Model answers

Practical observation tools

Who this service is for

This service may be suitable for:

  • RTOs developing new assessment tools;

  • RTOs purchasing assessment resources;

  • RTOs adding training products to scope;

  • RTOs preparing to commence delivery;

  • RTOs reviewing tools before use;

  • RTOs preparing for registration or re-registration;

  • RTOs responding to assessment concerns or audit findings;

  • RTOs transitioning to updated training products;

  • RTOs reviewing online or blended assessment;

  • RTOs strengthening their RPL system;

  • RTOs requiring independent validation; and

  • RTOs seeking greater confidence in assessment quality.

Expected outcomes

An independent assessment review can support:

  • greater confidence that assessment addresses the training product;

  • stronger evidence of pre-assessment review;

  • clearer student and assessor instructions;

  • more measurable assessment criteria;

  • stronger practical and observation requirements;

  • more accurate mapping;

  • more consistent assessment implementation;

  • better supported competency judgements;

  • stronger validation processes;

  • earlier identification of assessment risk;

  • clear rectification priorities; and

  • improved governance visibility of assessment quality.

Frequently Asked Questions

  • No. A pre-assessment review occurs before an assessment tool is used and considers whether it is capable of supporting compliant and effective assessment. Validation examines assessment practices and completed assessment judgements after the assessment system has been used. Both processes contribute to assessment quality, but they have different purposes and require different evidence.

  • The RTO needs to demonstrate that its assessment tools have been reviewed before use. The nature and depth of the review may vary according to the complexity and risk of the training product, the source of the tool, the intended cohort and the assessment environment. Purchased, mandated and previously used assessment tools should not be assumed to be fit for purpose without review.

  • The developer can contribute to the review, but an independent or additional perspective provides stronger quality assurance. The RTO should consider whether the reviewer has the vocational knowledge, assessment capability and current industry understanding needed to evaluate the tool effectively.

  • Yes. The review can determine whether the purchased tool aligns with the current training product and whether it is appropriate for the RTO's students, delivery model, resources and industry context.

  • A checklist can help structure the review, but the evidence must show that the actual assessment materials were critically examined. A generic checklist that records only yes or no responses may not demonstrate how the reviewer reached their conclusions, what issues were identified or what changes were made.

  • Yes. Support can include validation planning, risk assessment, sample selection, facilitation, documentation of findings and development of actions. The validators and process must meet the applicable requirements, including those relating to credentials, industry competence and impartiality.

  • Yes. The engagement can be limited to an independent review report or expanded to include redevelopment, mapping changes, assessor guidance, rectification support and a final quality review.

Strong assessment begins before the first student is assessed

Assessment quality cannot depend on discovering tool deficiencies after students have completed their assessment. A structured pre-assessment review helps ensure the tool is suitable before use. Ongoing validation then tests whether the assessment system is being implemented appropriately and producing defensible competency judgements.

Together, these processes provide stronger assurance that the RTO's assessment system is fit for purpose, consistent with the training product and capable of supporting reliable outcomes.

Discuss your assessment review requirements