Test Scoring Services for In-Basket Assessment Tools (D1120-18-2004)

1. Title: Test Scoring Services for In-Basket Assessment Tools Providing professional test scoring services to the E-testing and Test Administration (ETTA) Unit of the Consultation and Test Services (CTS) Division of the Personnel Psychology Centre (PPC) at the Public Service Commission (PSC).

2. Objective

   The PSC requires the services of qualified contractors to satisfy the requirements for Test Scoring Services for In-Basket Assessment Tools used at the PPC, on an as required basis and in accordance with the general terms of the standing offer.

3. For further information concerning the Managerial In-Basket Exercise (810), please visit

https://www.canada.ca/en/public-service-commission/services/staffing-assessment-tools-resources/human-resources-specialists-hiring-managers/human-resources-toolbox/personnel-psychology-centre/consultation-test-services/public-service-commission-tests/managerial-basket-exercise-810.html

For further information concerning the Middle Manager In-Basket Exercise (820), please visit

https://www.canada.ca/en/public-service-commission/services/staffing-assessment-tools-resources/human-resources-specialists-hiring-managers/human-resources-toolbox/personnel-psychology-centre/consultation-test-services/public-service-commission-tests/middle-manager-basket-exercise-820.html

3. Background 

The PPC is an internationally recognized leader in the personnel assessment field and offers a range of assessment tools and services to federal government departments and agencies. Clients use these tools to facilitate the selection process and to choose the right candidates to fill a position. The PPC’s test scoring operations are based in the National Capital Region (NCR). PPC psychologists and administrative staff are responsible for training, quality assurance of scoring activities, and test distribution. The workload may vary during the year, and scoring work may be distributed as required, depending on the demand for test scoring by PPC clients. The proposed resource acknowledges that the status of certified scorer is no guarantee that they will receive tests for scoring on a regular basis, but only that they will be included in the group of PPC-certified test scorers.

Furthermore, the PPC is in the process of developing an in-basket assessment tool that can be administered online. This standing offer may include this new tool. Where applicable, proposed resources will be provided with the relevant information at a later date.

4. Test scoring

The proposed resource will score tests that are received from the project authority in their offices or in another work location approved by the PSC. The proposed resource shall:

a) collect the tests and scoring sheets for scoring from the project authority, who will consult with the proposed resource to determine the return date for the scored tests;

b) read the texts that are written and assess the consistency between these texts, the scoring standard and detailed rating scales that are provided in the scoring guide;

c) assess the content of the texts that are provided;

d) indicate the scores of the texts that were assigned to them on a scoring form provided by the PPC;

e) add the scores from each page of the scoring form and write the totals in the appropriate boxes in the form;

f) verify whether the calculations are correct and meet the criteria provided in the scoring guide;

g) return the scored test and the completed scoring form to the project authority on or prior to the agreed upon date; and

a) report any unusual situation (missing pages, text too short, illegible writing, and so on) to the project authority by telephone, email or in person, and attach a sheet clearly summarizing the problem to the copy of the test (refer to Appendix I Quality Control – Section C – Scorer’s Form: Reporting Specific PSC Test Issues).

5. Return of tests and scoring forms

When the PSC gives a scorer a test for scoring, rescoring or revision following an evaluation performed by one of the quality assurance psychologists, the scorer must send via courier services or hand in, in person, the test and signed and dated feedback form to the project authority within a maximum of five working days. In exceptional circumstances only, the PSC reserves the right to approve an alternate method for handing in tests, provided the measure is temporary and does not compromise the security of protected documents. The PSC can also decide to allow a scorer additional time if they have a heavy workload, that is, more than 25 copies to process. If necessary, the scorer will be notified of the deadline and will have to agree to abide by it. The scorer will provide two invoices per month for the work completed during that same month. An invoice will be provided for services rendered during the first half of the month (until the 15th calendar day) and a second invoice will be submitted for services rendered during the second half of the month (from the 16th calendar day until the last day of the month).

6. Rescoring

As a certified scorer, the proposed resource will occasionally be called upon to rescore tests that have been scored by other scorers, at the request of the project authority. This work is similar to that of the initial scoring of tests, except that the scorer must also complete a feedback form that will indicate:

a) any elements that were missed (unnoticed errors or answers not related to the behavioural measures on the standardized scoring sheet) by the initial scorer; and

b) the first scorer’s degree of adherence to the standard scoring criteria that are provided in the guide (refer to Appendix I Quality Assurance – Section B – Rescoring Report).

7. Other related tasks

The project authority may ask the proposed resource to offer other services related to PSC activities in order to meet needs that cannot be met in full by PSC employees. These services may include, but are not limited to, the following functions:

• Research and statistical activities;

• Taking part in developmental modifications and leading-edge activities concerning measurement tools, related documentation, competency resource guides, and so on;

• Taking part in project management; and

• Delivering evaluation services related to accommodations, consultations, seminars, and so on.