Exam procedure

APPROVED
Deputy Minister of Health of Ukraine

O. Linchevskyi

April 12, 2017

The Licensing Integrated Exam Procedure is based on the currently effective normative base and is designed, taking into account the experience gained by the State Organization “Testing Board for Professional Competence Assessment of Higher Education Trainees in Medicine and Pharmacy at the Ministry of Health of Ukraine” and the “Procedure for External Independent Assessment and Monitoring of Education Quality” adopted by Decree №1095 of the Cabinet of Ministers of Ukraine, dated August 25, 2004 (revised version №533 adopted by the Cabinet of Ministers of Ukraine on July 08, 2015), as well as the experience gained by the National Board of Medical Examiners (USA), the General Medical Council (UK), the ETC GRE Test (USA), the Association of American Medical Colleges (USA), and the Occupational English Test Centre (UK).

This Procedure complies with the fundamental principles of the Ethical Code of Ukrainian Doctor, adopted by Resolution №3 passed at the meeting of the Academic Medical Council at the Ministry of Health of Ukraine on August 28, 2009.

1. GENERAL INFORMATION

1.1. This Procedure determines the basic principles of the Test-Based Licensing Integrated Exams “Krok” (hereinafter the “Licensing Exams”) as a form of external assessment of professional competence of the students and interns at higher education establishments that train professionals majoring in the “Healthcare” branch of knowledge, regardless of their form of ownership and subordination (hereinafter “higher education establishment”, “school”).

1.2. Basic organizational and technological arrangements regarding the preparation and administration of the Licensing Integrated Exams are performed by the State Organization «Testing Board for Professional Competence Assessment of Higher Education Trainees in Medicine and Pharmacy at the Ministry of Health of Ukraine» (hereinafter “the Testing Board”).

The Testing Board was created by the Ministry of Health of Ukraine to fulfill the “Agreement on Collaboration in Implementation of Medical Licensing Exam in Ukraine” concluded between the National Board of Medical Examiners (USA) and the Ministry of Health of Ukraine on September 08, 1997, Decree №1166/97 “The main directions of social policy in 1998–2000” adopted by the President of Ukraine on October 18, 1997, and Decree №422 “The implementation strategy for the main directions of social policy in 1998–2000” adopted by the Cabinet of Ministers of Ukraine on April 02, 1998.

The Testing Board is the state organization, specifically authorized by the Ministry of Health of Ukraine to supervise the training quality of healthcare professionals.

1.3. The Licensing Exams are carried out in compliance with:

  • “The regulations for the system of Licensing Integrated Exams for the professionals majoring in Medicine and Pharmacy” adopted by Decree №251 of the Ministry of Health of Ukraine on August 14, 1998 and registered with the Ministry of Justice of Ukraine on September 11, 1998 under №563/3003;
  • “The regulations for the organization and procedure of the state assessment of students” adopted by Decree №53 of the Ministry of Health of Ukraine on January 31, 2005 and registered with the Ministry of Justice of Ukraine on February 17, 2005 under №244/10524;
  • Decree №7 “On implementation measures for Decree №251 “On adoption of regulations for the system of Licensing Integrated Exams for the professionals majoring in Medicine and Pharmacy” adopted by the Ministry of Health of Ukraine on August 14, 1998” adopted by the Ministry of Health of Ukraine on January 15, 1999;
  • Decree №762 “On implementation of the Licensing Integrated Exam “Krok 3. Medicine” as a constituent part of the state assessment of interns” adopted by the Ministry of Health of Ukraine on November 20, 2006;
  • Decree №763 “On implementation of the Licensing Integrated Exam “Krok 3. Stomatology” as a constituent part of the state assessment of dental interns in compliance with the state standards of higher education” adopted by the Ministry of Health of Ukraine on November 20, 2006.

1.4. The Licensing Exams are test-based and can be administered in written (answer sheets) or computer-based form. Each test consists of 200 test items (150 for the “Krok M” and “Krok B” Licensing Exams) that passed expert assessment. Test duration for Ukrainian students (interns) is calculated, allocating 1 minute per 1 test item. Foreign students (interns) receive additional time (40 minutes) for a test.

1.5. The responsibility for the organization and administration of the Licensing Exams rests with two parties: Principals (Directors) of the higher education establishments and the Director of the Testing Board.

1.6. The responsibility for maintaining the proper Licensing Exam procedure rests with representatives of the Testing Board and authorized representatives of higher education establishments, appointed by a decree issued by the Principal (Director) of the higher education establishment.

1.7. The schedule of the Test-Based Licensing Exams is approved annually by the Ministry of Health of Ukraine.

The schedule of Licensing Exam retakes, administered in accordance with the currently effective normative base, is approved by the Testing Board.

1.8. The test procedure is subject to photo, audio, and video recording. Each classroom, where the Licensing Exam takes place, must be equipped with cameras, located in such a way that no less than 95% of the classroom is visible in the recording.

2. RIGHTS AND DUTIES OF THE EXAMINEES

2.1. The Licensing Exams can be taken only by the students (interns), who were properly registered with the Testing Board by their schools.

2.2. The students (interns) participating in the Licensing Exam have the right to write their tests in compliance with the approved schedule, receive their test results, and appeal to recheck their obtained test score according to the standard procedure.

2.3. The Licensing Exam results are sent by the Director of the Testing Board to the Principal (Director) of the higher education establishment.

Certificates are issued by the Testing Board. The Testing Boards keeps the Register of all issued certificates.

2.4. A student (intern) must:

  • familiarize himself/herself with the Licensing Exam Procedure;
  • timely arrive at the exam site and have his/her passport on hand;
  • comply with the instructions and requests of the Testing Board representatives administering the Exam;
  • upon completion of the test, hand over both the answer sheet and the exam booklet to the Testing Board representative administering the Exam;
  • avoid bringing into the classroom any objects or substances that are potentially dangerous to the life and health of other test participants;
  • comply with these Regulations.

2.5. During the test, students (interns) must:

  • avoid interfering with the work of other students (interns) and the duties of the representatives administering the Licensing Exam;
  • observe the rules of conduct;
  • avoid communication with other students (interns); avoid passing them any objects and materials, including those, related to the Exam;
  • avoid any disclosure of information about the test items before the Exam is concluded;
  • avoid using and carrying any communication devices or devices that can be used for scanning, processing, storage, and retrieval of information, as well as any printed or handwritten materials, not specified in the test procedure.

2.6. In case of violation of the demands provided in sections 2.4 and 2.5, a student (intern) loses the right to continue writing the test and, upon the request of the Testing Board representative, has to immediately hand over his/her answer sheet and leave the classroom. Each case of Exam Procedure violation must be recorded in the Licensing Exam Administration Report.

The submitted answer sheet in this case is not checked and marked instead as “0” (“fail”).

3. ADMINISTRATION SUBJECTS OF THE LICENSING EXAMS

3.1. The administration subjects of the Licensing Exams are:

  • the Ministry of Health of Ukraine;
  • the State Organization «Testing Board for Professional Competence Assessment of Higher Education Trainees in Medicine and Pharmacy at the Ministry of Health of Ukraine»;
  • higher education establishments that train professionals majoring in the “Healthcare” branch of knowledge.

3.2. The powers vested in the administration subjects of the Licensing Exams are as follows:

3.2.1. The Ministry of Health of Ukraine:

  • annually approves the schedule of the Licensing Exams;
  • annually approves the minimum passing score;
  • monitors compliance with the Licensing Exam Procedure;
  • takes steps to improve the quality of students’ (interns’) training within their higher education establishments based on the results of the Licensing Exams as a form of external assessment of professional competence;
  • executes its other powers, specified by the currently effective Ukrainian legislation.

3.2.2. The Testing Board:

  • provides organizational and technological preparation and administers the Licensing Exams;
  • develops and implements software complex for organization and administration of the Licensing Exams;
  • approves the exam content structure, proposed by the Expert Committees for the “Krok” Licensing Integrated Exams;
  • forms national databanks for the Licensing Exams and engages higher education establishments in updating the databanks of test items;
  • organizes primary, post-exam, and other expert assessments of the test items;
  • prepares, prints, and reproduces examination booklets necessary for confidential implementation of the Licensing Exams;
  • prevents unsanctioned access to the confidential materials and information;
  • registers students (interns) for the Licensing Exams according to the lists sent by their higher education establishments;
  • keeps and maintains the database of students (interns), their Licensing Exam results, and issued certificates; is the owner of this database under the Law of Ukraine “On Protection of Personal Data”;
  • determines the requirements for the equipment of the classrooms, where the Licensing Exams are held;
  • uses the State Courier Service to deliver the exam materials to the schools and/or uses other means of delivery, while ensuring the confidentiality of the materials and information and preventing unsanctioned access to them;
  • works with the Department of Police Security at the National Police of Ukraine to maintain public order and safety during the Exam and to ensure that no forbidden devices are brought into the classrooms, where the Exam is being administered. The powers of the representative of the Department of Police Security are specified in Decree №288/189 “Instructions for the provision of security services at the sites of external independent assessment by the officers of the Department of Police Security at the National Police of Ukraine” adopted by the Ministry of Education and Science of Ukraine on March 18, 2016.
  • provides different tests for different groups of students (interns) and has the right to use different test variants;
  • processes answer sheets, calculates and publishes Licensing Exam results in compliance with this Exam Procedure;
  • develops and issues information reports about Licensing Exam results;
  • draws up and issues certificates with the Licensing Exam results;
  • sets the date and site for the Licensing Exam retakes;
  • processes appeals with the requests to recheck the obtained test scores;
  • upon agreement with the Ministry of Health of Ukraine can cancel the Licensing Exam results, if unsanctioned access to the content of exam booklets is detected;
  • determines and analyses statistical indicators of test results and informs the Ministry of Health of Ukraine, if the results are invalid;
  • executes its other powers, specified by the currently effective Ukrainian legislation.

3.2.3. Higher education establishments and postgraduate education establishments:

  • help spread the information about the Licensing Exams procedure and objectives;
  • provide high-quality preparation of students (interns) for the Licensing Exams;
  • annually update the databanks of test items;
  • ensure participation of their faculty in primary, post-exam, and other types of expert assessment of test materials;
  • submit the necessary information about their students (interns) to the Testing Board, to register them for the Licensing Exams;
  • in compliance with the Testing Board requirements, allocate the students to the classrooms, where the Licensing Exams take place, and create safe conditions for the test participants;
  • provide medical assistance, if need be, to the students (interns) taking the Licensing Exams.

4. REGISTRATION OF STUDENTS (INTERNS) FOR THE LICENSING EXAMS

4.1. Students (interns) are registered by the Testing Board according to the lists submitted by their schools. Registration begins three months before the date of the Exam and ends no later than four weeks prior to the date of the Exam.

4.2. Higher education establishments, licensed for the training of healthcare professionals majoring in the relevant branch of knowledge, submit the following documents to the Testing Board, within the period and according to the procedure determined by the Testing Board:

  • a request for registration of students (interns) for the Licensing Exam, which must be submitted on a document sheet of the higher education establishment (or verified by its stamp) according to the template. The request must be verified by the Principal’s (Director’s) signature and the seal of the higher education establishment, with every page signed and sealed;
  • a registration form that contains necessary data about each student (intern) for his/her identification within the database (the form must be submitted as an electronic Microsoft Excel document in accordance with the template provided by the Testing Board);
  • a cover letter that describes the seating arrangement of students (interns) in the classrooms, considering that the Exam is administered in one shift, and the students (interns) are seated with one free seat remaining between them.

The data about the students, listed in the request, must match the data, submitted in the corresponding electronic document. The original of the request must be sent to the Testing Board via a registered letter or delivered in person. If a student (intern) is not included in the both registration documents, such student (intern) cannot be registered by the Testing Board for the Exam.

4.3. Information about the registered students (interns) is entered into the Testing Board database for further processing and personification of the Licensing Examination results. A personal identification code is assigned to each registered student (intern) – Student ID/Intern ID.

4.4. Student (intern) registration data, stored in the Testing Board database, can only be changed upon the relevant written request.

4.5. In cases when special conditions need to be met during the Exam for persons with medical conditions that may hinder the process of examination, the school must, besides the documents listed in section 4.2, submit the medical conclusion issued by a healthcare establishment, stating that certain conditions need to be created for such student (intern).

4.6. The Testing Board can refuse to register a student (intern) for the Licensing Exam. The grounds for such refusal can be as follows:

  • improper execution of the registration documents;
  • impossibility of providing special conditions required for certain students according to the medical conclusion issued by a healthcare establishment;
  • belated submission of the necessary documents;
  • violation of the currently effective normative base.

5. EXAM ADMISSION AND PARTICIPATION RULES

5.1. Only the students, who completed their curriculum (especially the subjects covered by the “Krok 1” Licensing Exam), can be allowed to take the “Krok 1” Licensing Exam. The students, who failed to complete their curriculum and therefore were not allowed to take the Licensing Exam, are considered to be absent without a reasonable excuse at the Exam. These students obtain “0” score and this score is registered as the result of taking (retaking) the Licensing Exam. Such students are granted no additional attempts to retake the “Krok 1” Licensing Exam. When such students properly complete their curriculum, they can be allowed to take the “Krok 1” Licensing Exam. In this case a separate decree needs to be issued by their school, stating that these students are allowed to take part in the Licensing Exam. The copy of this decree must be sent to the Testing Board.

5.2. Only the students, who completed their curriculum and have their “Krok 1” Licensing Exam Certificates, can be allowed to take the “Krok 2” Licensing Exam.

5.3. Only the interns, who have their “Krok 1” and “Krok 2” Licensing Exam Certificates, can be allowed to take the “Krok 3” Licensing Exam.

5.4. Only the students, who completed their curriculum, can be allowed to take their “Krok M” and “Krok B” Licensing Exams.

5.5. The students (interns), who were properly reinstated in a school and need to retake the Licensing Integrated Exam that they previously failed, must be registered with the Testing Board using the standard procedure. The decree about reinstating such students (interns) in a school must be sent to the Testing Board along with their registration data.

5.6. The students (interns), who were expelled or took a sabbatical prior to their Licensing Exam, are excluded from the list of students (interns) registered for the Licensing Exam and are not considered to be absent. The information about the expulsion of such students must be submitted to the Testing Board no later than one day before the date of the Exam and verified with the relevant documents. The accompanying documents that can serve as the grounds for the exclusion of a student (intern) from the list of the students (interns) registered for the Licensing Exam consist of:

  • a free-form letter from the school to the Testing Board with a request to cancel the registration of certain students (interns) due to their expulsion or sabbatical. The letter must be signed by the Principal (Director) or Vice-Principal and verified with the seal of the school;
  • a copy of the decree (decrees) about the expulsion or granting a sabbatical leave, properly verified with the seal of the school.

If the described situation concerns the “Krok 1” Licensing Exam, the students cannot participate in the retakes of the Exam within the current academic year.

5.7. The students (interns) (apart from those expelled or on a sabbatical leave), who were registered for the Licensing Exam, but failed to be present, obtain “0” score, and this score is taken into account during the calculation of total Licensing Exam results of their schools.

The students (interns) must submit the documents explaining the cause of their absence to the Testing Board within 3 (three) days after the Exam.

The document that provides a reasonable excuse of the absence at the Exam is a health certificate of temporary disability, properly issued (or verified) by a student hospital. Such health certificate is to be issued according to Decree №455 “On adoption of the instruction regarding the issuance procedure for the documents confirming temporary disability of the citizens”, section 2.16, adopted by the Ministry of Health of Ukraine on November 13, 2001 and registered with the Ministry of Justice of Ukraine on December 04, 2001 under №1005/6196 (revised and expanded). According to this Decree, a temporary disability of a student in a higher education establishment can be confirmed by:

  • a verified copy of the temporary disability certificate,
  • a relevant statement (form №095/о), approved by Decree №110 “On adoption of the forms of primary accounting documentation and instructions on the procedure of their filling in, used at the healthcare establishments regardless of their forms of ownership and subordination”, adopted by the Ministry of Health of Ukraine on February 14, 2012 and registered with the Ministry of Justice of Ukraine on April 28, 2012 under №661/20974,
  • or an extract from the outpatient (inpatient) medical record (form №027/0).

For interns the only document that can provide a reasonable excuse of their absence at the Exam is a properly issued health certificate of temporary disability.

The students (interns), who submitted the relevant health certificate within the determined period, have their score of “0” canceled. They are allowed to retake the Licensing Exam within the period determined by the Testing Board.

If such students (interns) fail to submit their health certificate or submit it after the expiration of the three-day-period, it is considered that they were absent at the Exam without a reasonable excuse.

5.8. If students (interns) for health reasons cannot take part in the Exam on schedule in a common classroom, it must be properly confirmed by the letter from their school signed by its Principal (Director) or Vice-Principal and verified with the seal of the school. Such students (interns) can write their Licensing Exam in a hospital on the day of examination or at the Testing Board premises on an individual schedule. The relevant report is to be drawn up about each individual case of the Licensing Exam administration.

5.9. Special requirements can be met for the students (interns) with disabilities. In each case the requirements are determined individually, based on the nature and the severity of the student’s (intern’s) health condition at the time of the examination, which must be confirmed with relevant health certificates.

6. STAFFING SUPPORT OF THE LICENSING EXAMS

6.1. Each Licensing Exam is supervised by faculty members of higher education establishments and other persons, who underwent the relevant training (instruction) and represent the Testing Board during the Licensing Exam.

6.2. Licensing Exam administration is provided by the Testing Board representatives and authorized faculty members of the higher education establishment, appointed by the Principal’s (Director’s) decree.

6.3. The remuneration of the persons engaged in administration of the Licensing Exams is provided according to the current legislation.

6.4. The training (instruction) of the persons engaged in administration of the Licensing Exams is provided by the Testing Board.

7. LICENSING EXAM PROCEDURE

7.1. The Exam can be taken by the registered students (interns), if their current health condition allows them to undergo testing.

7.2. To administer the Licensing Exams, the Testing Board makes and uses closed exam booklets in Ukrainian (for Ukrainian students), Russian, and English (for foreign students). The Testing Board can provide different examination booklets for different groups of students.

7.3. To deliver the exam materials to higher education establishments, the Testing Board employs the services of the State Courier Service of Ukraine or Testing Board employees. The exam materials are delivered to the school office, where they are received by an authorized person, who is appointed to this duty by the Principal’s (Director’s) decree and holds an executive administration post within the school. The receipt of the exam materials needs to be recorded in the relevant Report on the Receipt of Exam Materials signed by the representative of the State Courier Service of Ukraine and the authorized persons representing the school.

Until the time of the Exam, the exam materials are to be stored in a room of Principal’s choice, equipped with an alarm system (materials for the “Krok 1”, “Krok 2”, and “Krok 3” Licensing Exams), or in a sealed lockbox in the Principal’s office (materials for the “Krok M” and “Krok B” Licensing Exams).

On the day of the Exam, the authorized representative of the school must in the presence of all Testing Board representatives personally confirm the intactness of the sealed containers with the exam materials according to the Report on the Receipt of Exam Materials signed by the both parties (all Testing Board representatives and the authorized representative of the school). The procedure can be recorded on photo or video.

If the package with the exam materials is confirmed to be intact, the Testing Board representatives can proceed with the Licensing Exam as described in this document.

7.4. The Licensing Exams take place in the classrooms provided by higher education establishments, with no more than 100 (one hundred) examinees placed in one classroom. The number of the examinees in one classroom must not exceed ½ of the seats in the classroom.

The classrooms, where the Licensing Exam is to be held, must be furnished with tables (desks) and chairs. They also must be equipped with a clock and audio and video surveillance systems that automatically record the Licensing Exam in its entirety, to ensure that the proper exam procedure is maintained. The surveillance recordings are then to be sent to the Testing Board for analysis.

The representatives of the Testing Board and school, as well as an officer of the Department of Police Security at the National Police of Ukraine, must be constantly present in the classroom for the duration of the Licensing Exam. The school representative cannot walk the classroom and communicate with the students (interns). Everyone present must ensure that this Exam Procedure is properly maintained during the Licensing Exam administration.

Public observers can be present in the classroom during the Licensing Exam administration, on the condition that such public observers are properly registered using the approved procedure.

Outsiders are prohibited from entering the classroom, where the Licensing Exam takes place.

7.5. The Licensing Exam can be held on the Testing Board premises, if the number of students (interns) at a school that are to take the Exam does not exceed 20 persons. Exam retakes for the students (interns), who were previously suspended from taking the Exam due to their violation of the Exam Procedure, can also be held on the Testing Board premises.

7.6. The students (interns) that are to take the Exam are identified based on their passport. The school representative holds the responsibility for accurate identification of the students (interns). The Testing Board representative holds the responsibility for accurate identification of the students (interns) during retakes of the “Krok 1” Licensing Exam.

7.7. The students (interns) must leave their personal effects in the place allocated for this purpose by their school. The school holds the responsibility for the safety of the stored personal effects.

The students (interns) are to enter the examination classroom only in the presence of the representatives of the Testing Board, their school, and the Department of Police Security at the National Police of Ukraine. The students (interns) are admitted into the classroom and receive the exam materials only according to the list held by the Testing Board representative.

An officer of the Department of Police Security at the National Police of Ukraine uses a metal detector or other devices to detect any gadgets, forbidden in the examination classroom.

According to the Testing Board representative’s instructions, the students (interns) take their places in the classroom intermittently, with at least one seat remaining unoccupied between them. In this manner the students (interns) are consecutively seated row by row, leaving several rows free. The free rows are reserved for the reseating of the students (interns), who during the Exam need to leave the classroom (see section 7.11).

7.8. Before the start of the Licensing Exam, the Testing Board representative, the authorized person appointed by the Principal’s (Director’s) decree, the Head of the State Examination Committee of the higher education establishment (if necessary), and the Head (or Deputy Head) of the Student Parliament open the package with the exam materials in the classroom. They confirm the intactness of its seal in the presence of all students (interns) and an officer of the Department of Police Security at the National Police of Ukraine. The relevant report is to be drawn up about the opening of the package and inspection of the exam materials.

7.9. Before the start of the Licensing Exam, the Testing Board representative informs the examinees about the Licensing Exam procedure. After that, each student (intern) is given a numbered exam booklet.

7.10. A student (intern) must put his/her signature in ink into the “Additional Information” box on the answer sheet and enter the mandatory ID data and exam data. To personify the exam booklet, a student (intern) fills in the boxes on the booklet cover with his/her identification code and surname and writes down the booklet number into his/her answer sheet.

Exam booklets and answer sheets cannot be taken out of the classroom during the Exam.

7.11. The students (interns) cannot leave the classroom during the Licensing Exam without permission from the Testing Board representative. If a student (intern) needs to leave the classroom to feed the baby, to have a bathroom break, because of a medical condition (in this case the presence of a medical condition must be properly confirmed with the relevant documents and the school needs to notify the Testing Board about it in writing in advance), etc., he/she must notify of it the Testing Board representative and receive the permission. The duration of the student’s (intern’s) absence from the classroom must be recorded in the Exam Administration Report.

When the student (intern) returns to the classroom, the officer of the Department of Police Security at the National Police of Ukraine must again use a metal detector or other devices to check, whether the student (intern) has on his/her person any gadgets, forbidden in the examination classroom.

Additional seats in the classroom must be reserved for the students (interns), who were allowed to leave the classroom during the Licensing Exam.

7.12. The students (interns) cannot have on their persons and use any additional materials during the Licensing Exam, including but not limited to: communication devices; devices for information readout, processing, storage, and retrieval; paper; printed and handwritten materials, not specified in the test procedure.

7.13. Violation of sections 7.11–7.13 can be the cause for discontinuation of the exam for the violators. In such case the relevant report must be drawn up and signed by the Testing Board and school representatives.

The student (intern) suspended from the Exam due to a violation of the exam procedure has his/her answer sheet annulled and receives “0” score.

7.14. Having completed the work with the exam booklet, a student (intern) must put his/her answer sheet into his/her exam booklet, hand them over to the Testing Board representative, and leave the classroom.

7.15. The Testing Board representative inspects whether both the answer sheet and the exam booklet were handed over and whether all the answer sheets match their corresponding exam booklets. It must be done in the presence of the school representative.

7.16. If all the answer sheet-booklet sets are complete, the Testing Board and school representatives seal the answer sheets (and, if need be, booklets), and the relevant report is drawn up and signed by the Testing Board and school representatives. The sealed answer sheets are then sent to the Testing Board for processing, while the exam booklets remain in the school, where they are kept for 30 days.

7.17. If an answer sheet-booklet set is incomplete or the booklet number does not match the variant number written in the student’s (intern’s) answer sheet, the Testing Board and school representatives draw up and sign the Discrepancy Report. Then this answer sheet-booklet set is sent to the Testing Board.

7.18. Upon the completion of the Licensing Exam, the Licensing Exam Administration Report is drawn up for each classroom and signed by the Testing Board and school representatives.

7.19. To ensure the transparency of the Licensing Integrated Examination and its results, a procedure of copying the answer sheets of the examinees can be conducted at the higher education establishment. After the Licensing Exam is complete, the school and the Testing Board are both authorized to request that the copies of the answer sheets are made.

7.20. To obtain the copies of the examinees’ answer sheets, the school must send the Testing Board an official written request before the Licensing Exam. Upon this request, the Testing Board will provide its representative with the relevant report form and a necessary number of sealable courier envelopes for the storage of the copies.

After the Licensing Exam is complete, the Testing Board representative in the presence of an authorized representative of the school makes the copies of the answer sheets. The Testing Board and school representatives sign the copies, verify them with the seal of the school, and draw up the relevant report.

The sealed courier envelope with the copies of the answer sheets is kept in the Principal’s (Director’s) lockbox for 30 days from the date of the Licensing Exam. The courier envelope is opened, if discrepancies are revealed during an appeal or a revision of the results is initiated by the school, the Testing Board, or the Ministry of Health of Ukraine. During the first 30 days of storage, the courier envelope can be opened only in the presence of the representatives of two or more parties.

7.21. The answer sheets of the students (interns), who passed the Licensing Exam, are to be kept by the Testing Board for 30 days.

The answer sheets of the students (interns), who failed the Licensing Exam, are to be kept by the Testing Board for 1 year.

7.22. If the student’s (intern’s) health condition becomes worse during the Licensing Exam, the Testing Board and school representatives must be immediately notified of it. If the continuation of the Exam is impossible for the student (intern), the Testing Board representative must discontinue the Exam for this student (intern) and draw up the relevant report signed by the student (intern) and the representatives of the Testing Board and school.

8. LICENSING EXAM RESULTS

8.1. The Licensing Exam results are presented qualitatively and quantitatively.

8.2. The qualitative Licensing Exam results are presented in the “pass” / ”fail” format and are based on the professional competence requirements for healthcare workers. The requirements are determined by the national standards for higher education in Ukraine. The minimum passing score is approved by the Ministry of Health of Ukraine.

The quantitative Licensing Exam results are presented on the Licensing Exam scale (Medical Licensing Exam score), with the grade point average of 200 and standard deviation of 20, that is, within the interval from 140 to 260 points.

8.3. The Licensing Exam results are presented in the relevant report forms, drawn up and approved by the Testing Board.

8.4. The Licensing Exam results are officially published by the Testing Board by forwarding them to the official email addresses of higher education establishments within the period of 14 days.

8.5. The Licensing Exam results are entered into the Testing Board database.

8.6. The students (interns), who have successfully passed their Licensing Exam, obtain their Licensing Exam Certificates. The Certificates are drawn up and issued within the period of 30 days after the Exam results are published. The students (interns), who failed their Licensing Exam, still can take part in the other stages of the state certification.

8.7. All Certificates are entered into the Certificate Register of higher education trainees majoring in Medicine and Pharmacy. A Licensing Exam Certificate is an annex to the Higher Education Diploma of the corresponding level in the corresponding branch of knowledge. The Certificates are handed to the authorized representatives of higher education establishments, which is recorded in the relevant register.

8.8. In case of loss or damage to the Certificate, a student (intern) can receive a duplicate of the Certificate upon the written request made by the administration of his/her school to the Testing Board. The duplicate of the Certificate can be handed to the student (intern) in person or to the representative of the school administration, if both the written request and the student’s (intern’s) passport are presented.

8.9. Additionally to the report forms listed in section 8.3, after each Test-Based Exam the technological report forms are drawn up as well. They calculate test psychometrics, test procedure psychometrics by the classroom and by the school, and test item psychometrics within the national sample and school sample.

8.10. Based on the results of each Exam, the Testing Board prepares an Analytical Report about the Licensing Exam results within the period of 30 days after the Exam results are published. The Analytical Report is published on the official website of the Testing Board.

9. ANNULMENT AND CANCELLATION OF THE LICENSING EXAM RESULTS

9.1. In case of Licensing Exam procedure violation the Testing Board representative has the right to discontinue the Exam for a student (intern). Exam procedure violations are described in sections 2.4, 2.5, 7.11, and 7.12. They also include the situations, when:

  • during the Licensing Exam a student (intern) has on his/her person or in his/her workspace any communication devices; devices for information readout, processing, storage, and retrieval; printed and handwritten materials, not specified in the test procedure;
  • the test is being written not in the workspace assigned to the student (intern) by the Testing Board representative;
  • the identity of the person writing the test is suspect;
  • communication occurs between the students (interns) during the Licensing Exam;
  • answers are being copied from another student’s (intern’s) work;
  • answer sheets are being damaged beyond the possibility to process them automatically;
  • students (interns) refuse to hand over their answer sheets to the Testing Board representative on expiry of the time allotted for the testing.

The decision about the results cancellation can be made by the Testing Board based on the records about the Licensing Exam Procedure violations, entered into the Exam Administration Report that was signed by the Testing Board and school representatives. The results can also be cancelled, if video surveillance analysis reveals the fact of Exam Procedure violation.

9.2. If unsanctioned access to the test items in the exam booklets is detected:

  • before the Licensing Exam begins – the Exam is cancelled and another date for the Licensing Exam is chosen;
  • after the Licensing Exam begins and before it is completed – the results of the Exam are not published and another date for the Licensing Exam is chosen.

In such cases the Testing Board draws up the relevant report and immediately informs the schools and the Ministry of Health of Ukraine. If necessary, the Testing Board can make an official inquiry into the incident and contact the law enforcement authorities.

10. APPEAL PROCEDURE

10.1. A student (intern) has the right to file an Appeal, in which he/she may request to recheck his/her test score. This Appeal will be then processed by the Testing Board.

10.2. An Appeal can be submitted by a person, who took the test and received a negative score.

An Appeal cannot be submitted by those, who violated the testing procedure and were suspended from taking the test as a result. Such Appeals will be rejected by the Testing Board.

10.3. An Appeal to recheck the obtained test score must be submitted no later than 14 (fourteen) calendar days from the date, when the exam results were published. An Appeal can be submitted in person or via a registered letter. An Appeal can be filed regardless of whether appellants have copies of their answer sheets or not.

10.4. An Appeal is submitted as an official request addressed to the Testing Board Director. An Appeal Request must contain the following information:

  • full name of the Examinee;
  • residence address of the Examinee;
  • name of the school;
  • site, where the Exam took place (address and classroom number);
  • name and date of the exam;
  • name of the school representative that was present in the classroom during the Exam;
  • reasons, why the Appeal is being submitted;
  • the list of attached documents (if any).

10.5. An Appeal to the Testing Board must be verified by the Principal (Director) of the higher education establishment, where the Examinee undergoes training.

10.6. All Appeals are processed within 30 days after the date, when the Exam results were published, in the presence of the Examinees that submitted them.

Appeal procedure consists of comparing the answer sheet of the Examinee with its processing protocol that is the basis of the Exam result calculation.

10.7. After the Appeal Procedure is complete, both the Examinee and the Testing Board representative sign the Statement of Appeal Procedure that is regarded as final.

11. RETAKING OF THE LICENSING EXAMS

11.1. According to the currently effective normative base, all the students, who failed to pass the “Krok 1” Licensing Exam, are granted two more attempts to pass this Exam within the current semester.

11.2. The Testing Board can hold retakes of the Licensing Exams, set the dates for the retakes, and use different test variants, including those formed from the booklets of the previous years. If open booklets, copies of which are kept by the schools, are used for the Exam retake, the students (interns), who obtained a result above the minimum passing score, will receive only the minimum passing score in the result of an open booklet-based retake.

A retake of the Licensing Exam can be held no sooner than in a week after the Licensing Exam results are published. The schools are to be notified with a letter about the dates set by the Testing Board for Licensing Exam retakes.

11.3. Retakes of the Licensing Exams can be held on the Testing Board premises, if the number of students, who failed the Licensing Exam held on the school premises, does not exceed 20 persons.

11.4. The students, who failed to pass their “Krok 2”, “Krok M”, or “Krok B” Licensing Exams, are granted one retake of their failed Exam within the period of the next three years, with the next attempt no sooner than in a year.

The students, who failed to pass their “Krok 2”, “Krok M”, or “Krok B” Licensing Exams during the retake, cannot be registered for the subsequent retakes without repeating the curriculum.

11.5. Interns, who failed to pass their “Krok 3” Licensing Exam, can retake their failed exam within the period of the next three years, whenever the “Krok 3” Licensing Exam is held.

 

Director of the State Organization “Testing Board for Professional Competence Assessment of Higher Education Trainees in Medicine and Pharmacy at the Ministry of Health of Ukraine”

I. Bulakh

31 Gertsena St.,
Kyiv, 04050
  admin@testcentr.org.ua

  +38 (044) 483-30-03
  Mon.–Th.: 9:15 - 18:00
      Fri: 9:15 - 17:00
Lunch break: 13:00 – 14:00

Subscribe
to the Testing Board: