The adLearning solution offers networked collaboration tools to enable professionals to design validated pools of questions. The beauty of it is that it provides complete professional work flow ensuring that the questions really work as expected. The questions can be created and published within minutes. Peer reviews and user feedback can be analysed in real-time, and consequent modifications can be made on the basis of the well-thought-out and well-structured item analysis.
The adLearning solution helps you to implement better training solutions that, in turn, can only add prestige to your organisation.
Like all good writing, writing a test item involves writing it over, editing it, polishing it, and sometimes abandoning it to start again.
If you plan to focus on questions in your next training programme, we have an optimal solution for you. We offer our experience and in-house tools for your use. Let’s look at some typical questions that need to be solved at the beginning of the technical or process training programmes: How can experts share their knowledge in our organization? How do we know what our employees know and are capable of? How do we create effective training? adLearning’s key offering:
The adLearning method starts by collecting a list of typical incidents or mistakes at work. The aim is to find the things that provide the best value for the learner and the organization. The value of an incident can be analysed, for example, by estimating 1) its frequency of occurrence, 2) its damage (how big a loss is suffered) and 3) teachability (how much loss can be reduced with correct training).
The collaborating Root Cause Analysis is performed for the selected Key Incidents. The results of the analysis guide the creation of the training programme. This step answers the question: “Why do these Key Incidents occur?”
Root Cause Analysis can be carried out fast and accurately by using the adLearning collaboration tools. The Open Question function will provide an effective method of collecting collaborating participants’ real-life experience and knowledge. The identified root causes are classified according to their levels of skill, knowledge, attitude or other criteria. Each classification has its own template and question schema.
The Open Questions are the workhorse of the adLearning service. These are used in the early stages of the project to identify the Key Incident and Root Causes. However, the most important role of the Open Questions is to test the planned final questions with the pilot group. The Learner’s answers to the Open Questions form the basis of the multiple choice answers. This will ensure that the answers are based on real user opinions, conceptions and beliefs. The answers received to the Open Questions are used to predict the distribution of the answers in the final questions.
The first step in tuning the questions is to collect pilot data and assess the reliability and validity of the test items. The teacher receives instant statistics about item difficulty, discrimination power and validity: this means the immediate identification of weaknesses and ambiguities and allows on-the-spot changes to the question. Your questions will simply improve and develop with ease.
The structured and validated pools of questions provide a solid basis for both testing and training programmes. The development of the training programme can be planned on the basis of the pilot phase statistics. The tests can be targeted to cover selected Key Incidents and their value can be accurately forecast. Based on the ROL (Return-on-Learning) estimates, the actual training can then be planned and created with complete confidence.
The adLearning analyses the overall difficulty, discrimination, distribution, disctractor discrimination, symmetry of likert scale answers, correlation between items, usefulness, used time and if suitable performs advanced modelling techniques , such as structured equation modelling, to help user to create efficient and trusted training programme.
The training programme can be published in the adLearning cloud or it can be hosted in the company LMS.
A traditional training project defines course objectives by interviewing, for example, subject matter experts. This phase easily results in a very high level analysis with an as-wide-as possible course scope. However, tests are typically created at the end of the project - when all the sources have already left. In contradistinction, the adLearning method begins with the testing. Experts are able to send instant questions to poll the users’ skills, knowledge, attitudes and various other possible causes for errors. On-the-job training, just-in-time training, classroom training or eLearning can then be organized for identified causes of error.
The traditional training project:
The adLearning Process: