WED 463 - Evaluation Levels
40-60% of the ISD process is spent in design
Kaizen - continuous improvement, a ground-up improvement system
On-line instruction - for every one hour of delivery, 100 to 300 hours of development is required
Formal evaluation very critical to on-line instruction
Compound objective - more than one performance action required for one obj
(use only one performance per objective)
Mager Three-Part Objective
1. Performance that states what the learner is expected to do
2. Conditions describe the circumstances under which the performance will occur
3. Criterion states the level of quality and/or competence that must be reached or surpassed
Important: measurement of performance and role of objectives are continuous throughout the model
F ormative
E valuation
E ach
D esign
S tage
Survey mortality rate - the level at which a survey is not completed and the factors that affect non-accomplishment of parts of the survey
Primacy/recency effect - the first and the last items read are remembered, in a paragraph, the first word and the last sentence is recalled, break up long classes into segments with more beginning and endings to take advantage of this effect
Miller's magic number - Working memory is limited to only 5 to 9 numbers (7+or- 2) that can be calculated at a time (7 for digits, 6 for letters, 5 for words)
Chunking - elements of data in chunks to enhance short term memory
Rubric - a rating scale, evaluation by classification of numbers
Experimental Design
Measures impact of training
Safety, legal or public service must receive the required training
On-the-job can increase learning to pass tests
Random sampling - personnel for control groups must have equal chance for selection
Random number tables - avoid experimental bias
Sometimes learners learn from the pre-test and are desensitized
Internal Validity - whether observed changes can be attributed to your program or intervention and not other possible sources
Design of experiments - design of information-gathering exercises
where a variation is present
Survey Types
Questionaire - research instrument consisting of a series of questions and other prompts for the purpose of gathering information
Interviews - more personal means of gathering information, can probe or ask follow up questions
40-60% of the ISD process is spent in design
Kaizen - continuous improvement, a ground-up improvement system
On-line instruction - for every one hour of delivery, 100 to 300 hours of development is required
Formal evaluation very critical to on-line instruction
Compound objective - more than one performance action required for one obj
(use only one performance per objective)
Mager Three-Part Objective
1. Performance that states what the learner is expected to do
2. Conditions describe the circumstances under which the performance will occur
3. Criterion states the level of quality and/or competence that must be reached or surpassed
Important: measurement of performance and role of objectives are continuous throughout the model
F ormative
E valuation
E ach
D esign
S tage
Survey mortality rate - the level at which a survey is not completed and the factors that affect non-accomplishment of parts of the survey
Primacy/recency effect - the first and the last items read are remembered, in a paragraph, the first word and the last sentence is recalled, break up long classes into segments with more beginning and endings to take advantage of this effect
Miller's magic number - Working memory is limited to only 5 to 9 numbers (7+or- 2) that can be calculated at a time (7 for digits, 6 for letters, 5 for words)
Chunking - elements of data in chunks to enhance short term memory
Rubric - a rating scale, evaluation by classification of numbers
Experimental Design
Measures impact of training
Safety, legal or public service must receive the required training
On-the-job can increase learning to pass tests
Random sampling - personnel for control groups must have equal chance for selection
Random number tables - avoid experimental bias
Sometimes learners learn from the pre-test and are desensitized
Internal Validity - whether observed changes can be attributed to your program or intervention and not other possible sources
Design of experiments - design of information-gathering exercises
where a variation is present
Survey Types
Questionaire - research instrument consisting of a series of questions and other prompts for the purpose of gathering information
Interviews - more personal means of gathering information, can probe or ask follow up questions
No comments:
Post a Comment