MeasureTrainingResults SomeConceptsSomeexperiencesSomelessons FrankCaoLucentTechnologiesfcao@1
TrainingProcess NeedsAnalysisDesignDeliveryEvaluation2
FourEvaluationLevelsReactionHowdoparticipantsfeelabouttheprogram?LearningTowhatextentdidtheparticipantsincreaseknowledge,improveskills,and/orchangeattitude?BehaviorTowhatextentdidtheirjobbehaviorchange?ResultsWhatfinalresultsoccurred?(Quantity,quality,safety,sales,costs,profits,ROI)3
LevelOne:ReactionWhatisevaluated?ContentTrainerMethodologyMaterialFacilitiesLogisticsRegistration4
ExampleQuestionsProbabilityyouwilluseideasfromthissessioninyourworkContentrelevancetomyjobPracticalexamplesandexperienceSpeaker’sknowledgeofsubjectareaSpeaker’spresentation/facilitationskillsSpeaker’sabilitytorespondtoquestionsGroupparticipation5
LevelOne:ReactionWhatisevaluated?Overall6
ExampleQuestionsWhatdidyoulikemostabouttheprogram?Whatdidyoulikeleastabouttheprogram?Inwhatwayscouldthisprogrambeimproved?Wouldyourecommendthiscoursetootherswhoareinterestedinthesubject?Whichofthefollowingfeatureswereimportantinyourdecisiontoattend?Rankinorderofimportance)7
LevelOne:ReactionHowtoevaluate?QuestionnairesInterviewFocusGroupPhonesurvey8
LevelOne:ReactionQuestionnaire:scalesExcellent Well Fair PoorExcellent VeryGood Good Fair PoorStronglyAgree Disagree76543 21High Low 10 98 76 543 21 9
LevelOne:ReactionAdvantagesEasytoexecuteParticipantsarefreeSomerelationshiptoonjobperformance IssuesPurelysubjectiveHaloeffect(smilesheet)HorneffectCentraltendencyTimepressure10
LevelOne:ReactionTip1:highlightpurpose,solicitcooperationTodeterminethedegreethattheseminarmetyourneeds,wewouldlikeyoutogiveusyourhonestopinion…Tomakeourfuturesessionsasmeaningfulaspo