|
|
Improving Your Exams:
Multiple Choice and
Performance Testing
An intensive, professional seminar specifically designed for
managers of certification or licensure exam programs
This three-day seminar will teach you:
- A continuous improvement strategy for your tests
- Creating an evolutionary examination program
- Defining an optimal item life-cycle
- Translating multiple-choice tests into performance tests
- The real question underlying multiple-choice items
- Taxonomy of 6 performance item types
- Scoring performance items
- Psychometrics for non-psychometricians
- Classical Statistics
- Item Response Theory (IRT)
- Decision Theory
- New Performance Certification Statistics
Job Task Analysis for performance tests and multiple choice tests
- Sampling
- Defining consensus from survey responses
- Creating your blueprint
- Translating your blueprint into items
Building a business case for your exams
- Calculating ROI for a proposed exam
- Estimating exam construction costs
- What to outsource
ANSI and NCCA accreditation
- Evaluate your own program’s readiness
- Precursors to accreditation
- Reporting requirements for accreditation
- How to apply and achieve accreditation
- What’s involved in the process?
We give you the tools you need and teach you how to use them!
Thirteen Excel worksheets will be included in the workshop materials. They enable you to do everything from
managing a Job Task Analysis to using the Angoff process for determining exam cut scores. (The value of these
programs alone more than covers the cost of the seminar!) You will also receive materials presenting the latest
test development innovations and research.
When you've completed this workshop, you'll be able to answer these questions:
- When I revise my exam, how do I know the revision will be a better exam?
- What indicators give me a clue I';ve got a security problem?
- How can I do scaled scoring? … and why should I do scaled scoring?
- What new methods are available for Job Task Analysis?
- How is a performance test JTA different from a conventional one?
- How do I do forms equating?
- How can I translate my multiple-choice test into a performance test?
- What resources will I need to develop a performance exam?
- How is statistical analysis for performance exams different?
- How do I choose from among simulation, hands-on labs, video, or scenario-based performance items?
- How do I define an item time limit for a performance item?
- How can I set a cutscore for a performance test?
- How can I make my questions more representative of what people do?
- How do I develop a budget for a performance exam?
- How can performance tests reduce my security issues?
- How can I validate the cutscore for my exams?
- What management tools will make scheduling exam reviews easier?
- Is our program ready for ANSI or NCCA certification?
- What are the critical steps leading up to ANSI certification?
- How can I calculate the Return on Investment for an exam?
|
