Week 13: General Test, CALT

This week is about online testing. Nour opened class with the program wiZiQ. It is a form of synchronous online testing. The program is constantly being updated.

Nour's link: wiZiQ Nour

Later during class, we gathered ideas and compare/contrasted general test and CALT.

Washback 
When a teacher instruction changes according to the test

General Test
Hybrid answers
Washback (instruction changes according to the test)
Reliability
Raters
Purpose/type
Practicality
Timing
Use
Impact
Feedback
Paper shuffling
Interpretation of scores
Presentation
Item types
Construct underrepresentation
Construct irrelevance

CALT
Computer-assisted Language Testing
Delivery and presentation; audio and video easy. Presentation is presented through the computer.
You type the word and spell it wrong: "Did you mean ___?" Natural language processing where computers can predict/know what you're thinking. 
Computers measure your sentences and how many different words you use.
Using surveys (similar to asynchronous CMC; e.g. clickers like Socrative)
Adaptive/non
Multimedies
Objective scoring
Interactivity
Flexibility
Item banks
IRT - Item Response Theory
NLP - National Language Processing
LSA - Latent Semantic Analysis
Resources
Authenticity
Computer Raters
Indirect tEST

Assessment
Reliability is answering the question; if the same student takes the same test again, will the get the same score? Whereas validity is asking, does the test evaluate what it seeks out to?

Lecture and Exam - How to examine a test
What delivery system does the test use?
What is the purpose of the test?
What characteristics may threaten or improve reliability?
Does the test appear to have any threats to validiy?
Is there any potential washback?
Multidimensional? Authentic?