Welcome to Language Assessment, which is, as the name suggests, a course about advanced assessment of foreign language learners.

In order to examine the basic principles of test construction and testing procedures, this course will examine topics such as measurement constructs and models of language knowledge, test reliability, the design of tests and assessments, item and task construction, scoring and rating tests and assessments, the training of raters, and issues of fairness and standards. There is a special focus on the area of validity, and different perspectives on validity are also introduced, including the use of arguments and evidence in the support of test validation. Students will participate in group discussions, take a midterm and final examination, produce a course validation project in which they (a) experience the process of conceptualizing the theoretical bases of an assessment instrument, (b) produce an instrument designed to measure a particular language skill (e.g., reading, grammar) or affective variable (e.g., motivation, self-efficacy), (c) gather and analyze data using that instrument, and (d) write a report on the strengths and weaknesses of the instrument. Finally, there will also be a short final paper.�@

If you would like (for some inane or perhaps insane reason), here is the course syllabus for your reading pleasure. Of course, I reserve the right to amend it, so please treat this as a guideline.

For those of you that have taken courses from me, you will recall that we have had no textbooks, and in the present course we will also have no textbook. Class material will be available on both Dropbox and Google Drive, and feel free to download, save, print, or otherwise use it. I seldom make paper handouts, but if you prefer paper, please take care of printing files yourself.

You will find course requirements near the bottom of this page.

---

Hereafter you will find a reasonably detailed synopsis of the various class meetings ("sessions") that we will enjoy this term.

Sure, you were about to ask, right? That, Good People, is a sextant, a very necessary tool for navigation in the days of sailing ships (i.e., in the pre-GPS age). There is, in a most appropriate nod to our course, a strong mathematical background to this beautiful tool.

---

Session #1 (April 28, 2018) — Introduction; Paper Format; Word Advice 

As often happens on the first day of class, we'll be speaking in somewhat general terms about our course and some of the topics therein. First, note that this course includes all four skills that appear in academic work: speaking, listening, reading, and writing. There are, of course, certain requirments for this course, as is true for every course; please scroll down to the specific courrse requirements for your enlightenment.

Homework:

Session #2 (May 5) — Validity 

Text here ...

Homework:

Session #3 (May 12) — Classroom Assessment, Part 1 

One seemingly ...

In my years ...

Our final goal today is to ...

Homework:

Session #4 (May 19) — Classroom Assessment, Part 2 

Today we will ...

Let's continue with a look at ...

Class Material:

Session #5 (May 26) — Classroom Assessment, Part 3 

This final discussion of classroom assessment focuses on the necessity of balancing external guidelines with assessment conducted in the classroom. As we noted in earlier discussions, the variability in teachers, instruction, and pedagogy poses considerable challenges to creating and conducting assessments that are valid.

As noted on page 303 of the C2 Unit of Fulcher and Davidson, the webpage of the Council of Chief State School Officers (CCSSO) includes a host of information on assessment with the express goal of facilitating coordination between states and the federal government in the United States.

Class Material:

Session #6 (June 2) — Constructs and Models 

In this discussion we will be examining the triad of theoretical models, frameworks for assessment, and test specifications. These narrow the focus from a grand, overarching theory down to the 'nitty-gritty' that can be actually utilized for constructing test items.

Models:

On page 46 we find the interesting assertation that a checklist based on Bachman and Palmer's model can inform the development of test items.

Class Material:

Session #7 (June 9) —  Test Specifications and Designs 

This chapter deals with the specs and actual creation of test items. As noted, test items can follow existing formats or can be original, but there should be some set of guidelines upon which to base the items.

The Brown and Abeywichrama chapter provides a useful example of various types of listening items. I'd like to direct your attention to the micro- and macro-skills list on page 163.

Class Material:

Session #8 (June 16) —  Item Response Theory; Winsteps Introduction 

Good morning, everyone. Today our class will be devoted to CTT and—to a small extent— item response theory. In the links below we have some useful information from the JALT Shiken SIG.

Class Material:

Session #9 (June 23) —  Writing Items & Tasks; Winsteps, Part 2 

Today we will devote our time to practicing some with Winsteps, which is software (paid, unfortunately) for conducting Rasch analysis. An alternative is the open source (and thus free) software called jMetrik. As you'll see, jMetrik accomodates item analysis, differential item functioning, item response analysis and Rasch analysis (just check the Analyze tab).

This class will be devoted to ...

Class Material:

Session #10 (June 30) —  Prototyping and Field Tests; Facets Introduction 

We will also delve some into ...

 Homework: 

Session #11 (July 7) —  Scoring Language Tests & Assessments; Facets, Part 2 

Good day, everyone. Today we will wander through Unit 7A, which deals with scoring language tests. We will also look some at the basics of FACETS, which is just pumped-up Rasch analysis.

Class Material:

Session #12 (July 14) —  Fairness, Ethics, and Standards 

In today's class we will be considering the very nature of testing and where it falls in terms of its role in society, for institutions, and for individuals. This discussion is at points very philosophical, yet it is of the utmost significance because of the uses to which testing can be put.

 Class Material: 

Session #13 (July 21) —  Arguments and Evidence in Test Validation and Use 

Good morning, everyone. Today we will walk through ...

 Class Material: 

Text coming here soon.

Session #14 (July 28) —  Project Presentation(s) 

Class Material:

Session #14 (August 5) —  Course summary

Homework:

1. In principle, three absences will be allowed, beyond which the student's overall grade will be reduced.


2. Regular and active participation in class is expected. (10%)


3. Required writing will include the following (70%):
• ✔ Research paper presentation (10%);
• ✔ Journal review (15%)
• ✔ Annotated bibliography (25%)
• ✔ Course paper on instrument development and results (50%)