《大规模英语考试作文评分信度与网上阅卷实证研究》绍有关大规模英语考试作文网上阅卷的研究成果,内容涉及作文网上阅卷过程的各个环节、与作文网上阅卷有关的阅卷员心理决策过程、作文评分过程中的认知作用、网上阅卷模型、计算机自动评分以及网上阅卷系统的设计开发与试用。实证研究发现,网上阅卷能确保随机分配作文卷,能加强阅卷过程的质量监控,而且阅卷员之间的评分一致性、阅卷员个人一致性和评分正确性都较高。研究结果证明,网上阅卷有利于提高阅卷信度和阅卷效率。
Chapter 1 Introduction
1.1 Rationale for the study
1.2 Objectives of the study
1.3 Organization of the thesis
1.4 Definition of terms
1.4.1 Online
1.4.2 Marking
1.4.3 Online marking
1.4.4 Online Marking System (OMS)
1.4.5 Local Area Network (LAN)
Chapter 2 Research Questions and Methodology of the Study
Chapter 3 Issues in the Direct Testing of EFL/ESL
Writing Ability
3.1 Introduction
3.2 What is a direct writing test?.
3.3 EFL/ESL writing ability: What shall we test?
3.4 Issues in validity
3.4.1 What is validity?
3.4.2 Types of validity
3.5 Issues in reliability
3.5.1 What is reliability?
3.5.2 Methods of judging reliability of writing assessments
3.6 The relationship between validity and reliability
3.7 Four components of a direct writing test
3.7.1 The task
3.7.2 The writer
3.7.3 The scoring procedure
3.7.4 The rater
3.8 Washback
3.8.1 Washback in general
3.8.2 Washback of direct tests of writing
3.9 Practicality
3.10 Summary
Chapter 4 The CET Writing Test
4.1 Introduction
4.2 The writing test required by the CET
4.2.1 A direct test
4.2.2 Positive washback
4.3 The scoring of CET compositions
4.3.1 The scoring approach currently adopted
4.3.2 Procedures involved in scoring CET essays
4.3.2.1 Scoring Principles and Marking Scheme
4.3.2.2 Range-finders and sample essays
4.3.2.3 Rater training
4.3.2.4 Rating process
4.3.2.5 Monitoring raters scoring during the scoring sessions
4.3.2.6 Recording essay scores
4.4 Computer-aided adjustment of writing scores
4.5 Discussion
Chapter 5 The First Experimental Study
5.1 Introduction
5,2 Compositions
5.3 Participants
5.4 Data collection procedure
5.5 The introspection and retrospection studies
5.5.1 Introduction
5.5.2 Data elicitation
5.5.3 Tape transcription
5.5.4 Data analysis
5.6 The questionnaire studies
5.6.1 Design of the questionnaires
5.6.2 Analysis of questionnaire responses
5.7 Findings from the introspection, retrospection and questionnaire studies
5.7.1 Issues and problems in rating CET essays online
5.7.2 Decision-making behaviors while rating CET-4 essays.
5.7.3 Summary of comments made by the raters on essays
5.7.3.1 Overall summary
5.7.3.2 Variations in raters comments
5.7.4 Essay elements influences on raters decision-making.
5.7.5 Elements of good CET essays in the raters eyes
5.8 Analysis of writing scores
5.9 Summary and discussion
5.9.1 About the issues and problems involved
5.9.2 About the raters scoring decisions
5.9.3 About the writing scores
Chapter 6 The Second Experimental Study
6.1 Introduction
6.2 Compositions
6.3 Participants
6.4 Data collection procedure
6.5 Problems encountered
6.6 Data analysis
6.7 Results
6.8 Summary
Chapter 7 Design of the OMS
7.1 Introduction
7.2 Literature review on online marking of compositions
7.2.1 Automated scoring of essays
7.2.1.l Overview of four major automated scoring methods
7.2.1.2 Analysis of the four major automated scoring methods
7.2.1.3 Summary
7.2.2 Online scoring of essays by human raters
7.2.2.1 Overview of online scoring of essays by human raters
7.2.2.2 Empirical research on online scoring of essays by human raters
7.2.2.3 Summary
7.3 A preliminary model of marking essays online
7.4 Overview of the CET Online Marking System (OMS)
7.4.1 The data management module
7.4.l.1 Basic information management
7.4.1.2 Essay management
7.4.1.3 Search and report
7.4.2 The training module
7.4.3 The rating module
7.4.4 The monitoring module
7.5 Operation of the OMS and the rater interface
7.5.1 Overview of the operation of the OMS
7.5.2 The OMS rater i
暂无