Initial programme now available

Last update: 18 October 2018

08.00-10.30 Registration
09.00-16.30 Pre-conference workshops, Van der Valk Hotel Nijmegen-Lent
09.00 Item Banking for Computerized Adaptive Testing
Angela Verschoor, Roel Visseren
Room: Waalsprong 1
Achieving in Content Through Language: Assessing Bilingual and Multilingual Learners
Stuart Shaw
Room: Waalsprong 2
IRT in R made easy

Remco Feskens, Jesse Koops

Room: Waalsprong 3

Innovative on-screen assessment – confronting barriers, sharing ideas and moving forward

Caroline Jongkamp, Susan Stothard , Rebecca Hamer

Room :Waalsprong 4

Large-scale performance assessments: problems and potentials

Rianne Janssen

Room: De Bongerd 8

18.30-19.00 Welcome reception for new attendees

Cito Office , Amsterdameweg 13, 6814 CM Arnhem

19.00-20.30 Welcome reception

Cito Office , Amsterdameweg 13, 6814 CM Arnhem

08.00-10.30 Registration
09.00-09.30 Welcome addresses

Room : Waalsprong 1- 4

Thierry Rocher , AEA- Europe President

Pieter Hendrikse, President National Board of Tests and Examinations The Netherlands

09.30-10.15 Keynote speech: The balance in the performance: a missed opportunity in achievement testing

Dr. Norman Verhelst

Chair: Thierry Rocher

Room: Waalsprong 1- 4

10.15-10.45 Coffee break
10.45-11.30 Keynote speech: Response times in educational assessment: Moving beyond traditional assumptions

Dr. Maria Bolsinova, Kathleen Tattersall New Assessment Researcher

Chair: Alex Scharaschkin

Room : Waalsprong 1- 4

11:30 – 12:45 Poster presentations

Chair: Cor Sluijter

11.30 Poster 1

English Language Teachers` Perceptions and Practices of Formative Assessment in Kazakhstan
Balzhan Sengerbekova

11.30 Poster 2

How useful are data reduction techniques for an Awarding Body?
Louise Beattie, Noel Thomson, Shakeh Manassian

11.30 Poster 3

On-action reflections and self-assessment of pre-service language teachers in Turkish higher education context
Ebru Sire Kaya, Yonca Özkan

11.30 Poster 4

Teachers as trainees of an online program: challenges and support
Dina Tsagari, Anna Mavroudi

11.30 Poster 5

Uncovering Learner Patterns in Process Data within the MathemaTIC Assessment-For-Learning Platform
Charles Anifowose

11.30 Poster 6

Using the results of teachers` within in-service teacher training programs assessment to review the content of the training program
Yelena Adulova, Kanysh Bibekov, Rauan Sarsekenov

11.30 Poster 7

An Evaluation System for Assessing Effectiveness of Employee Training Programs: The Case of the National Bank of Kazakhstan
Aigul Yessengaliyeva, Maira Zhaksybay, Nico Dieteren

11.30 Poster 8

Uncovering the Disparities in Educational Attainment across Urban and Rural Locations in Northern Ireland.
Gemma Cherry

11.30 Poster 9

Computer Science and Technological Education in Primary School Education – Two Sides of the Same Coin?
Lennart Goecke, Jurik Stiller

11.30 Poster 10

Test-enhanced learning: Using tests beyond the scope of assessment – to improve learning
Frida Bertilsson, Carola Wikund-Hörnqvist, Tova Stenlund, Bert Jonsson

11.30 Poster 11

User Experience (UX) in the World of Assessment
Sam Sipasseuth

11.30 Poster 12

Examination malpractice analysis: defensibility, clarity and complexity

11.30 Poster 13

Large Scale National Diagnostic Assessment in Italy: A Case Study
Patrick Plichart

11.30 Poster 14

Bridging Standards between International Qualifications and Cognate Papers taken within the UK
Lakshita Perera, Sharon Nixon

11.30 Poster 15

Personalized Learning Environment in Mathematics
Arbana Miftari, Catalina Lomos

12:45 – 13:45 Lunch
13:45 – 15:15 Open paper sessions A, B, C, D, E, F
Sessions A: Papers 1-3 – Perspectives on assessment innovations

Chair: Tom Bramley

Room: Waalsprong 1

Session B: Papers 4-6 – E-assessment in large scale assessment

Chair: Fabienne van der Kleij

Room: Waalsprong 2

Session C: Papers 7-9 – Educational policy

Chair: Angela Verschoor

Room: Waalsprong 3

Session D: Papers 10-12 – Adaptive Approaches to Testing

Chair: Isabel Nisbet

Room: Waalsprong 4

Session E: Papers 13-15 – National Test & Exams

Chair: Naomi Gafni

Room: De Warmoes 6

13:45 PISA test validity from a student perspective

Eva Knekta, Hanna Eklöf

Preventing unintended consequences? – a pre-validation of the digitalization of a large-scale high stakes test

Christina Wikstrom, Per-Erik Lyrén

Education for the twenty-first century: assessment to support the development of problem solving goals in mathematics curricula 5 to 16.

Jennie Golding, Grace Grima

Urnings Algorithm for Tracking Learners’ skills and Items’ Difficulties in Adaptive Assessment and Learning
Maria Bolsinova, Gunter Maris, Han van der Maas, Abe Hofman, Benjamin Deonovic, Matthieu Brinkhuis, jesse koops
Building bridges between assessment and subject matter: An innovative approach to assessing GCSE Practical Science

Yasmine El Masri, Sibel Erduran, Alison Cullinane, Ruth Johnson

14:15 High-stakes testing reimagined – The German citizenship test

Kristine Gorgen

Personalised Assessments in Wales: a bridge to future assessment?

Sarah Maughan

Re-thinking the relationship between the media and educational assessment in the future

Maria Teresa,  Florez Petour

Improvement of Measurement Efficiency in Multistage Tests by Targeted Assignment

Stéphanie Berger, Angela Verschoor, Theo Eggen, Urs Moser

Probing the impact of an (arguably) unsuitable rating scale in high-stakes language assessment

Iasonas Lamprianou, Dina Tsagari

14:45 Transforming the delivery and marking of international assessments from paper to tablets: Stakeholder perspectives.

Grace Grima, Mary Richardson, Tina Isaacs

Transitioning from paper based to computer based assessments at a national level – challenges and opportunities

Louise Bailey, Oliver Stacey

Difficult policy decisions: weighing up perceptions, statistics and key stakeholder acceptance as evidence for A level grade standard adjustment in England

Milja Curcin, Qingping He, Beth Black

Adaptive Pairwise Comparison for Educational Measurement

Elise Crompvoets, Anton Beguin

Routing in the Multistage End of Primary School Test

Maaike van Groen, Hendrik Straat, Marie-Anne Keizer-Mittelhaëuser

15.15-15:45 Coffee/tea break
15:45-17.15 Open paper sessions F, G, H, I and J
Session F: Papers 16-18 – Analyses of international survey data

Chair: Theo Eggen

Room: Waalsprong 1

Session G: 19-21 – Analysis of Big Datasets in Assessment

Chair: Therese Hopfenbeck

Room: Waalsprong 2

Session H: Papers 22-24 – Assessment for Learning in Mathematics

Chair: Paul Newton

Room: Waalsprong 3

Session I: Papers 25-27 – Psychometric Models 1

Chair: Mary Richardson

Room: Waalsprong 4

Session J: Papers 28-30 – Examination Boards and the Role of Examiners

Chair: Bas Hemker

Room: De Bongerd 8

15:45 Do low or high achievers need more support in Romanian primary schools? Findings from TIMSS 2011

Catalina Lomos


The attributed value of big data analytics for educational assessment

Bernard Veldkamp

Curriculum sampling as a strategy employed for student performance monitoring system in Mathematics at NIS

Laila Issayeva, Nico Dieteren, Daniyar Temirtasov, Sjoerd Crans

PsychoNetrics: a comprehensive network perspective on psychometric models

Gunter Maris, Maria Bolsinova, Benjamin Deonovic

Reviewing assessments and dense data: towards effective evaluation of assessments for the non-technically minded

Jonathan Powell

16:15 A possibility for cross-country comparisons of early reading for children starting school in Russia and in the UK

Alina Ivanova

Regulatory and ethical implications of using log file data

Damian Murchan, Fazilat Siddiq

Professional Learning Community for MathemaTIC” – an online teacher environment, designed to support the implementation of digital innovations

Catalina Lomos, Carole Frieseisen, Frauke Kesting, Filipe Lima, Amina Afif

Which statistics help us automatically create tests with predictive validity?

Tom Benton

National examination systems and school improvement The roles of teachers and examination boards in
national examination policies
Andrew Watts
16:45 The role of missing responses in the assessments of the future. A preliminary look at missing responses in TIMSS 2015.

Elena Papanastasiou


Assessment in the age of Data Science: the case of interactive items tested in France

Reinaldo Dos Santos, Saskia Keskpaik

MathemaTIC – creating new paths for adaptive teaching, learning and assessment in a digital environment

Carole Frieseisen, Frauke Kesting, Catalina Lomos, Amina Afif

Modeling partial knowledge in multiple-choice questions using elimination scoring

Qian Wu, Tinne De Laet, Rianne Janssen

The Roles of National Examinations in Norwegian Secondary Education: Bridging Long-Standing Traditions with New Political Demands and Methodological Approaches

Sverre Tveit, Rolf Vegar Olsen

19:00 – 20:30 Social events (free choice)

Room: Artez/Airborne at the Bridge (meeting point Arnhem Central Station)

19:00 – 20:30 Event for members holding accreditation and for doctoral students
Chair: Rolf V. Olsen

Room: Historische Kelders, Arnhem (meeting point Arnhem Central Station)

09:00- 10:30 Open paper sessions K, L, M, N and O
Session K: Papers 31-33 – Test Development 1
Chair: Sarah MaughanRoom: Waalsprong 1
Session L: Papers 34-36 – The E-Assessment SIG

Chair: Stuart Shaw

Room: Waalsprong 2

Session M: Papers 37-39 – Assessment for Learning: Challenging Contexts

Chair: Christina Wikstrom

Room: Waalsprong 3

Session N: Papers 40-42 – Psychometric Models 2

Chair: Yasmine el Masri

Room: Waalsprong 4

Session O: Papers 43-45 – Features of National Assessment

Chair: Ayesha Ahmed

Room: De Bongerd 8

9:00 Agree to disagree? Understanding the impact of levels-based mark scheme design on examiner agreement

Sarah R. Hughes

eMarking in HIgher Education. Lecturers’ perceptions of change in assessment practice.

Mary Richardson

A Study of Norwegian Teachers’ Conversation About the Use of Test Results for Instructional Purposes

Hege Rangnes, Aslaug Fodstad Gourvennec

Evaluating the ‘similar items method’ for standard maintaining

Tom Bramley

The many goals of the Finnish basic education evaluation system

Jukka Marjanen, Mari Huhtanen

9:30 Broadening admission and orientation tests: The importance of self-efficacy (factors) for academic achievement.

Lot Fonteyne

‘Identifying priorities for the future of assessment – A collaborative approach’

Martyn Ware, John Winkley

Assessment for Learning in challenging contexts

Therese N. Hopfenbeck, Joshua McGrane, Yusuf Sayed, Anjum Halai, Veronica Sarungi, Anil Kanjee

Investigation of Composite Constructs Structure: Opportunities from Bin Factor IRT Models

Denis Federiakin

Building bridges to future writing assessment: what next for writing assessment at KS2?

Rebecca Clarkson

10:00 Constructs over time: the construct of language competence as captured in tests in England over the last 150 years perspectives.

Filio Constantinou

Marking by Question-Item-Group (QIG): A survey of the examiner experience

Katie Schultz, Rebecca Hamer

Two or three? The structure of motivation among primary school students: the case of Russia

Tatjana Kanonire, Alena Kulikova, Ekaterina Orel

 Measuring parental involvement in children’s education using a Rasch scenario
scale approach
Inna Antipkina, Larry Ludlow
Alignment of Standards in High Stake Examinations between the UK and International
Examinations: A Rank Ordering Exercise
Elena Mariani, Vasu Krishnaswamy
10:30 -11:00 Coffee/tea break
11:00 – 12:00 Discussion groups 1, 2, 3, 4 and 5
Discussion group 1

Room: Waalsprong 1

Discussion group 2

Room: Waalsprong 2

Discussion group 3

Room: Waalsprong 3

Discussion group 4

Room: Waalsprong 4

Discussion group 5

Room: De Bongerd 8

11:00 What do we require of a PhD education?

Eva Bjerkholt, Tony Burner, Andre Gaathaug, Synne Kleiven, Tone Marte Ljoså

Building an Assessment Institute that serves Education in a Country: comparing the examples of Azerbaijan, Kazakhstan and the Netherlands

Frans Kleintjes, Vali Huseyn, Nazipa Ayubayeva,Jacqueline Visser

eAssessment Special Interest Group: Progress and Planning for the Future

Martyn Ware, Rebecca Hamer, Jenifer Moody, Mary Richardson, Jurik Stiller, Naomi Gafni, Lesley Wiseman

Computerizing large-scale high-stakes examinations: Possibilities and pitfalls

Per-Erik Lyrén, Christina Wikström, Avi Allalouf, Naomi Gafni

The big crunch: combining sources of evidence in standard setting

Dennis Opposs, Kristine Gorgen, Lena Gray, Tina Isaacs

12:00 – 13:00 General assembly

Chair: Thierry Rocher and Jannette Elwood

Room: De Warmoes 6

13:00 – 14:00 Lunch
14:00 -15:30 Open paper sessions P,Q, R and S
Session P: Papers 46-48 – Assessment Cultures

Chair: Tim Oates

Room: Waalsprong 1

Session Q: Papers 49-51 – Social Justice in Assessment

Chair: Reinaldo dos Santos

Room: Waalsprong 2

Session R: 52-54 – Assessment for Learning

Chair: Iasonas Lamprianou

Room: Waalsprong 3

Session S: Papers 55-57 – National Tests & Exams
Chair: Amina AfifRoom: De Bongerd 8
14:00 A Study in Computer-Based Testing Washback: A Framework for Supporting Practitioner Research

Stuart Shaw, Martin Johnson

Extended Time as Accommodation: Monitoring Test Fairness in Standardized Tests

Marcus Strömbäck Hjärne

Improving teaching and learning through descriptive feedback in external assessment

Paula Simoes

Inter-subject comparability of A level examination standards in England – the evidence and the impact of
aligning statistical standards
Qingping He, Beth Black
14:30 TALE: the development of a new assessment training paradigm

Dina Tsagari

Secondary transition in Northern Ireland: children’s accounts of equity and assessment for selection

Leanne Henderson

Addressing culturally responsive assessment in Norwegian Schools

Guri A. Nortvedt

National tests in Norway – and assessment tool for learning

Olav Dalsegg Tokle, Bård Vinje, Grethe Ravlo

15:00 Assessing the effects of bilingual schooling on language learning motivation and proficiency

Karen Dunn, Barry O’Sullivan, Janina Iwaniec

“It all depends on how we look at things” – Bringing a lens to fairness in assessment

Isabel Nisbet, Stuart Shaw

Assessing Micro-teaching Performances of Pre-service Language Teachers: Integration of Alternative
Assessment Tools
Yonca Özkan, Ebru Sire Kaya
Predictive validity: Using success on acceleration programmes for postsecondary admissions and predicting
university success
Sarah Mattey, Stuart Shaw
15:30 – 16:00 Coffee break
16:00 – 17:20 Ignite Session and Symposia
Ignite Session

Chair: Gill Stewart

Room: Waalsprong 1 and 2

16:00 Automated marking of open-ended items

Roel Visseren

16:10 Remote invigilation: a spotlight on assessment administration

Nicola  Mellor, Liam Simington

16:20 Test-enhanced learning: Evidence from behavioral and brain imaging studies

Bert  Jonsson, Carola Wiklund-Hörnqvist, Tova Stenlund, Linnea Karlsson Wirebring


16:30 Free applications to support the formative function of knowlegde testing

Natasja Kok, Desirée Joosten-ten Brinke

16:40 The assessment expert of the future

Desirée Joosten-ten Brinke, Theo Eggen

16:50 Building Bridges by Open Standards

Mark Molenaar

17:00 An investigation of (dis)engaged test-taking behavior in PISA using response times

Michalis Michaelides, Militsa Ivanova, Christiana Nicolaou

17:10 A Unique Solution for Student Success in Mathematics

Carole Frieseisen

16:00 – 17:00 Symposium : 20 years of international large-scale assessments: Lessons learned from three countries.

Room: Waalsprong 3 and 4

Rolf Vegar Olsen, Therese N Hopfenbeck, Thierry Rocher, Julius Björnsson, Emily

19:00 – 23:00 Conference dinner
Room: River Dream Boat (Rhine) (transfer by bus)
09:00- 10:30 Open paper sessions T, U,V, W and X
Session T: 58-60 – Test Development 2
Chair: Nico Dieteren

Room: Waalsprong 4

Session U: Papers 61-63 – Developments in E-assessment

Chair: Rebecca Hamer

Room: De Warmoes 6

Session V: Papers 64-66 – Assessment for Learning Validity Considerations

Chair: Mary Richardson

Room: De Lentse Lus 5

Session W: Papers 67-69 – Vocational Assessment

Chair: Lesley Wiseman

Room: De Tuinderij 7

Session X: Papers 70-72- Assessing New Skills & Constructs

Chair:Martyn Ware

Room: De Bongerd 8

9:00 Subject specific discourse and the plain English campaign: impact on question and task development


Shakeh Manassian

Curiosity (didn’t) kill the CAT: Technical issues arising from the development of computer adaptive tests for Wales

Ben Smith, Angela Verschoor

How can we develop multiple choice items that support assessment for learning?

Bård Vinje, Olav Dalsegg Tokle, Grethe Ravlo

Vocational, technical and applied qualifications within upper secondary education in England: who takes them, how do they fit within students’ programmes of study, and where do students progress to next?

Joanna Williamson, Matthew Carroll

Permanence versus transience? Designing national systems to assess digital technology skills in an ever- changing world.

Cassy Taylor, Gareth Downey, Rachael Sperring

9:30 Should we be banking on it? Exploring potential issues in the use of ‘item’ banking with structured examination questions

Victoria Crisp, Tom Bramley, Stuart Shaw

A brave new world of continuous assessment

Cesare Aloisi, Claire Whitehouse

A General Framework for the Validation of Formative Assessment

Dorien Hopster-den Otter, Saskia Wools, Theo Eggen, Bernard Veldkamp

Grading Competence-Based Vocational Qualifications

Paul Newton

Developing a new assessment instrument for 21st century learning objectives for Science in Peru

Carmen Maribel Carpio, Caroline Jongkamp, José  Bruêns

10:00 Developing a conceptual framework of creativity and critical thinking: evidence from a validity study

Irina Uglanova, Georgy Vasin, Irina Brun

Automation of the assembly of Multistage Tests

Angela Verschoor, Theo Eggen

Piloting a tool for enhancing secondary students’ engagement with assessment feedback

Fabienne Van der Kleij

A level playing field? Does the levelling of qualifications build bridges or barriers?

Cassy Taylor, Paul Newton, Norman Gealy

Individualised learning, personalised learning – implications for assessment

Tim Oates

10:30 -11:00 Coffee Break
11:00 – 11:45 Keynote speech: On the assessment of (digital) reading skills.

Prof. Dr. Eliane Segers

Chair: Christina Wikstrom

Room: Waalsprong 1 – 3

11:45  – 12:30 Keynote presentation: Educational assessment and its prospects in the 21st century,

Prof. Dr. Samuel Greiff

Chair: Andrej Novik

Room:Waalsprong 1 – 3

12:30 – 13:00 Awards and Closing Session

Chair: Jannette Elwood

Room:Waalsprong 1 – 3

13:00 – 14:00 Lunch