State-of-the-art of Language Testing and Assessment in Non-formal Education: The Case of English Language Schools in Turkey

Nurdan Kavakli, Ismail Hakki Mirici

Abstract


Purveying insights from a mixed-method research design, this study aims to enlighten the exploitation of the European guidelines in language testing and assessment practices in non-formal educational settings. Accordingly, three non-formal English language schools renowned for quality in Turkey were taken to in-depth analysis in order to offer a general paradigm from a sample of leading professionals on the utilization of the European benchmarks in language testing and assessment practices. The results have yielded that (1) there is a need for a more practical curriculum molded with a real auditing system for the enhancement of the current language testing and assessment practices; (2) there is a request for the validation process for language certificate examinations implemented in non-formal educational settings; (3) there is a demand for cooperation amidst the allies for the standardization process in language testing and assessment practices. The results are laced with some recommendations and implications for language testing and assessment.

Full Text:

PDF

References


Alderson, J. C. (2007). The CEFR and the need for more research. The Modern Language Journal (MLJ), 91(4), 659–663.

Alderson, J.C., & Banerjee, J. (2008). EALTA’s guidelines for good practice: A test of implementation. Paper presented at the 5th Annual Conference of the European Association for Language Testing and Assessment. Athens, Greece, 8- 11 May, 2008. [On-line: http://www.ealta.eu.org/conference/2008/programme.htm, Retrieved on 15 February, 2017.]

Alderson, J. C. (2010). A survey of aviation English tests. Language Testing, 27(1), 51-72.

Association of Language Testers in Europe (ALTE). (2012). Constitution for the association of language testers in Europe. [On-line: http://www.alte.org/docs/constitution-2012.pdf, Retrieved on 16 June, 2016.]

Banerjee, J. (2004). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: Section D: Qualitative analysis methods. Strasbourg: Language Policy Division.

Bjornavold, J. (2000). Making learning visible: Identification, assessment and recognition of non-formal learning in Europe. Luxembourg: European Communities.

Coste, D. (2007). Contextualizing uses of the Common European Framework of Reference for Languages. Paper presented at Council of Europe Policy Forum on use of the CEFR, Strasbourg 2007. [On-line: http://www.coe.int/T/DG4/Linguistic/Source/SourceForum07/D-Coste_Contextualise_EN.doc, Retrieved on 25 September, 2018,]

Council of Europe (CoE). (2000). Resolution on the European language portfolio. Adopted at the 20thsession of the Standing conference of the ministers of education of the Council of Europe, Cracow, Poland, 15-17 October, 2000. [On-line: http://culture.coe.int/portfolio, Retrieved on 7 February, 2017.]

Council of Europe (CoE). (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.

Council of Europe (CoE). (2005). Reference level descriptions for national and regional languages (RLD) – Guide for the production of RLD (Version 2). Strasbourg: Language Policy Division.

Council of Europe (CoE). (2009a). Relating language examinations to the common European framework of reference for languages: Learning, teaching, assessment (CEFR): A manual. Strasbourg: Language Policy Division.

Council of Europe (CoE). (2009b). Relating language examinations to the common European framework of reference for languages: Learning, teaching, assessment (CEFR): Further material on maintaining standards across languages, contexts and administrations by exploiting teacher judgment and IRT scaling. Strasbourg: Language Policy Division.

Council of Europe (CoE). (2011). Manual for language test development and examining: For use with the CEFR. Strasbourg: Language Policy Division.

De Jong, J. H. A. L., & Zheng, Y. (2011). Research Note: Applying EALTA guidelines: A practical case study on Pearson Test of English Academic. London: GB Pearson.

Eckes, T. (2009). Reference Supplement to the preliminary pilot version of the Manual for Relating Language examinations to the CEF: Section H: Many- Facet Rasch Measurement. Strasbourg: Language Policy Division.

Erickson, G., & Figueras, N. (2010). EALTA guidelines for good practice in language testing and assessment: Large scale dissemination days. [Online http://www.ealta.eu.org/documents/archive/GGP_dissemination_report.pdf, Retrieved on 15 July, 2016.]

European Association for Language Testing and Assessment (EALTA). (2006). EALTA guidelines for good practice in language testing and assessment. [On-line: http://www.ealta.eu.org/documents/archive/guidelines/English.pdf, Retrieved on 19 October, 2016.]

Holliday, A. (1992). Tissue rejection and informal disorders in ELT projects: collecting the right information. Applied Linguistics, 13(4), 403-424.

International Language Testing Association (ILTA). (2007). Guidelines for practice in English. [On-line: http://c.ymcdn.com/sites/iltaonline.siteym.com/resource/resmgr/docs/ilta_guidelines.pdf, Retrieved on 20 September 2016.]

Kaftandjieva, F. (2004). Reference supplement to the preliminary pilot version o the manual fo relating language examinations to the CEF: Section B: Standard setting. Strasbourg: Language Policy Division.

Karaboğa, K. (2013, 23 December). İngilizce’ye yılda 100 milyon [100 billion Turkish liras for learning English]. Dünya [The World]. [On-line: https://www.dunya.com/ekonomi/ingilizceye-yilda-100-milyon-haberi-231840, Retrieved on 10 November, 2017.]

Kavaklı, N., & Arslan, S. (2017). Applying EALTA Guidelines as baseline for the foreign language proficiency test in Turkey: The case of YDS. International Journal of Curriculum and Instruction (IJCI), 9(1), 104-118.

Kavaklı, N. (2018). CEFR oriented testing and assessment practices in non-formal English language schools in Turkey. Unpublished PhD Thesis. Ankara: Hacettepe University.

Kavaklı, N., & Arslan, S. (2019). Towards a continuum from know-how to show-how for developing EFL student-teachers’ assessment literacy. International Online Journal of Education and Teaching (IOJET), 6(1), 223-232.

Kavaklı, N., & Mirici, İ. H. (2018). The utilization of the European standards for defining educational assessment: teacher-tester attributes and directors’ control. Selçuk University Journal of Faculty of Letters (SEFAD), 40, 171-190.

Lambert, D., & Lines, D. (2000). Understanding assessment: Purposes, perceptions, practice. London, UK: Routledge Falmer.

Little, D. (2005). The common European framework and the European language portfolio: Involving learners and their judgements in the assessment process. Language Testing, 22(3), 321-336.

Mirici, İ. H. (2008). Development and validation process of a European language portfolio model for young learners. Turkish Online Journal of Distance Education (TOJDE), 9(2), 26-34.

Mirici, İ. H. (2015). Contemporary ELT practices across Europe. International Journal of Language Academy (IJLA), 3(4), 1-8.

Mirici, İ. H., & Kavaklı, N. (2017). Teaching the CEFR-oriented practices effectively in the MA program of an ELT department in Turkey. International Online Journal of Education and Teaching (IOJET), 4(1), 74-85.

North, B. (2005). Le Cadre européen commun de référence: Introduction. [The Common European framework of reference: Introduction]. Paper presented at the Journée Pédagogique, 15 June, 2005, Paris, France. On-line: http://www.alliance-us.org/dg/ documentupload/cecrBrianNorth.pdf., Retrieved on 9 April 2017.]

Saville, N. (2005). An interview with John Trim at 80. Language Assessment Quarterly, 2(4), 263-288.

Schaerer, R. (2005). European language portfolio: Interim report 2005 with executive summary. Strasbourg: Language Policy Division.

Spöttl, C., Kremmel, B., Holzknecht, F., & Alderson, J. C. (2016). Evaluating the achievements and challenges in reforming a national language exam: The reform team’s perspective. Papers in Language Testing and Assessment, 5(1), 1-22.

Taber, K. S. (2000). Case studies and generalizability: Grounded theory and research in science education. International Journal of Science Education, 22, 469-87.

Toncheva, S., Zlateva, D., & John, P. (2017). Developing as assessment methodology for a universal maritime English proficiency test for deck officers. Paper presented at the 18th Annual General Assembly of the International Association of Maritime Universities (IAMU), 11-13 October, 2017, Varna, Bulgaria. [On-line: https://www.researchgate.net/publication/320419205_Developing_an_assessment_methodology_for_a_universal_Maritime_English_proficiency_test_for_deck_officers, Retrieved on 20 October, 2017.]

Trim, J. L. M. (2005). The role of the Common European Framework of Reference for Languages in teacher training. Lecture delivered during the Ceremony of the 10th Anniversary of the European Centre for Modern Languages of the Council of Europe, 16 September, 2005, Graz, Austria. [On-line: http://www.europarl.europa.eu/RegData/etudes/etudes/join/2013/495871/IPOL-CULT_ET(2013)495871_EN.pdf, Retrieved on 17 November, 2016.]

Valax, P. (2011). The Common European Framework of Reference for Languages: A critical analysis of its impact on a sample of teachers and curricula within and beyond Europe. Unpublished Doctoral Dissertation. University of Waikato, Hamilton, New Zealand.

Verhelst, N. (2004a). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: section C: Classical test theory. Strasbourg: Language Policy Division.

Verhelst, N. (2004b). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: section E: Generalizability theory. Strasbourg: Language Policy Division.

Verhelst, N. (2004c). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: section F: Factor analysis. Strasbourg: Language Policy Division.

Verhelst, N. (2004d). Reference supplement to the preliminary pilot version of the manual for relating language examinations to the CEF: Section G: Item response theory. Strasbourg: Language Policy Division.


Refbacks

  • There are currently no refbacks.


  Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

 

Copyright © 1986 - 2017 by World Council for Curriculum and Instruction (WCCI)
ISSN 1562-0506