<?xml version="1.0" encoding="utf-8"?>
<?sc-transform-do-oumusic-to-unicode?>
<?sc-transform-do-oxy-pi?>
<Item xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Autonumber="false" id="X_EXL885_2" TextType="CompleteItem" SchemaVersion="2.0" PageStartNumber="0" Template="Generic_A4_Unnumbered" DiscussionAlias="Discussion" ExportedEquationLocation="" SecondColour="None" ThirdColour="None" FourthColour="None" Logo="colour" Rendering="OpenLearn" xsi:noNamespaceSchemaLocation="http://www.open.edu/openlearn/ocw/mod/oucontent/schemas/v2_0/OUIntermediateSchema.xsd" x_oucontentversion="2021052404">
	<meta name="aaaf:olink_server" content="http://www.open.edu/openlearn/ocw"/>
	<meta name="dc:source" content="http://www.open.edu/openlearn/education/assessment-secondary-modern-foreign-languages/content-section-0?utm_source=openlearn&amp;utm_campaign=ou&amp;utm_medium=ebook"/>
	<meta name="vle:osep" content="false"/>
	<meta name="equations" content="mathjax"/>
	<CourseCode>EXL885_2</CourseCode>
	<CourseTitle/>
	<ItemID/>
	<ItemTitle>Assessment in secondary modern foreign languages</ItemTitle>
	<FrontMatter>
		<Imprint>
			<Standard>
				<GeneralInfo>
					<Paragraph><b>About this free course</b></Paragraph>
					<Paragraph>This version of the content may include video, images and interactive content that may not be optimised for your device. </Paragraph>
					<Paragraph>You can experience this free course as it was originally designed on OpenLearn, the home of free learning from The Open University –</Paragraph>
					<Paragraph><a href="http://www.open.edu/openlearn/education/assessment-secondary-modern-foreign-languages/content-section-0??utm_source=openlearn&amp;utm_campaign=ol&amp;utm_medium=ebook">www.open.edu/openlearn/education/assessment-secondary-modern-foreign-languages/content-section-0</a></Paragraph>
					<Paragraph>There you’ll also be able to track your progress via your activity record, which you can use to demonstrate your learning.</Paragraph>
				</GeneralInfo>
				<Address>
					<AddressLine/>
					<AddressLine/>
				</Address>
				<FirstPublished>
					<Paragraph/>
				</FirstPublished>
				<Copyright>
					<Paragraph>Copyright © 2016 The Open University</Paragraph>
				</Copyright>
				<Rights>
					<Paragraph/>
					<Paragraph><b>Intellectual property</b></Paragraph>
					<Paragraph>Unless otherwise stated, this resource is released under the terms of the Creative Commons Licence v4.0 <a href="http://creativecommons.org/licenses/by-nc-sa/4.0/deed.en_GB">http://creativecommons.org/licenses/by-nc-sa/4.0/deed.en_GB</a>. Within that The Open University interprets this licence in the following way: <a href="http://www.open.edu/openlearn/about-openlearn/frequently-asked-questions-on-openlearn?utm_source=openlearn&amp;utm_campaign=ou&amp;utm_medium=ebook">www.open.edu/openlearn/about-openlearn/frequently-asked-questions-on-openlearn</a>. Copyright and rights falling outside the terms of the Creative Commons Licence are retained or controlled by The Open University. Please read the full text before using any of the content. </Paragraph>
					<Paragraph>We believe the primary barrier to accessing high-quality educational experiences is cost, which is why we aim to publish as much free content as possible under an open licence. If it proves difficult to release content under our preferred Creative Commons licence (e.g. because we can’t afford or gain the clearances or find suitable alternatives), we will still release the materials for free under a personal end-user licence. </Paragraph>
					<Paragraph>This is because the learning experience will always be the same high quality offering and that should always be seen as positive – even if at times the licensing is different to Creative Commons. </Paragraph>
					<Paragraph>When using the content you must attribute us (The Open University) (the OU) and any identified author in accordance with the terms of the Creative Commons Licence.</Paragraph>
					<Paragraph>The Acknowledgements section is used to list, amongst other things, third party (Proprietary), licensed content which is not subject to Creative Commons licensing. Proprietary content must be used (retained) intact and in context to the content at all times.</Paragraph>
					<Paragraph>The Acknowledgements section is also used to bring to your attention any other Special Restrictions which may apply to the content. For example there may be times when the Creative Commons Non-Commercial Sharealike licence does not apply to any of the content even if owned by us (The Open University). In these instances, unless stated otherwise, the content may be used for personal and non-commercial use.</Paragraph>
					<Paragraph>We have also identified as Proprietary other material included in the content which is not subject to Creative Commons Licence. These are OU logos, trading names and may extend to certain photographic and video images and sound recordings and any other material as may be brought to your attention.</Paragraph>
					<Paragraph>Unauthorised use of any of the content may constitute a breach of the terms and conditions and/or intellectual property laws.</Paragraph>
					<Paragraph>We reserve the right to alter, amend or bring to an end any terms and conditions provided here without notice.</Paragraph>
					<Paragraph>All rights falling outside the terms of the Creative Commons licence are retained or controlled by The Open University.</Paragraph>
					<Paragraph>Head of Intellectual Property, The Open University</Paragraph>
				</Rights>
				<Edited>
					<Paragraph/>
				</Edited>
				<Printed>
					<Paragraph/>
				</Printed>
				<ISBN>978-1-4730-2149-5 (.kdl)<br/> 978-1-4730-2148-8 (.epub)</ISBN>
				<Edition/>
			</Standard>
		</Imprint>
		<Introduction>
			<Title>Introduction</Title>
			<Paragraph>This free course, <i>Assessment in secondary foreign languages</i>, will identify and explore some of the key issues around assessing MFL in secondary schools. Engaging with these issues and debates will help you to reflect upon and develop your assessment practice as a teacher of MFL. You will also develop a greater awareness of how assessment can be used in developing students to become more independent in their use of the target language.</Paragraph>
			<Paragraph>This course is based on a learner-centred approach to teaching that is is underpinned by a constructivist view of learning – the idea that students will construct knowledge and understanding for themselves as a result of classroom activities and experiences.</Paragraph>
			<Paragraph>Now listen to an introduction to this course by its coordinator, Maria Luisa Pérez Cavana:</Paragraph>
			<MediaContent id="a1" src="https://www.open.edu/openlearn/pluginfile.php/684210/mod_oucontent/oucontent/33124/nc3002_2016_pgce_oer_aug011.mp3" type="audio" x_manifest="nc3002_2016_pgce_oer_aug011_1_server_manifest.xml" x_filefolderhash="fe953a88" x_folderhash="fe953a88" x_contenthash="c104c3b3">
				<Transcript>
					<Speaker>Maria Luisa Perez Cavana</Speaker>
					<Remark>Welcome to the Open Educational Resource Unit Assessment in Secondary MFL – Issues in Practise.</Remark>
					<Remark>I'm Maria Luisa Perez Cavana and when designing this unit I drew on my many years in MFL education as a German and Spanish teacher as well as my experience of initial teacher education.</Remark>
					<Remark>Assessment is challenging for MFL teachers in secondary schools because language learning is very complex involving the skills like listening, speaking, writing and reading and also communicative interaction cultural awareness and the willingness to participate and to take risks.</Remark>
					<Remark>So it’s important to understand the importance of assessment in a learner’s language development, in particular what should be assessed and how.</Remark>
					<Remark>This unit is for beginner teachers of MFL in secondary schools.  It starts by looking at what it means to make progress in MFL.  From there it lists a number of key assessment strategies, identifying some challenges assessing language learning.</Remark>
					<Remark>A key aspect here is outlining the differences between affirmative and summative assessment and exploring different assessment approaches.  </Remark>
					<Remark>The unit ends by exploring ideas and beliefs about effective assessment of language learning.</Remark>
					<Remark>I'm sure you will find this unit enjoyable and interesting.</Remark>
				</Transcript>
			</MediaContent>
			<Paragraph>As you work through the activities you will be encouraged to record your thoughts on an idea, an issue or a reading, and how it relates to your practice. Hopefully you will have opportunities to discuss your ideas with colleagues. We therefore suggest that you use a notebook – either physical or electronic – to record your thoughts in a way in which they can easily be retrieved and revisited. If you prefer, however, you can record your ideas in response boxes within the course – in order to do this, and to retrieve your responses, you will need to enrol on the course.</Paragraph>
			<Paragraph>This OpenLearn course is part of a collection of Open University <a href="http://www.open.edu/openlearn/education/free-access-courses-teachers-and-student-teachers?utm_source=openlearn&amp;utm_campaign=ou&amp;utm_medium=ebook">short courses for teachers and student teachers</a>.</Paragraph>
		</Introduction>
		<LearningOutcomes>
			<Paragraph>After studying this course, you should be able to:</Paragraph>
			<LearningOutcome>articulate what it means to make progress in MFL</LearningOutcome>
			<LearningOutcome>list a number of key assessment strategies</LearningOutcome>
			<LearningOutcome>identify the challenges to assessing language learning</LearningOutcome>
			<LearningOutcome>outline the differences between formative and summative assessment</LearningOutcome>
			<LearningOutcome>classify some different assessment approaches.
</LearningOutcome>
		</LearningOutcomes>
		<Covers>
			<Cover template="false" src="https://www.open.edu/openlearn/pluginfile.php/684210/mod_oucontent/oucontent/33124/exl885_2_pdfimage_19x12-6_300d.jpg" type="A4"/>
			<Cover template="false" src="https://www.open.edu/openlearn/pluginfile.php/684210/mod_oucontent/oucontent/33124/exl885_2_epub_1400x1200.jpg" type="ebook"/>
		</Covers>
	</FrontMatter>
	<Unit>
		<UnitID>
			<!-- BLANK -->
		</UnitID>
		<UnitTitle>
			<!-- BLANK -->
		</UnitTitle>
		<!-- SESSION CONTENT BEGINS -->
		<Session>
			<Title>1 What does it mean to make progress in MFL?</Title>
			<Paragraph>Assessment is all about ensuring that students are making progress. But what does this actually mean when learning a modern foreign language? What does progress in the target language look like? In this section you will consider defining good language learning and what this means for assessing progress.</Paragraph>
			<Section>
				<Title>1.1 The good language learner</Title>
				<Paragraph>Making progress in MFL is about students moving towards becoming independent users of the target language. The ultimate goal is for pupils to be able to communicate effectively, understand what is being said, and deduce meaning in the spoken and written word.</Paragraph>
				<Paragraph>Grenfell and Harris (1999) consider good language learning to be about increasing autonomy in the use and development of a second language. They argue that knowing a language is extremely complex and has different levels: that is, fundamental levels of phonetics, phonology, morphology and syntax, as well as the manipulation of sound and organisation of structure. In addition, there has to be communication of meaning with the understanding and expression of ideas, as well as appropriate management of social and cultural ‘dimensions’ of the language (Grenfell and Harris, 1999, p. 41). All of these aspects of target language use will need to be assessed as the students move towards becoming good language learners.</Paragraph>
				<Paragraph>In this context, making progress in language learning goes beyond simple knowledge of vocabulary and grammar structures. Therefore, monitoring and assessment strategies need to support students as they become increasingly independent users of the target language. For Grenfell and Harris, this means an emphasis on ‘learning to learn’ and approaching language learning from a different direction that focuses on the learner – their particular competence profile, learning styles and stage of developmental. Consequently, monitoring and assessment this requires consideration of ‘knowledge about language as well as knowledge of language’, and the inclusion of tasks and activities that develop both (Grenfell and Harris, 1999, p. 50).</Paragraph>
				<Paragraph>If your approach to teaching a language includes also teaching the pupils how to learn a language, then how much and what kind of assessment will also need to reflect this.</Paragraph>
				<Box>
					<Heading>Reflection point</Heading>
					<Paragraph>Consider the assessment strategies you have observed in a school context or begun to use in your own teaching.</Paragraph>
					<Paragraph>What aspects of language learning are assessed? How much consideration is given to pupils’ knowledge about language as well as of the language?</Paragraph>
				</Box>
			</Section>
			<Section>
				<Title>1.2 External assessment</Title>
				<Paragraph>In addition to monitoring and assessing students to support their development as good language learners, students will also need to make progress according to external criteria. These include any statutory curriculum requirements and national examinations such as GCSE and A levels. Curriculum requirements differ from nation to nation, along with the criteria against which pupils’ progress is measured, but schools need to find a way of monitoring and assessing students to demonstrate fulfilment of these.</Paragraph>
				<Paragraph>For example, the National Curriculum guidance for England, introduced in 2013, states that MFL teaching should enable pupils to ‘to understand and communicate personal and factual information that goes beyond their immediate needs and interests, developing and justifying points of view in speech and writing, with increased spontaneity, independence and accuracy.’ It sees progress in terms of grammar, vocabulary and linguistic competence, which includes initiating and developing conversations, expressing ideas and coping with unfamiliar language. ‘Linguistic competence’ refers to competence in speaking, listening, reading and writing (the four skills).</Paragraph>
				<Activity>
					<Heading>Activity 1</Heading>
					<Timing>Allow about 1 hour</Timing>
					<Question>
						<Paragraph>Consider how external or statutory examinations assess language learning in a school context that you know of. In your opinion, to what extent do the criteria allow pupils to demonstrate all aspects of the good language learner as defined by Grenfell and Harris? Make a note of your thoughts.</Paragraph>
					</Question>
				</Activity>
			</Section>
			<Section>
				<Title>1.3 Validity and reliability</Title>
				<Paragraph>Any assessment should be both valid and reliable. Validity asks whether grades generated by the kind of statutory testing described earlier represent a student’s achievement in the whole of the subject. Can a series of timed, written tests at the end of a key stage assess all those things MFL teachers think are important for students to learn about?</Paragraph>
				<Paragraph>An over-reliance on test results may lead teachers to make generalisations and judgements about a pupil’s capability in all aspects of a subject, based on the formal testing of a subset. For example, a National Curriculum level tells us nothing about a pupil’s problem-solving ability or creativity, nor about their ability to work in groups or engage in extended tasks. Perhaps all that can be said is that the tests simply tell the teacher about the capabilities of pupils to answer questions at a particular time and of a particular type (and in the conditions and circumstances of the test) – no more and no less.</Paragraph>
				<Paragraph>Reliability asks whether pupil performance changes (or not) depending on the particular questions that are set. Ideally, assessments should give every pupil optimal opportunity to demonstrate what they know. In practice, however, tests have been found to be biased against pupils from particular backgrounds, socio-economic classes, ethnic groups or gender (Pullin, 1993). Equity issues are particularly important when assessment results are used to label pupils or deny them access to courses or careers in the future.</Paragraph>
			</Section>
		</Session>
		<Session>
			<Title>2 What should be assessed in MFL learning and how?</Title>
			<Paragraph>Having thought about what is meant by progress in MFL learning, this session will help you think further about the specifics of assessment, and to understand the importance of assessment in a learner’s language development. In particular, you will consider what should be assessed and how.</Paragraph>
			<Section>
				<Title>2.1 What should MFL teachers assess?</Title>
				<Paragraph>You have already considered how there are multiple things that need to be assessed in the MFL classroom – the four skills, cultural understanding, willingness to participate, willingness to take risks, and so on. Any assessment methods to monitor progress should be clearly linked to the teaching and learning that has taken place. Atkinson and Lazarus (2002) state:</Paragraph>
				<Quote>
					<Paragraph>The greater the harmony between teaching methods and assessment methods, the more likely they suggest that the greater the harmony between the two, the more likely that the outcomes of each will correspond; for example, the more likely it is that assessment results will give an accurate picture of what has been learned and the more likely also that these learning outcomes will correspond with the original objectives.</Paragraph>
				</Quote>
				<Paragraph>In considering what should be assessed, Atkinson and Lazarus (2002) identify two broad categories: fluency and accuracy.</Paragraph>
				<Paragraph>Fluency consists of the following:</Paragraph>
				<BulletedList>
					<ListItem>achieving a task</ListItem>
					<ListItem>conveying a message</ListItem>
					<ListItem>making meaning</ListItem>
					<ListItem>being creative</ListItem>
					<ListItem>effective communication.</ListItem>
				</BulletedList>
				<Paragraph>Accuracy includes:</Paragraph>
				<BulletedList>
					<ListItem>pronunciation</ListItem>
					<ListItem>accent</ListItem>
					<ListItem>grammar</ListItem>
					<ListItem>spelling.</ListItem>
				</BulletedList>
				<Activity>
					<Heading>Activity 2</Heading>
					<Timing>Allow about 1 hour</Timing>
					<Question>
						<Paragraph>Reflect on how these criteria are assessed in a school context that you know about and how they relate to the four language skills of listening, speaking, reading and writing. Is there a greater emphasis on some of these criteria than others? Why do you think this is? Make a note of your thoughts.</Paragraph>
					</Question>
				</Activity>
			</Section>
			<Section>
				<Title>2.2 Using assessment to support learning</Title>
				<Paragraph>How assessment is carried out and how students are able to respond to it is of prime importance if it is to support their target language development. It is not simply what a teacher does that is important, but how it is done. Various techniques and approaches are available to teachers, and choosing the most appropriate approach requires skill and knowledge. You may well have already seen how experienced teachers adopt different assessment strategies depending on the type of activity or its focus; for example, whether it concerns the introduction of new language or the practise or manipulation of already familiar vocabulary and/or grammar.</Paragraph>
				<Paragraph>Assessment can be summative (assessment of learning) or formative (assessment for learning). Effective assessment is planned and integrated into everyday lessons so that you are aware of what the students have learned during a lesson, after a lesson, after a sequence of lessons and at the end of a course or academic year. Formative assessment can be carried out by the teacher or by the pupils themselves through self- or peer assessment.</Paragraph>
				<Paragraph>The purpose of assessment <b>of</b> learning (AoL) is to find out what pupils know, understand and can do, which may then be used for formal certification, to report progress to parents, and to judge teacher and school effectiveness.</Paragraph>
				<Paragraph>Assessment <b>for</b> learning (AfL) also finds out what pupils know, understand and can do, but includes the pupil in the process, and enables the teacher to plan how to help the pupils make progress and develop their understanding and skills.</Paragraph>
			</Section>
			<Section>
				<Title>2.3 Assessing language skills</Title>
				<Paragraph>In the MFL classroom, where a lesson will often consist of several small steps that each build on the one before, it is important that the teacher constantly assesses the students’ progress at the end of each step, as well as at the end of each lesson, to ensure that the students are ready to move to the next level of activity. This is particularly important when new language is introduced into the lesson. The students need to become familiar with that language before moving on to practise its use in different ways before being ready to perform and/or manipulate that language independently.</Paragraph>
				<Paragraph>The next activity will enable you to consider what needs to be assessed in MFL teaching and learning, and how that assessment can be managed and made effective.</Paragraph>
				<Activity>
					<Heading>Activity 3</Heading>
					<Timing>Allow about 90 minutes </Timing>
					<Question>
						<Paragraph>Read the document <olink targetdoc="Good assessment practice in modern foreign languages (MFL)">‘Good assessment practice in modern foreign languages (MFL)’</olink>, which sets out Ofsted’s view of good practice in the assessment of MFL. (Ofsted is the inspection body for education in England.)</Paragraph>
						<Paragraph>Summarise the advice it gives in a table, listing the assessment activities and examples of good assessment practice that matches these activities. Some examples are provided in Table 1.</Paragraph>
						<Table>
							<TableHead>Table 1 Good practice in MFL assessment</TableHead>
							<tbody>
								<tr>
									<th>Assessment opportunity</th>
									<th>Example of good practice</th>
									<th>Explanation</th>
								</tr>
								<tr>
									<td>Oral work</td>
									<td>Correction of pronunciation and intonation</td>
									<td>The teacher is by and large the ‘model’ for correct pronunciation and intonation</td>
								</tr>
								<tr>
									<td>Focused questioning</td>
									<td>Teacher asks closely focused questions to elicit understanding (e.g. grammatical patterns)</td>
									<td>The ‘Socratic’ approach (using questions to guide the learner to a better understanding) is a very effective technique</td>
								</tr>
								<tr>
									<td>Plenary</td>
									<td><FreeResponse id="fr11" size="paragraph"/></td>
									<td><FreeResponse id="fr12" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Vocabulary testing</td>
									<td><FreeResponse id="fr21" size="paragraph"/></td>
									<td><FreeResponse id="fr22" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Written work</td>
									<td><FreeResponse id="fr31" size="paragraph"/></td>
									<td><FreeResponse id="fr32" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Homework</td>
									<td><FreeResponse id="fr41" size="paragraph"/></td>
									<td><FreeResponse id="fr42" size="paragraph"/></td>
								</tr>
								<tr>
									<td><FreeResponse id="fr50" size="paragraph"/></td>
									<td><FreeResponse id="fr51" size="paragraph"/></td>
									<td><FreeResponse id="fr52" size="paragraph"/></td>
								</tr>
								<tr>
									<td><FreeResponse id="fr60" size="paragraph"/></td>
									<td><FreeResponse id="fr61" size="paragraph"/></td>
									<td><FreeResponse id="fr62" size="paragraph"/></td>
								</tr>
							</tbody>
						</Table>
					</Question>
				</Activity>
				<Paragraph>Go back to the different elements in the two categories identified by Atkinson and Lazarus (2002) that should be assessed in MFL: fluency and accuracy. How do the assessment activities and examples of good practice that you have noted in the table help you to assess these? Add any other examples that you have observed or used in your own school context.</Paragraph>
			</Section>
			<Section>
				<Title>2.4 Involving students in the assessment process</Title>
				<Paragraph>It is not only the teacher who can carry out assessment; students can also assess their own learning. Involving students in assessment this has the potential to empower them and lead to a greater commitment to learning and progress. Students are more likely to understand the learning goals and assessment criteria if they are discussed and devised with them rather than imposed on them. Students will also become more engaged in their learning, and will build their confidence in discussing work with peers in a reflective, collaborative process, which in turn will develop their metacognition skills.</Paragraph>
				<Paragraph>This means encouraging students to review their work critically and constructively, and involving them in identifying the learning goals that they will work towards (see Black and William, 1998).</Paragraph>
				<Paragraph>Involving students in the assessment process will be considered further in Section 3.</Paragraph>
			</Section>
		</Session>
		<Session>
			<Title>3 How can we use assessment to enable MFL learning?</Title>
			<Paragraph>Having considered what we mean by progress in MFL and what should be assessed, this session looks at how using assessment can support students to develop their language skills. You will consider:</Paragraph>
			<BulletedList>
				<ListItem>the role of feedback and target setting</ListItem>
				<ListItem>how involving students in the assessment process can contribute to their learning</ListItem>
				<ListItem>how assessment can be used to support students in becoming independent learners.</ListItem>
			</BulletedList>
			<Section>
				<Title>3.1 Including students in the assessment process</Title>
				<Paragraph>Involving students in their language learning assessment supports their progress as they need to develop an understanding of what constitutes ‘success’.</Paragraph>
				<Paragraph>You may have seen occasions where a teacher has involved the students in the assessment process by:</Paragraph>
				<BulletedList>
					<ListItem>sharing learning goals and assessment criteria with the students</ListItem>
					<ListItem>helping students know and recognise the standards they are aiming for</ListItem>
					<ListItem>involving students in self-assessment</ListItem>
					<ListItem>providing feedback that helps students recognise their next steps and how to take them</ListItem>
					<ListItem>reviewing and reflecting on assessment data with students.</ListItem>
				</BulletedList>
				<Paragraph>Encouraging students to reflect on their own work and that of their peers is an important language learning strategy, because it builds higher-order thinking skills. In addition, being able to monitor your own progress against learning outcomes (i.e. to self-assess) is important in becoming an independent learner. Discovering for yourself how to move forward (i.e. to use self-assessment formatively) develops self-regulation and self-efficacy. An improved ability to self-assess is an outcome of engaging with criteria and giving feedback, which is required in peer assessment.</Paragraph>
				<Paragraph>Peer assessment is an important tool in helping students to move towards using the target language independently as they develop the ability to self-assess effectively and use metacognitive skills to regulate their own learning. Metacognition is a process requiring knowledge about both cognition and how to control, monitor and regulate cognitive processes (Anderson and Krathwohl, 2001).</Paragraph>
				<Paragraph>As students learn to become more self-regulatory and therefore independent in facilitating their own target language learning, they are able to monitor, direct and regulate their own actions towards their learning goals.</Paragraph>
			</Section>
			<Section>
				<Title>3.2 The impact of feedback on student progress in MFL</Title>
				<Paragraph>Feedback on students’ progress in the MFL classroom takes place during a lesson constantly. You may have already observed experienced teachers as they correct students’ pronunciation in oral work, provide suggestions to reading or writing tasks as they circulate around the room, and praise correct usage of grammar or recollection of vocabulary. Immediate feedback like this supports students within a lesson, helping them to adjust or correct their responses to oral or written tasks.</Paragraph>
				<Paragraph>Other forms of feedback may include a written assessment of performance with targets set on how to improve. As well as feedback from the teacher to the student, it can also be from one student to another, or from a student to the teacher.</Paragraph>
				<Paragraph>Many theories have been proposed as to the most effective forms of student feedback. Some schools still use effort grades and marks out of 10, while others use National Curriculum levels and GCSE grades.</Paragraph>
				<Paragraph>Feedback is most effective when the system is transparent, and students understand exactly how successful they have been and how they can improve. Feedback that is discussed with the students is particularly effective and allows them to contribute to identifying how they have fulfilled the success criteria and any areas for improvement. In order for students to make progress, any feedback needs to include a summary of what has been achieved, the points to improve on and what the learner actually needs to do to correct the weaknesses in a piece of work.</Paragraph>
				<Paragraph>William and Black (2002) suggest a number of effective forms of feedback that enable students to make decisions about their future learning and become more effective learners. The next activity will help you identify these.</Paragraph>
				<Activity>
					<Heading>Activity 4</Heading>
					<Timing>Allow about 2 hours</Timing>
					<Question>
						<Paragraph>Read the article ‘<a href="https://www.tes.com/magazine/archive/feedback-best-nourishment">Feedback is the best nourishment</a>’ (William and Black, 2002) and note the most effective forms of feedback, as suggested by the authors in a table like Table 2 below. Complete a second column to add your opinion of the benefit or drawback of the form of feedback, and a third column to note when you might use this form of feedback in MFL lessons.</Paragraph>
						<Paragraph>The first row of the table has been filled in for you as an example.</Paragraph>
						<Table>
							<TableHead>Table 2  Forms of feedback</TableHead>
							<tbody>
								<tr>
									<th>Form of feedback</th>
									<th>Benefit/drawback?</th>
									<th>When to use in MFL?</th>
								</tr>
								<tr>
									<td>Oral feedback from the teacher to the student</td>
									<td>More immediate and personal</td>
									<td>During group or pair work</td>
								</tr>
								<tr>
									<td>Giving a mark</td>
									<td><FreeResponse id="fs11" size="paragraph"/></td>
									<td><FreeResponse id="fs12" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Giving a written comment</td>
									<td><FreeResponse id="fs21" size="paragraph"/></td>
									<td><FreeResponse id="fs22" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Student-to-student (peer) assessment</td>
									<td><FreeResponse id="fs31" size="paragraph"/></td>
									<td><FreeResponse id="fs32" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Student self-assessment</td>
									<td><FreeResponse id="fs41" size="paragraph"/></td>
									<td><FreeResponse id="fs42" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Focus of feedback</td>
									<td><FreeResponse id="fs51" size="paragraph"/></td>
									<td><FreeResponse id="fs52" size="paragraph"/></td>
								</tr>
							</tbody>
						</Table>
					</Question>
				</Activity>
			</Section>
			<Section>
				<Title>3.3 Target setting</Title>
				<Paragraph>An important part of feedback is to set targets that to support students’ further progress in their use of the target language. Assessment information can also be used to help the teacher decide on the next steps in their teaching and inform their planning of future lessons.</Paragraph>
				<Paragraph>These targets give every learner a ‘next step’ to take in improving their learning in a logical and systematic manner. The more that the students are involved in setting these next steps themselves, the more they learn – and the more they also learn about the skills involved in language learning.</Paragraph>
				<Paragraph>Good language learners are usually able to set out their next steps with only minimal assistance. Helping less accomplished or less effective language learners to consider criteria and set out appropriate next steps for themselves can be difficult, but it will help them move towards becoming more successful and independent learners of the target language.</Paragraph>
				<Paragraph>To be effective, student targets should be:</Paragraph>
				<BulletedList>
					<ListItem>negotiated with the student (so that they have ownership of the targets)</ListItem>
					<ListItem>achievable and realistic</ListItem>
					<ListItem>relevant and pertinent to the student’s progression in MFL (this involves knowing the student and their work, and identifying the most significant factors hindering progress)</ListItem>
					<ListItem>limited in number (it is easier for a student to concentrate on one or two targets, and success in these will improve their motivation)</ListItem>
					<ListItem>concise, focused and specific</ListItem>
					<ListItem>supported with suggestions for actions (these indicate how the targets might be achieved)</ListItem>
					<ListItem>clear in terms of indicating criteria for success (so that students identify when they have reached their targets).</ListItem>
				</BulletedList>
				<Activity>
					<Heading>Activity 5</Heading>
					<Timing>Allow about 1 hour</Timing>
					<Question>
						<Paragraph>Watch the video clip <a href="https://www.youtube.com/watch?v=r7k5Bds5E1I">‘Secondary assessment for learning – modern foreign languages’</a> about assessment for learning (AfL) in MFL. (Alternatively, you can read a <olink targetdoc="‘Secondary assessment for learning – modern foreign languages’ transcript">transcript</olink>.) As you do so, make notes on the different approaches to AfL in MFL that you see. How do they support students in becoming good language learners? Use the following questions to help you:</Paragraph>
						<BulletedList>
							<ListItem>What aspects of the assessment process are shared with students?</ListItem>
							<ListItem>Who sets deadlines?</ListItem>
							<ListItem>How is assessment used to support students’ progress?</ListItem>
							<ListItem>How are targets set?</ListItem>
							<ListItem>How are students encouraged to reflect on their learning?</ListItem>
							<ListItem>What do you need to consider when planning for peer and self-assessment?</ListItem>
						</BulletedList>
					</Question>
				</Activity>
			</Section>
		</Session>
		<Session>
			<Title>4 What are the challenges to effective assessment in MFL?</Title>
			<Paragraph>There are a number of challenges to assessing progress in language learning, particularly how to assess the different aspects of language learning in a classroom context, how to record assessment and the role of target language in assessment. This section will help you think further about some of these aspects of assessment.</Paragraph>
			<Box>
				<Heading>Reflection point</Heading>
				<Paragraph>Which aspects of language learning do you find most difficult to assess?</Paragraph>
				<Paragraph>Can you think of any reasons for this?</Paragraph>
			</Box>
			<Section>
				<Title>4.1 Assessing oral work</Title>
				<Paragraph>Assessing oral work can present MFL teachers with a particular challenge. There are many reasons why this is so, such as:</Paragraph>
				<BulletedList>
					<ListItem>the size of classes can make it difficult for teachers to hear all students regularly use spoken language independently</ListItem>
					<ListItem>a lot of the speaking work done in class may be ‘practice’ rather than the independent production of language</ListItem>
					<ListItem>spoken work is ephemeral, and it is difficult to record the outcomes of speaking activities during lessons, especially if the teacher leads the activity and cannot record students at the same time</ListItem>
					<ListItem>at the higher levels of performance, few people other than the teacher can provide the stimulus that students need to extend the scope of the language they produce.</ListItem>
				</BulletedList>
				<Activity>
					<Heading>Activity 6</Heading>
					<Timing>Allow about 1 hour</Timing>
					<Question>
						<Paragraph>In this activity you will look at issues involved in assessing oral work in MFL. Look at the following settings for oral work:</Paragraph>
						<BulletedList>
							<ListItem>role-plays and simulations</ListItem>
							<ListItem>asking and answering open-ended questions</ListItem>
							<ListItem>use of classroom language</ListItem>
							<ListItem>use of spontaneous language</ListItem>
							<ListItem>mini-talks or presentations made individually or in groups (for example, using illustrations on a whiteboard or in a PowerPoint presentation).</ListItem>
						</BulletedList>
						<Paragraph>Using Table 3, note down in the middle column which setting from the list above could be used to assess the component of oral work listed in the first column.</Paragraph>
						<Paragraph>In the third column, note the type of record you would make.</Paragraph>
						<Paragraph>One example has been provided for you.</Paragraph>
						<Table>
							<TableHead>Table 3 Assessing speaking – setting and records</TableHead>
							<tbody>
								<tr>
									<th>Component to assess</th>
									<th>Possible setting</th>
									<th>Type of record</th>
								</tr>
								<tr>
									<td>Pronunciation</td>
									<td>
										<Paragraph>Pair work</Paragraph>
										<Paragraph>Role-plays or simulations</Paragraph>
									</td>
									<td>
										<Paragraph>Note students whose sounds are particularly French, German or Spanish</Paragraph>
										<Paragraph>Note students who need to work on the sounds</Paragraph>
										<Paragraph>Note sounds that the class needs to hear and practise</Paragraph>
									</td>
								</tr>
								<tr>
									<td>Intonation</td>
									<td><FreeResponse id="ft11" size="paragraph"/></td>
									<td><FreeResponse id="ft12" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Range of vocabulary</td>
									<td><FreeResponse id="ft21" size="paragraph"/></td>
									<td><FreeResponse id="ft22" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Initiative</td>
									<td><FreeResponse id="ft31" size="paragraph"/></td>
									<td><FreeResponse id="ft32" size="paragraph"/></td>
								</tr>
								<tr>
									<td>Accuracy</td>
									<td><FreeResponse id="ft41" size="paragraph"/></td>
									<td><FreeResponse id="ft42" size="paragraph"/></td>
								</tr>
							</tbody>
						</Table>
					</Question>
				</Activity>
				<Paragraph>Despite the challenges, there are many speaking tasks that can be carried out during lessons that afford opportunities for assessment, for example when students are engaged in pair work.</Paragraph>
				<Paragraph>When assessing oral work, both permanent and ephemeral evidence can be gathered. Permanent evidence will often consist of recordings of spoken work that can be assessed at a later date.</Paragraph>
				<Paragraph>Ephemeral evidence is produced at the moment of learning and consists of actions or words. It is important to listen to students as they talk, and to ask them questions that will allow them to demonstrate their level of attainment. Gathering such data is time-consuming, so it is important to identify in advance which students are to be assessed and which aspect of their speaking work needs to be assessed, so that no time or opportunities are wasted.</Paragraph>
				<Paragraph>You may also wish to refer back to the elements identified by Lazarus and Atkinson in session 2. How might you assess the different aspects relating to ‘fluency’?</Paragraph>
			</Section>
			<Section>
				<Title>4.2 Keeping student records in MFL</Title>
				<Paragraph>With so much to assess in the MFL classroom, another challenge for all teachers, but especially beginner teachers, is what assessment to record and in what way.</Paragraph>
				<InternalSection>
					<Heading>Reasons for keeping a record of students’ progress</Heading>
					<Paragraph>It is important to keep records so that you are able to monitor the progress of individual students over a period of time. Keeping records allows the teacher to see whether individual students are making consistent and appropriate progress in all areas of language learning or whether a student finds a particular aspect of language learning more difficult. You can also look for patterns that tell you if a student is working at their identified level or if they may need some form of intervention or particular support.</Paragraph>
				</InternalSection>
				<InternalSection>
					<Heading>How to record student progress in MFL</Heading>
					<Paragraph>For any assessment information to be useful it, therefore, has to be meaningful. It will also need to make sense to you some time after it has been recorded!</Paragraph>
				</InternalSection>
				<Activity>
					<Heading>Activity 7</Heading>
					<Timing>Allow about one hour</Timing>
					<Question>
						<Paragraph>Look at the record of student progress in Table 4.</Paragraph>
						<Table>
							<TableHead>Table 4 Student progress</TableHead>
							<tbody>
								<tr>
									<th>Date</th>
									<th>2 March</th>
									<th>16 March</th>
									<th>16 March</th>
									<th>20 March</th>
									<th>23 March</th>
									<th>27 March</th>
								</tr>
								<tr>
									<td><b>Task</b></td>
									<td>Homework: family tree</td>
									<td>Unit test: writing</td>
									<td>Unit test: listening</td>
									<td>Speaking test: out of 28</td>
									<td>Classwork: reading Unit 3, page 6</td>
									<td>Vocabulary test: schoolbag items, out of 12</td>
								</tr>
								<tr>
									<td><b>Student 1</b></td>
									<td>✔</td>
									<td>Level 2</td>
									<td>Level 2</td>
									<td>25</td>
									<td>B</td>
									<td>11</td>
								</tr>
								<tr>
									<td><b>Student 2</b></td>
									<td>✔</td>
									<td>Level 1</td>
									<td>Level 2</td>
									<td>24</td>
									<td>B</td>
									<td>11</td>
								</tr>
								<tr>
									<td><b>Student 3</b></td>
									<td>✔</td>
									<td>Level 1</td>
									<td>Level 1</td>
									<td>24</td>
									<td>C</td>
									<td>8</td>
								</tr>
								<tr>
									<td><b>Student 4</b></td>
									<td>✔</td>
									<td>Level 2</td>
									<td>Level 2</td>
									<td>27</td>
									<td>A</td>
									<td>12</td>
								</tr>
								<tr>
									<td><b>Student 5</b></td>
									<td>✔</td>
									<td>Level 3</td>
									<td>Level 3</td>
									<td>26</td>
									<td>A</td>
									<td>12</td>
								</tr>
								<tr>
									<td><b>Student 6</b></td>
									<td>✔</td>
									<td>Level 2</td>
									<td>Level 3</td>
									<td>27</td>
									<td>B</td>
									<td>10</td>
								</tr>
							</tbody>
						</Table>
						<Paragraph>What does this record tell you about the progress of each student? What information does it give you about what each student has learnt? What do the test results tell you about each student’s strengths and weaknesses? As a teacher of MFL what would you need to know about students’ writing, listening, reading and speaking skills that would be useful?</Paragraph>
						<Paragraph>Now look at the example of student progress in Table 5</Paragraph>
						<Table>
							<TableHead>Table 5 Student progress</TableHead>
							<tbody>
								<tr>
									<th>Date</th>
									<th>3 April</th>
									<th>4 April</th>
									<th>10 April</th>
									<th>11/17 April</th>
									<th>18 April</th>
								</tr>
								<tr>
									<td><b>Task</b></td>
									<td>Vocabulary test</td>
									<td>Reading</td>
									<td>Listening</td>
									<td>Speaking</td>
									<td>Writing</td>
								</tr>
								<tr>
									<td><b>Student 1</b></td>
									<td>10</td>
									<td>10</td>
									<td>10</td>
									<td>A P✔</td>
									<td>C A✔</td>
								</tr>
								<tr>
									<td><b>Student 2</b></td>
									<td>9</td>
									<td>10</td>
									<td>8</td>
									<td>A✔ P*</td>
									<td>C✔ A*</td>
								</tr>
								<tr>
									<td><b>Student 3</b></td>
									<td>10</td>
									<td>10</td>
									<td>9</td>
									<td>A P✔</td>
									<td>C A✔</td>
								</tr>
								<tr>
									<td><b>Student 4</b></td>
									<td>9</td>
									<td>10</td>
									<td>9</td>
									<td>A P✔</td>
									<td>C✔ A*</td>
								</tr>
								<tr>
									<td><b>Student 5</b></td>
									<td>4</td>
									<td>6</td>
									<td>5</td>
									<td>A*</td>
									<td>C* A*</td>
								</tr>
								<tr>
									<td><b>Student 6</b></td>
									<td>6</td>
									<td>9</td>
									<td>9</td>
									<td>A* P✔</td>
									<td>C✔ A*</td>
								</tr>
								<tr>
									<td/>
									<td>10 places (inc. gender)</td>
									<td>Recognise 10 places on map</td>
									<td>Recognise places in a dialogue (/10)</td>
									<td>Ask and give directions</td>
									<td>Describe your town</td>
								</tr>
								<tr>
									<td colspan="6">Key: A = accuracy, P = pronunciation, C = content; ✔ = good, * = improvement needed.</td>
								</tr>
							</tbody>
						</Table>
						<Paragraph>What does Table 5 tell you about the progress of each student? What information does it give you about what each student has learned? What can you learn about each student’s strengths and weaknesses? What does it tell you about how the assessment was carried out?</Paragraph>
						<Paragraph>Table 5 is a more helpful record, because the information at the bottom indicates what the students were required to do and some indication of individual strengths and weaknesses.</Paragraph>
					</Question>
				</Activity>
			</Section>
		</Session>
		<!-- SESSION CONTENT ENDS -->
		<Session>
			<Title>Conclusion</Title>
			<Paragraph>In this free course, <i>Assessment in secondary foreign languages</i>, you have considered the complex nature of assessing progress in MFL. It has encouraged you to explore ways of assessing students’ progress and using approaches and strategies that support students towards becoming independent language learners. The challenges to assessment in the MFL classroom remain, but examining the key issues in these sessions will have helped you to become more confident in finding ways to overcome these.</Paragraph>
		</Session>
	</Unit>
	<BackMatter>
		<!-- GLOSSARY
			<Glossary>
				<GlossaryItem>
					<Term/>
					<Definition/>
				</GlossaryItem>
			</Glossary>
			-->
		<References>
			<Reference>Anderson, L.W. and Krathwohl, D.R. (2001) <i>A Taxonomy for Learning, Teaching and Assessing</i>: <i>A Revision of Bloom’s Taxonomy of Educational Objectives</i>, New York, NY, Longman.</Reference>
			<Reference>Atkinson, T. and Lazarus, M.E. (2002) ‘Assessment’, in Swarbrick, A. (ed.), <i>Aspects of Teaching Secondary Modern Foreign Languages</i>, London and New York, NY, Routledge-Falmer, pp. 200–10.</Reference>
			<Reference>Black, P. and William, D. (1998) ‘Inside the black box: raising standards through classroom assessment’, <i>Phi Delta Kappa</i>, vol. 80, no. 2, pp. 139–48 [Online]. Available at <a href="http://www.spd.dcu.ie/site/teaching_today/documents/raisingstandardsthroughclassroomassessment.pdf">http://www.spd.dcu.ie/site/teaching_today/documents/raisingstandardsthroughclassroomassessment.pdf</a> (Accessed 14 March 2016).</Reference>
			<Reference>European Portfolio for Student Teachers of Languages (EPOSTL), [Online]. Available at <a href="http://epostl2.ecml.at/">http://epostl2.ecml.at/</a> (Accessed 14 March 2016).</Reference>
			<Reference>Grenfell, M. and Harris, V. (1999) <i>Modern Languages and Learning Strategies in Theory and Practice</i>, London, Routledge.</Reference>
			<Reference>Pullin, D.C. (1993) ‘Legal and ethical issues in mathematics assessment’, in Mathematical Science Education Board/National Research Council (eds) <i>Measuring What Counts: a Conceptual Guide for Mathematics Assessment</i>, Washington, DC, National Academies Press, pp. 201–23.</Reference>
			<Reference>Teachers TV (2011) ‘Secondary assessment for learning - modern foreign languages’, <i>Promethean Planet</i>, 20 October [Online]. Available at <a href="http://www.prometheanplanet.com/en-gb/Resources/Item/105386/secondary-assessment-for-learning-modern-foreign-languages#.VxDPXkv2bct">http://www.prometheanplanet.com/en-gb/Resources/Item/105386/secondary-assessment-for-learning-modern-foreign-languages#.VxDPXkv2bct</a> (Accessed 15 April 2016).</Reference>
			<Reference>William, D. and Black, P. (2002) ‘Feedback is the best nourishment’, <i>TES</i>, 4 October [Online]. Available at <a href="https://www.tes.com/magazine/archive/feedback-best-nourishment">https://www.tes.com/magazine/archive/feedback-best-nourishment</a> (Accessed 25 April 2022).</Reference>
		</References>
		<FurtherReading>
			<Reference>CLIO (2000) ‘Could Try Harder’ – <i>The LEARN Project: Guidance for Schools on Assessment for Learning</i>, Bristol, CLIO Centre for Assessment Studies.</Reference>
			<Reference>Hargreaves, D. (2001) ‘Opening minds: increasing opportunities – a future for the school curriculum’, paper presented at the RSA/SHA conference, November.</Reference>
			<Reference>Little, D. (2005) ‘The Common European Framework and the European Language Portfolio: involving learners and their judgement in the assessment process’, <i>Language Testing</i>, vol. 22, no. 3, pp. 321–36.</Reference>
			<Reference>McCallum, B. (2000) <i>Formative Assessment: Implications for Classroom Practice</i>, Qualifications and Curriculum Association © Crown Copyright.</Reference>
			<Reference>Sebba, J., Deakin Crick, R., Yu, G., Lawson, H., Harlen, W. and Durant, K. (2008) <i>Systematic Review of Research Evidence of the Impact on Students in Secondary Schools of Self and Peer Assessment</i>, EPPI-Centre, Social Science Research Unit, Institute of Education, University of London, 1614T.</Reference>
			<Reference>The European Centre for Modern Languages (ECML), which is based in Graz, Austria, has produced a number of very good training and learning materials, including some to train pupil teachers to use the ELP: Using the European Portfolio for Student Teachers of Languages (EPOSTL). You can find more information on <a href="http://epostl2.ecml.at/">the EPOSTL website</a>.</Reference>
		</FurtherReading>
		<Acknowledgements>
			<Paragraph>This free course was designed by Maria Luisa Pérez Cavana and written by Elaine Hemmings.</Paragraph>
			<!-- Archive Courses: This free course includes adapted extracts from the course <i>MODULE TITLE</i>. If you are interested in this subject and want to study formally with us, you may wish to explore other courses we offer in [SUBJET AREA AND EMBEDDED LINK TO STUDY @OU].-->
			<Paragraph>Except for third party materials and otherwise stated (see <a href="http://www.open.ac.uk/conditions">terms and conditions</a>), this content is made available under a <a href="http://creativecommons.org/licenses/by-nc-sa/4.0/deed.en_GB">Creative Commons Attribution-NonCommercial-ShareAlike 4.0 Licence</a>.</Paragraph>
			<Paragraph>The material acknowledged below is Proprietary and used under licence (not subject to Creative Commons Licence). Grateful acknowledgement is made to the following sources for permission to reproduce material in this free course: </Paragraph>
			<!--The full URLs if required should the hyperlinks above break are as follows: Terms and conditions link  http://www.open.ac.uk/ conditions; Creative Commons link: http://creativecommons.org/ licenses/ by-nc-sa/ 4.0/ deed.en_GB]-->
			<Paragraph>Course image: Catherine Yeulet/istockphoto.com.</Paragraph>
			<Heading>Text</Heading>
			<Paragraph>‘Good assessment practice in modern foreign languages (MFL)’, Ofsted, HMI 1478, © Crown Copyright 2003. Reproduced under the terms of OGL for PSI.</Paragraph>
			<!-- Please include  further acknowledgements as provided in production specification or by LTS-Rights in following order: Text, Images, Figures, Illustrations, Tables, AV, Interactive assets -->
			<!-- ACKNOWLEDGEMENTS BEGIN -->
			<!-- ACKNOWLEDGEMENTS END -->
			<Paragraph>Every effort has been made to contact copyright owners. If any have been inadvertently overlooked, the publishers will be pleased to make the necessary arrangements at the first opportunity.</Paragraph>
			<Paragraph/>
			<Paragraph><b>Don't miss out</b></Paragraph>
			<Paragraph>If reading this text has inspired you to learn more, you may be interested in joining the millions of people who discover our free learning resources and qualifications by visiting The Open University – <a href="http://www.open.edu/openlearn/free-courses?utm_source=openlearn&amp;utm_campaign=ou&amp;utm_medium=ebook">www.open.edu/openlearn/free-courses</a>.</Paragraph>
		</Acknowledgements>
	</BackMatter>
<settings>
    <numbering>
        <Session autonumber="false"/>
        <Section autonumber="false"/>
        <SubSection autonumber="false"/>
        <SubSubSection autonumber="false"/>
        <Activity autonumber="false"/>
        <Exercise autonumber="false"/>
        <Box autonumber="false"/>
        <CaseStudy autonumber="false"/>
        <Quote autonumber="false"/>
        <Extract autonumber="false"/>
        <Dialogue autonumber="false"/>
        <ITQ autonumber="false"/>
        <Reading autonumber="false"/>
        <StudyNote autonumber="false"/>
        <Example autonumber="false"/>
        <Verse autonumber="false"/>
        <SAQ autonumber="false"/>
        <KeyPoints autonumber="false"/>
        <ComputerDisplay autonumber="false"/>
        <ProgramListing autonumber="false"/>
        <Summary autonumber="false"/>
        <Tables autonumber="false"/>
        <Figures autonumber="false"/>
        <MediaContent autonumber="false"/>
        <Chemistry autonumber="false"/>
    </numbering>
    <discussion_alias>Discussion</discussion_alias>
    <session_prefix/>
<version>2021052404</version></settings></Item>
