Sabtu, 03 Desember 2011

Cognitive Skills in Translating: Creating a web-based learning activity

Cognitive Skills in Translating: Creating a web-based learning activity

  • ISSN 1442-438X
  • CALL-EJ Online
  • Vol. 5, No. 1, June 2003


Paper Presented at Horwood Language Centre, University of Melbourne, 3 December 2002
Intended Audience: K-12 teachers interested in using computers, language teachers

Pedagogical Background

Regardless of the approach on which their instruction has been based, once learners reach a certain level of proficiency in a foreign language, they become increasingly aware of the value of translation as a skill, a tool and an art. They also understand that it is one of many ways for themselves and others to gauge their ability to move across linguistic and cultural frontiers, and appreciate that it is a powerful catalyst for reflection on the nature of language systems. So, in spite of the virtually total eclipse of grammar-translation as the foundation of foreign language learning, translation has justifiably remained an integral part of many intermediate and advanced level courses. It is also the substance of courses aimed specifically at training bilingual speakers to become professional translators and interpreters. The conduct of a translation class, however, provides both teacher and learner with numerous challenges.
Students need to be given adequate opportunity to produce translations which will be evaluated by experts. Practice is an inescapable part of the process of becoming a proficient translator. Frequent encounters with points at which the two language systems diverge allow students to recognise them quickly and to develop reflex strategies for dealing with them. They also hone the complex and at times laborious skills associated with bilingual and monolingual dictionary use.
Learners also need feedback. Typically, at university, a translation assignment is handed out to students one week, submitted the next, and returned in the third week. The delay between the time at which students are actually engaging in the act of translation and when they receive feedback on the success or otherwise of their efforts is problematic. A week or two after the event, students are not always inclined or able to spend time re-analysing the different pathways through a linguistic maze, delving into the complex interrelation of words and ideas within and across sentences, or focusing again on the subtle nuances that distinguish between the many solutions that present themselves for a given problem. If the translation passage is part of an assessment program, the single most important piece of feedback is usually the mark. Students have done the work, the mark is the reward, and all the reflection in the world is not going to alter that. They basically just want to get on with the next assessable task.
From the point of view of the teacher there are other dilemmas. Firstly, no two student translations are the same. Each represents a unique combination of skills, strategies and inadequacies. Each script therefore requires a different set of feedback, and it would be possible to spend a great deal of time in fruitful discussion with every student, one-to-one. This is a task which very few teachers have either the opportunity or inclination to perform, and a luxury which very few institutions could afford. To convert the content of such discussion to written explanations would require considerably more time again. The problem increases in pBoportion to the number of translations students are given to help them master the art, and is exacerbated by the fact that even if written comments were tailored to each student's work, a great many of them would remain unread or undigested. And a lesson in which the teacher attempts to address the needs of every student, may actually meet those of none.
There is also a need for objectivity in weighing up alternatives in translation. To discuss a passage which students have not made a serious attempt to translate can be a very worthwhile task, but there is no guarantee that they will be able to apply the fruits of the collective intellectual labour in performing subsequent translation tasks. However, to discuss a passage which students have made a serious attempt to translate generates a completely different set of problems, mainly of an affective nature. If a corrected translation is handed back to students along with a fair copy, they generally have little difficulty in accepting a situation in which their version, while different, has been deemed equivalent and acceptable by ’higher authority’ in the form of the teacher. It is a different matter, however, in cases where the student translation is signalled as deficient in some respect, particularly when the problem flagged is one of idiom, style or register, rather than grammar, syntax or spelling. Any teacher who has taught a translation class will probably be familiar with the ease with which what begins as a reasoned discussion can, unchecked, flare up into a heated and irrational bun fight once students begin to defend their efforts in relation to the model of a fair copy, and especially in relation to the efforts of their fellow students. Positions tend to be defended even more strongly when the direction of the translation is into the student's mother tongue. Any hint of correction can easily be taken as a slur on first- language proficiency, and the degree of offence taken tends to be proportional to the sense of ownership, which in turn is usually a function of the effort invested in the task. It is in fact very difficult, in the time frame typically associated with translation exercises, to establish the personal and temporal distance necessary for objective analysis. The principle of affective blindness can apply equally to teacher and student.
This paper presents and analyses a web-based activity, ‘Translator Choice’, whose development represents an attempt to use information technology as a means of fostering the cognitive skills required by foreign-language students in their mastery of translation. It will look in turn at the ‘surface structure’ of the activity as encountered by the student, the teacher rationale, the data base on which an activity is constructed, and the returns for the effort and expertise invested by the teacher.

Surface Structure

There are two activities, ‘Select the Most Accurate Translation’ (or ‘Select One’) (see Fig. 1 for basic work screen), and ‘Rank the Translations’ (see Fig. 2 for basic work screen). Each activity can be done in practice or test mode. The alternative translations are displayed in random order each time the screen is presented. On completion of each activity students are awarded a score based on the degree to which their choice or ranking of translations corresponded with the teacher-preferred classification.

Fig. 1 Basic work screen for ‘Select One’ activity

The mechanics of the student's interaction with the material is summarised in the instructions for the activity.

‘Select One’ Instructions:
  • In this activity you are presented with a segment of the passage followed by a set of suggested translations.
  • The translations vary in their accuracy.
  • Click on the translation you consider to be the most accurate. To change your selection, click on a different translation.
  • Once you are satisfied with your choice, click ‘Lock In My Answer’ to register your answer.
  • Once you have locked in your answer, you may wish to use the ‘Show Feedback’ button to explore the merits of the various translations.
  • Click ‘Next Segment’ to move to the next segment of the translation.
  • The ‘View your translation so far’ link allows you to see the current segment in the context of the whole passage at any stage of the activity. It also displays the text of the translation constructed through your choices to that point.

By way of example, the following is the feedback available to a student considering the merits of the fourth-ranked translation:
According to some witnesses, the murderer, a young man, healthy, fair-haired, and built like a surfer,
for the segment:
Selon des témoins, le tueur, un jeune homme blond portant la tenue d'un surfeur,
in the passage ‘Tuerie en Tasmanie’.
Feedback:

some witnesses: ‘selon des témoins’ means ‘according to witnesses’. Although it is possible for the French indefinite article ‘des’ to mean ‘some’ in English, to use ‘some’ here is overtranslation. It may be misleading, suggesting that other witnesses’ opinions differed. If the French had intended to emphasise ‘some’ in this context (i.e. to indicate a quantity), the word ‘quelques’ or ‘certains’ would have been used: ‘selon quelques témoins’, ‘selon certains témoins’.
murderer: ‘killer’ is a more appropriate term in this context. Killings tend to be random, but murder tends to pre-suppose a specific victim.
healthy: This is added information. The original doesn't indicate whether he is healthy or not. The probable source of this error is careless dictionary use. ‘portant’ here is used as the present participle of the verb ‘porter’ (to wear) – i.e. he was wearing surfie clothes. There is, however, a dictionary entry under ‘portant’ which includes the information: étre bien/mal portant – to be healthy or in good health/in poor health.
built like a surfer: The meaning of ‘la tenue’ here is ‘clothing’, and ‘portant la tenue d’un surfeur’ means ‘wearing surfer's clothes’ or ‘dressed like a surfie’.


Fig. 2 Basic work screen for ‘Rank the Translations’ activity


Rank the Translations Instructions:
  • In the ‘Rank the Translations: Practice’ activity you are presented with a segment of the passage followed by a set of suggested translations.
  • The translations vary in their accuracy.
  • Each of the translations is accompanied by a set of buttons.
  • Click on the buttons to grade the translations (1 = most accurate; highest number = least accurate)
  • All suggested translations must be given a ranking.
  • No two translations can be assigned the same ranking.
  • You may change your preferences at any time by clicking on another button in the same row.
  • Once you are satisfied with your choices, you may click “Lock In My Answer” to register your answers and either compare them with the Recommended Ranking or move directly to the Next Segment.
  • The ‘View Full Passage’ button allows you to see the current segment in the context of the whole passage at any stage of the activity.

Teacher rationale

The ‘Translator Choice’ activity is not intended as a substitute for traditional translation exercises, but as a complement to them. It provides a new dimension by enabling learners to encounter and evaluate a range of translations of the same original text. In doing so it takes them beyond the frequently restricted and restrictive world of the apprentice translator, which is typically bounded by the keyboard (or pen and paper), reference material (grammars; dictionaries; comparable documents in the source and target language, web-based or printed), and the student's own intellectual resources. One of the criteria in selecting the variants displayed on the screen is that at some stage they have actually been produced by a genuine translator or would-be translator. And since the variants will seldom if ever have been generated by the students doing the activity, they are in a position to consider the various alternatives in a dispassionate manner, with no vested interest or personal pride to protect. In the case of practice activities they have the choice of working either individually or in small groups, where the final choice can be the result of discussion and negotiation with fellow students.
The results of a preliminary on-paper trial of the exercise in class were of particular interest. The students, who had been given the passage as a translation exercise (part of a larger assignment) the previous year, were a subset of the group from whose written translations the 5 variants had been compiled. When their assignments had been handed back the previous year, accompanied by a fair copy, their reactions had been entirely consistent with that of other generations of students. The assertive or confident or desperate among them had used the corrections indicated on the returned assignments as a platform for launching a public justification of their choices, either in the hope of forcing some concession from the teacher that would result in an upward adjustment of their grade, or as a means sending some signal to their fellow students about the injustice of objective assessment (i.e. exact percentage scores, and any judgement of ‘right and wrong’) being applied to what they were, at least for the sake of that particular debate, choosing to represent as an art. (In that atmosphere the teacher sensed that the students would not have been entirely receptive to the observation that some findings claim that machine translation systems achieve, on average, about 65% as well as expert human translators (ANDERSON, D. 1995:68)) And the less assertive, regardless of the strength of their convictions or the amount of effort they had put into the task, had accepted the rulings of the authority figure, or at least chosen not to voice any disagreement with them.
For the class activity students were divided into groups of 3 and given several consecutive segments of the passage, each accompanied by 5 alternative translations in random order. Students were asked to discuss the alternatives and rank them by accuracy. Virtually without exception their agreed rankings corresponded with those of the teacher. And the fact that none of the students identified personally with any of the variants they were evaluating meant that all justification of choices and deference or concession to the opinions of fellow students was based on linguistic rather than affective premises.
By removing the pencil, paper and reference book components, the web-based activity allows student to focus exclusively on meaning and expression. And it is infinitely less awkward to administer than its on-paper predecessor. To reach a decision requires students to weigh each variant up against the original text and each of the alternatives, and to look at both the detail of the individual semantic units, and the structure and style of the segment as a whole. Students are encouraged to consult dictionaries and other reference materials in the process. At the cognitive level it is in many respects a more demanding task than the production of a single translation, since implied in the process is the need for students to have formed their own clear idea of the meaning of the original. They must then proceed to weigh it up against the set of alternatives, some of which will be more accurate and complete expressions of that meaning than their own version, some less. And given that students are aware that they have only to recognise, rather than produce, an exemplary translation, they sense that their chances of scoring well are higher. The relationship between the activity and conventional translation is similar to that between listening comprehension and speaking, or reading comprehension and writing.
In the ‘Select One’ practice activity students have access to a comprehensive bank of feedback for each translation variant. Workload constraints have previously prevented the author from ever even considering this luxury for his students in 30 years of teaching.
In addition to providing students with a different angle from which to view translation, the computer-managed activities allow the teacher to be confident that students are devoting a certain amount of time to the task without the need for personal supervision or presence in a single classroom. This in turn allows the teacher to focus on other matters during formal class hours.

Data Input

The creation of an activity is essentially an extension of a conventional class translation exercise.
In addition to selecting a passage appropriate to the academic level and professional orientation of the students, and grading their individual performances in that assignment, the teacher has to take the following steps:
  • Divide the passage into a set of discrete sense units (segments). Segment boundaries tend to fall naturally at sentence boundaries, as sentences normally represent the expression of an independent unit of thought. In the case of complex sentences, there are usually natural cleavage points at which it is possible to split the discourse, thus preventing students from having to reflect on and compare unwieldy chunks of text on screen.
  • Using the full range of student translations generated from the class exercise, compile a set of 5 translations of each segment of varying degrees of accuracy and as fully representative as possible of the range problems and solutions associated with conveying the meaning of the original text in the target language.
  • For each alternative translation, compile feedback to explain each point at which it fails to accurately represent the meaning of the original.

A sample compilation of feedback for a single segment is provided in Appendix 1. In this sample, the segment is coded G (it is the 6th segment of the passage), the 5 alternative translations, in order of accuracy, are coded G1-5, and feedback for each translation is coded using lower-case letters (e.g. G4a-d). Once prepared in this form, the data can easily be pasted into the template, and further modified if required (e.g. as a result of input from site users).

Investments and Returns

As data entry fields have been designed to accept and display both standard keyboard input and paste-in graphics, activities can be created for languages from the full spectrum of writing systems. And because the exercises generated are of a receptive and cognitive nature, there is no requirement for students to type in any data. This facet of the design eliminated any need for programmers to create open-ended, unpredictable and costly routines for checking infinitely variable data input by students.
With regard to delivery (i.e. the electronic equivalent of preparing the worksheets handed out to students in the preliminary on-paper version), the computer does all the work, including randomising the display of choices and grading responses. As with any activity, IT-based or not, this exercise can only have the full desired influence on students' learning if it is thoroughly and formally integrated into a course structure and assessment procedures.
Generation of the material is unquestionably painstaking, and the investment of effort and expertise on the part of the teacher in constructing the range of alternative translations and in preparing the feedback would simply not be justifiable for a single class. However, once it exists in electronic form, the activity becomes part of a bank of exercises that can be used by groups of students in other institutions nationally or internationally. Any exercise can be designated as either practice or test, and can be given an ‘active’ or ‘archived’ classification. By giving a teaching resource the capacity to transcend geographical and temporal boundaries, the web platform brings into play an economy of scale factor previously precluded from the individual teacher's equation for materials preparation. One exercise, if carefully constructed, can serve many classes in many institutions over many years. The web base also changes the balance of factors in the teacher-student equation, as it allows the intellectual resources and the time and energy spent in preparation by many teachers to be made available to small groups of students or even to individual learners. The potential scope and longevity of any activity, however, creates a commensurate responsibility on the part of those who manage it to ensure a high level of quality control.

Concluding Remarks

The ‘Translator Choice’ site is not a panacea. It is, like the Transit-TIGER advanced technical translation materials developed by D. Thompson at the University of Hull, an aid in the training of students in translation that enlists the support of computers to manage processes and present information in ways not possible with traditional media in traditional classrooms. It can be used to enrich instruction, free up class time and administer assessable work in a specified time frame.
The activities it generates allow students to achieve objectivity in their appraisal of translation alternatives, and to receive as much or as little feedback on the nature and sources of inaccuracy in those alternatives as they want or require. It is a tool for assembling and preserving resources and expertise in virtually any language, and for disseminating them to a scattered public and over many years. The reservoir of resources requires some management but little in the way of maintenance or ongoing commitment of funds. But like any such resource, it is only as rich as the academic content around which it is built.

Acknowledgements

Professor Sharon Bell, Dean, Faculty of Arts, University of Wollongong, for her support and encouragement, and for her vital role in enabling the project.
Mr Ray Stace, Manager, Educational Development Services, Centre for Educational Development and Interactive Resources (CEDIR), University of Wollongong, for his advice and patience in helping me frame the project in the idiom of IT.
Mr David Elsner, Web Developer/Programmer, The Education Media Laboratory (emlab), Faculty of Education, University of Wollongong, for dedicated and eager application of his skills to converting the specifications into a fully functional site.
Mr Owen McKerrow, Web Developer/Programmer, The Education Media Laboratory (emlab), Faculty of Education, University of Wollongong, for his skill in grasping concepts and specifications expressed by an IT layman and in overseeing their conversion into a Web-based reality.
Mr Robert Wright, Project Director, The Education Media Laboratory (emlab), Faculty of Education, University of Wollongong, for picking up the project and running with it.

References

  • ANDERSON, Don D., ‘Machine Translation as a Tool in Second Langauge Learning’, CALICO Journal Vol. 13/1, p68 (1995), citing the results of the evaluation for the third quarter of WHITE, J.S. et al., ‘The ARPA (Advanced Research Projects Agency) MT Evaluation Methodologies: Evolution, Lessons, and Future Approaches’, AMTA, 1994, 193-205.
  • THOMPSON, D. & J. Thompson, ‘Advanced (Technical) Translation (Italian/English): A Pilot Project’, in Language Learning with Computers, An Educational Challenge, ed. Peter Baumgartner and Anthony Hall, WISL - Werkstatt für interkulturelles und soziales Lernen A - 9020 Klagenfurt, Austria, 1991, 160-173
  • THOMPSON, D. & J. Thompson, TransIt, Advanced [Technical] Translation (Italian to English) Teacher's Manual, Department of Italian, University of Hull, 1993 ISBN 085958 595 6
  • THOMPSON, J. ‘Embedding technology into language examinations: a case study’, in Active Learning ,4 (July 1996) 25-29

Author

Brian McCarthy is an Associate Professor of French, Modern Languages Program. He was appointed to the University of Wollongong as a foundation lecturer in French in 1975. His academic qualifications include a BA with 1st class honours in French, a Master of Arts, a Diploma of Education and a Doctor of Philosophy in Applied Linguistics. In 1994, he received the Vice-Chancellor's Award for Excellence in Teaching. He has been Head of the Modern Languages Program since 1999, the recipient of numerous research grants, and the author of half a dozen textbooks, over 40 research articles and 50 language-learning software modules.

Apendix

Appendix 1: Sample of segment data organised for entry into Web authoring template.


G Nous tapions dessus à coups de bâtons, nous la poursuivions avec des pierres.
G1 We would beat it with sticks and pelt it with stones.
G2 We'd hit it with sticks and went after it with rocks.
G2a we'd: This contracted form of ‘we would’ is too informal and conversational in the context (author narrating, not character speaking). Moreover, followed as it is in this translation by ‘and went after it’, ‘we'd’ could be considered ambiguous, as the same contraction can be used for ‘we had’.
G2b went after it: The French uses the imperfect for both verbs (‘tapions’, ‘poursuivions’), and this indicates that both actions were routinely performed by the children. In this translation two different forms are used, the first ‘we'd hit’ represents the action as a past repeated one, the second ‘we went’ suggests that the second action may have been a one-off event. Suggested translation: ‘and (we would) go after it’
G3 We would beat her with sticks and we'd chase her with stones.
G3a her: There is nothing to suggest that the animal was female. French grammar conventions require the form ‘la’ to used in ‘nous la poursuivions’ because the word ‘bête’ is grammmatically feminine. This does not necessarily imply that the word refers to a female: ‘un lion’, ‘un tigre’, and ‘un chien’ would all be described as ‘une bête’, so would ‘une chèvre’ and ‘une vache’. Suggested translation: ‘beat it with sticks’
G3b we'd chase: This contracted form of ‘we would’ is too informal and conversational in the context (author narrating, not character speaking). Repetition of the auxiliary verb ‘would’ here places unnecessary emphasis on the repeated nature of the action. Even if this emphasis were justified stylistically, it would be very unusual to use two different forms (‘we would’ and ‘we'd’). Suggested translation: ‘We would beat… and chase…’
G4 We would strike it with blows from sticks, and aim for it with stones.
G4a strike: This synonym for ‘hit’ or ‘beat’ has a slightly literary or technical connotation in the context, wherease the word ‘taper’ is relatively informal.
G4b strike it with blows: This translation introduces a tautology (= ‘needless repetition of an idea, especially in other words in the immediate context’) for which there is no basis in the original.
G4c sticks,: The comma is used after ‘bâtons’ in the original to separate the two ideas ‘nous tapions’ and ‘nous poursuivions’, thus presenting them as a list. This stylistic technique does not work well in English in this context, and this has been recognised by the use of ‘and’ to separate the ideas in the translation. However, as the word ‘and’ replaces the comma of the original, the comma in the translation after ‘sticks’ is redundant.
G4d aim for it: Mistranslation. The word ‘poursuivre’ means ‘to pursue’, ‘to chase (after)’. The normal French equivalent of ‘aim (for)’ is ‘viser’.
G5 We were beating it with sticks, we continued with rocks.
G5a were beating: The imperfect tense (‘nous tapions’) can convey two basic meanings in English: a past continuous action (=‘we were (in the process of) beating’), or a past repeated action (=‘we used to beat, we would beat’). In this context it clearly refer to a repeated action, i.e. something the children did regularly. Suggested translation: ‘we would beat’
G5b sticks,: The comma is used after ‘bâtons’ in the original to separate the two ideas ‘nous tapions’ and ‘nous poursuivions’, thus presenting them as a list. This stylistic technique does not work well in English in this context. It is standard practice to use the word ‘and’ instead of a comma.
G5c we continued: (i) Mistranslation. The word ‘poursuivre’ can mean ‘to continue’ (e.g. poursuivre ses études = to continue one's studies). The principal meaning of the word, however, is ‘to pursue, to chase, to hunt down’, and this is clearly the meaning in this context. The children are hunting an animal. (ii) The ‘la’ of ‘nous la poursuivions’ has been omitted from the translation. (iii) The French uses the imperfect for both verbs (‘tapions’, ‘poursuivions’), and this indicates that both actions were routinely performed by the children. The form ‘we continued’ suggests that the second action may have been a one-off event. Suggested translation: ‘and we would go after it’

source: http://callej.org/

Investment and Returns in CALL Development

Investment and Returns in CALL Development

  • ISSN 1442-438X
  • CALL-EJ Online
  • Vol. 4, No. 2, January 2003


The ideas expressed in this paper are part of a stocktaking exercise at the end of a fertile decade of CALL software development prior to embarking on a fresh venture in the field.
They relate to a practical facet of the development process that can all too easily be obscured by passion for the production of effective instructional materials, by fascination with the capabilities and dimensions of a new medium, and by the plain hard slogging involved in conception, design, content generation, trialling and project management. They also represent a challenge to teachers and academics, the author very much included, to be and to remain aware of productivity as factor in planning and development of their own projects, and in their assessment of others.

Perspectives on productivity

It is very easy for the individual whose hands produced a particular item to develop a sense of total ownership, and to be oblivious to the fact that the artisan, the article and the tools are all part of a larger world. Outsiders generally have little difficulty in recognising that, no matter how much skill and professional pride a carpenter making a chair in a company workshop may take in the piece of furniture being created, others such as the supervisor, the manager, and the customer, will all view the workman, the craft and the product differently. In a 21st-century Australian university, academics no more function in a vacuum than does a carpenter in a company workshop, but, because of the intimate and absorbing relationship between the person, the knowledge, and the application of that knowledge, we academics, particularly in traditional Arts disciplines, can go for years without seriously considering how what we are doing fits into the broader picture. Ultimately, however, it is a wider community that establishes the relevance, assesses the merits, and determines the viability of the materials we produce.
Academic developers of computer-based teaching materials thus stand to benefit from reflecting on the way what they are doing does or does not fit with the interests and concerns of other parties. This paper will look at similarities and differences in the perspectives of three key groups regularly involved in CALL development: teachers, academic institutions and commercial publishers. The position of each is group is considered in relation to the motivation for investment, the nature and extent of that investment, and the returns for that investment and consequent impact of those returns on further development.

Motivation to invest effort and resources

Teachers

Teachers' interest in CALL may stem from a variety of factors working independently or in combination.

  • A perception of specific learning needs in their students coupled with a sense that new technologies can stimulate learning by delivering information in fresh ways and by creating rich, flexible instructional processes and learning environments;
  • Awareness that computers increasingly represent an idiom with which the present generation of students is very much at ease;
  • A sense that teachers can play a unique role in recognising and selecting electronic information and resources that will be of most value to learners and in optimising their benefits by organising them, structuring activities, and integrating them into the syllabus;
  • A simple fascination with the technology;
  • A desire to improve learning because, in their vocation of teacher, they derive personal satisfaction from seeing students gain increasing mastery of a foreign language, because improved learning makes teaching easier, and because the process may generate job satisfaction in the form of encouraging feedback from students, colleagues or educational managers.

Institutions

To talk of an institution investing in CALL is a shorthand, depersonalised way of representing decisions regarding the allocation of research and development funds taken by committees of academics and senior management in response to priorities increasingly shaped by the policies and directions promulgated by federal bodies. A primary consideration in this process is the institution's desire to enhance its standing by attracting kudos, further funding, and additional students, and to forge links with business, industry, and other educational institutions. Although many such policies work against or ignore the interests of foreign language learning, some, such as internationalisation, technology enhanced instruction, competitive benchmarking, distance education, degree enhancement, or the need to maintain ‘unfashionable’ disciplines, can work in favour of foreign languages in general and of CALL in particular. Institutions may also be motivated by a deluded notion that technology-enhanced language learning will somehow deliver large unsupervised laboratories crammed for 18 hours a day with full fee paying foreign language students who emerge at the end of a 10-week course equipped to perform as interpreters for high-level trade delegations on sensitive missions to a range of European and Asian countries.

Commercial Publishers

With very few exceptions, commercial publishers are motivated primarily by turning a profit. Their product saves teachers time and effort and provides them with a level and scope of expertise and materials beyond their individual capabilities. They can only take on projects that are sound financial investments. Ultimately, factors such as market size, image, fashion, novelty, and the fit between a project and the particular field in which the publisher has established expertise and market credentials can exert far more influence on the decisions taken than do matters such as editors' or directors' personal convictions about the general educational benefits of the material produced, or the desire to see students achieving.
Of the three categories of ‘investor’, it is only the teacher whose motivation to expend time, effort, knowledge and resources derives directly from those who will actually be using the ‘product’ for their academic development. And it is only the teacher who is in regular one-to-one contact with them.

Nature and extent of investment

Teachers

The most significant input of the teacher-academic into any CALL venture is the conceptual component: awareness of the language system and learning process, identification of a need, recognition of a specific contribution to be made by technology in managing information and cognitive processes, formulation of a solution, and design of materials. Through lack of awareness or lack of interest, the value of the intellectual input often goes unrecognised by non-specialists - the institution's financial and human resources personnel, casual observers from business, industry or the broader community, and even colleagues in other disciplines. Yet this is the element that is crucial in determining the ultimate effectiveness of the material and that guards against gimmickry, tediousness, impracticality and irrelevance. It also serves as a quality-monitoring instrument throughout the development process.
More visible and measurable are the investments of resources and time - time spent in design, gathering and organising data, supervision, liaison, trialling, management of resources, preparation of project submissions, and reporting. Teacher-academics, like workshop carpenters, regularly and justifiably make claims of the type “I did this” or “I spent X hours (or days) doing that”.

Institutions

In paying for the employment of the individual with the skills to do the job, however, the institution has very clearly also made an investment. And it matters little whether the capacity to develop CALL materials was one of the original selection criteria. One must ask whether the teacher-developer would be producing the materials if they were not occupying the position funded by their employer. There are, then, layers of investment in most projects, and the nature of the investment at the various levels is fundamentally different. The institution does not actually produce the goods. Its role is one of sponsorship, support and facilitation. It pays for someone to put in time and effort, and hence also has a justifiable sense of ownership. It is often also the case that professional pride and academic dedication motivate teachers to put in many more hours than those they are actually paid for, or that, in matters of career advancement, institutions may not accord the same recognition to the development of teaching materials as they do to more purely academic pursuits.
Questions relating to which party has made what investment frequently surface after the event, when it comes time to resolve issues of intellectual property and copyright. Regardless of whether institutions receive funding from government or private sources, it would appear that they, rather than the source body, are in a position to claim ownership of intellectual property generated by the resources they administer, and that they retain the right of first refusal when it comes to commercial exploitation. Foreign-language teaching materials, it happens, are seldom if ever seen as worthy of commercial exploitation by universities.Many areas of CALL lie out of the ambit of the purely commercial as they involve the conception, structuring and ongoing management of resources provided free of charge to teachers and students within an institution. This includes activities built around such things as email exchanges or chat sessions between foreign language students and native speakers, access to web sites with their unrivalled and ever-expanding capacity to supply print, audio and visual foreign language data, electronic distance-education set-ups, word processing, desktop publishing, concordancers, on-line dictionaries, and automatic translation sites. It is generally the institution that outlays the millions of dollars required to the purchase of the hardware and expertise, and to set the IT infrastructure in place, and it normally does so with little or no specific thought for any use that foreign language programs may make of it. It nevertheless can clearly justify its sense of ownership of any educational ‘product’, however incidental, generated using the resource. But when it comes to such ingredients as time, energy, expertise, inspiration, motivation, or the soliciting of funds for research or development, input is provided almost exclusively by the teacher. Material returns for such ventures would normally be generated by a fee for service (tuition, management), and would be unlikely to flow directly to the teacher personally.

Commercial Publishers

The investment made by a commercial publisher is more clear-cut, as it is essentially a straight business arrangement. There are two classic scenarios. In the first, the author, using whatever resources are available, generates material to submit to a publisher. The publisher evaluates it and undertakes to assume the costs and responsibilities of publishing and distributing it on condition that the author agree to any editorial modifications deemed necessary by the publisher and accept as remuneration a stipulated royalty of perhaps 10 or 15%. The editorial modifications, often driven by considerations of a cosmetic or commercial rather than an academic nature, may well require the author to make further investments of time, effort, intellect and resources. The second, less common, scenario is of publishers commissioning a work from an individual or team. Under such an arrangement the publisher is strongly placed in setting parameters and in controlling scope, contents, approach and costs. A royalty arrangement with authors would apply on completion of the work. In many respects this model runs counter to the interests of the average teacher-developer. Firstly, the needs base that would normally prompt an individual teacher to develop CALL materials is most likely to be the classroom. In a country like Australia, foreign language classes are traditionally small, non-mainstream, low-priority in terms of government policy and funding, and taught using a kaleidoscope of approaches in a diverse array of institutions and conditions. Moreover, in the area of tertiary education in particular, the sum total of students nationally, even if they formed a homogeneous group, may not represent a sufficiently large market for many major publishers to invest in. As a result, authors may have to respond to the power of the publisher holding the purse strings and tailor materials to accommodate the requirements of much larger markets such as those of the UK, North America or Asia. There is a definite risk that the end product will be less well suited than the original to the group whose needs inspired it in the first place.
In the world of foreign language teaching, publishers still invest primarily in books. By doing so they created material in a medium that is tangible, functional, totally portable, has universal currency, and is independent of electronics, hardware, software, and their frequently incompatible national standards. They thus eliminate many factors that might otherwise fragment the market or allow quick and easy electronic reproduction and breaches of copyright that are difficult to detect and costly to police - i.e. they protect the capacity of their investment to generate the return on which its publication is premised. For such investors software tends to be peripheral, closely tied to the print material (and therefore unlikely to be picked up and used, in part or in whole, as a freestanding resource by teachers following another text or methodology), and of secondary importance in the overall project. It is normally part of a large suite of materials that may include a student manual, a teacher's guide, a workbook or work sheets, audio cassettes, audio CDs, videos in one or more formats (PAL, NTSC), and private study CDs. The complexity and high production and distribution costs of such materials helps explain the publishers' need to control and protect their investment.

Dividends and stimulus to progress

Commercial Publisher

For the commercial publisher there is a one-to-one correlation between the financial success of a venture and continued commitment to it. This is why large-scale market research is indispensable in the planning stages, and it accounts for the relatively small number of full language-learning courses in the catalogues of even the biggest and most specialised publishers, the relative insignificance of CALL materials within those packages, and the pressure such publications can exert on small, peripheral dispensers of foreign language instruction to conform, or endeavour to conform, to the norms established by the countries or institutions whose students represent the bulk of their paying customers. There is also a sense in which a degree of obsolescence is commercially desirable. Textbooks are recyclable. If a school purchases a class set, it can serve for many years. Should a particular method lose favour with the public for whatever reason, it will be replaced by another (i.e. new sets will be purchased), generating greater returns than if the status quo had persisted, and publishers are always keen to demonstrate that they are able to supply the innovative or fashionable product, and to increase their market share.

Teachers and Institutions

In cases where the teacher-academic's involvement with CALL is limited to a cost-neutral exploitation of resources and infrastructure made available to the establishment as a whole, universities and similar institutions are inclined to toleJate and even encourage the research and development activities of their staff, and to use any celebrity accruing from it to enhance their image and to attract support. But the days of institutional infatuation with technology for its own sake would appear to be in the past, and in cases where tangible and ongoing returns cannot be demonstrated for resources invested in CALL, institutions seem increasingly less disposed to dedicate resources to fund further ventures or even to maintain existing ones. Academics are thus more and more likely to be called on to provide some form of ‘market research’ to demonstrate the material, scholarly or educational benefits that will flow from any new project.
Only an extremely small proportion of the teachers of a given foreign language ever produce wide-circulation textbooks. But virtually every teacher at some time or other uses their linguistic, pedagogical and technical skills to create resources in the hope of improving their students' learning outcomes. Occasionally these are computer-based. The more focused the project, the fewer resources it is likely to demand and the less susceptible it is to distortion by outside influences. As such projects do not represent commercial enterprises and are so small-time that they occur below the level of institutional consciousness, they are often little noticed. But they are really the ones that best illustrate the typical teacher-developer perspective on input (professional energy and personal intellectual commitment to the assignment) and dividends (improved teaching) in the creation of CALL materials. The lifespan of a textbook rarely exceeds 10 years. This obsolescence may be due to changes in theories and practices of language teaching, the relevance of images, themes or sociolinguistic elements, and, in the case of CALL elements, incompatibilities with new standards, platforms, operating systems, modes of delivery, or institutional preferences. In the case of print materials, visual aids, transparencies, audio recordings, or even creative board work, ongoing serviceability of a resource over the teacher's career can justify what may have seemed like an inordinately heavy personal investment at the time of initial production. The pace of change and the staggering diversity of hardware, software and concepts in the world of IT mean that it would be almost inconceivable for a computer-based aid created in 1970 or 1980 to still be in service post-2000. This capacity of external factors to make something materially obsolete when it is still pedagogically valid can create a sense of futility in teacher-developers, a feeling that the world of technology conspires to stifle their personal investment and commitment. Print materials are more or less constant. Teachers developing resources on that platform can devote all their energies to content and technique. IT however, being far from static, requires teacher-developers to keep pace with concepts and techniques that may well not come naturally to them, but which have been adopted because they offer some pedagogical advantage. In the end, however, individual teachers may end up, like commercial publishers, making sparing use of CALL, and disinclined to be adventurous with it. The investment they are guarding is different, but the end result of protecting it is similar.

Concluding remarks

In many traditional Humanities areas, to talk of productivity in the same breath as research and scholarship is viewed as a degrading commodification of knowledge. But in creating CALL materials one is not just configuring knowledge, one is also creating a device for dispensing it. If the dispenser takes 2 years to produce and is unusable 12 months later, the experience will act as a deterrent to further ventures in the field. In the same way as it makes little sense for educational institutions or commercial publishers to ignore the perspective of the teacher-academic, it is dangerous for the latter not to take account productivity during the planning process.
Taking a realistic look at who will be able to benefit from teaching materials and for how long, and giving serious consideration to by-passing any processes or devices that have the capacity to reduce the lifespan or currency of the materials is far from wasted effort. It will benefit students by giving them a lasting resource. But more importantly, it will provide a platform on which to build realistic appraisals of the ongoing value of externally-produced materials, and it will do much to protect the teacher-developer from becoming jaded, embarrassed or frustrated by a sense of wasted effort in a climate where an increasingly higher institutional expectation of expertise is paralleled by a reduced tolerance of the process of learning through mistakes.

source: http://callej.org/

Author

Brian McCarthy is an Associate Professor of French, Modern Languages Program. He was appointed to the University of Wollongong as a foundation lecturer in French in 1975. His academic qualifications include a BA with 1st class honours in French, a Master of Arts, a Diploma of Education and a Doctor of Philosophy in Applied Linguistics. In 1994, he received the Vice-Chancellor's Award for Excellence in Teaching. He has been Head of the Modern Languages Program since 1999, the recipient of numerous research grants, and the author of half a dozen textbooks, over 40 research articles and 50 language-learning software modules.

Resisting Obsolescence in CALL1

Resisting Obsolescence in CALL1

  • ISSN 1442-438X
  • CALL-EJ Online
  • Vol. 3, No. 2, January 2002


Introduction

Although rarely acknowledged, one of the greatest impediments to the design of CALL materials is that, after inspired vision, careful research and planning, hundreds or even thousands of hours of development effort, piloting, implementation, refinement, and the expenditure of resources in the form of hardware and materials and wages, the software produced ends up having a working life of only two or three years before fading into oblivion. Individual academics may be content to notch it all up to experience and quietly proceed to other paths or projects. However, when rapid obsolescence occurs repeatedly or on a large scale, it creates a situation in which the discrepancy between investment and output is conspicuously apparent. It can demotivate developers, erode institutional endorsement and funding potential, and create a strong counter-current to CALL software development.
In order to better understand the nature of obsolescence and to consider its implications for future development projects, this paper reflects on the influence of the passage of time on a suite of CALL materials for French (see Fig. 1) whose design, production and ongoing use occupied the author and a colleague2 for a decade.

Fig. 1: Suite of CALL materials for French developed at University of Wollongong, 1991-2000

The wide range of design, teaching, linguistic, theoretical and practical issues addressed in the development phase or arising in the course of implementation have been the subject of numerous research articles, the most significant of these being McCarthy 1994a, 1994b, 1994c, 1995, 1996, 1999, 2000, 2001.
There is a sense in which it is very gratifying to have been part of a long-term project that has produced insights and experience, and generated materials that have gained the recognition of colleagues and students. But increasingly discernible age in the software the project has created now often arouses a reaction of techno-ageism among members of the IT community. For the most part, the ‘wrinkles’ in this software stem from its Hypercard base. Disparaging remarks from casual onlookers not interacting with the materials on a day-to-day basis are of the ‘that must have outlived its usefulness by now’, ‘it's getting a bit long in the tooth’, ‘it's starting to show its age’ variety. The natural response is to indignantly dismiss such comments out of hand. The more reasonable one is to allow that there may be some truth to them, and to address frankly the possibility that the materials may indeed have passed their use-by date.

What does ‘obsolete' mean?

At one level, this is an easy question to answer. Typical dictionary definitions are ‘fallen into disuse’, ‘no longer in use’, ‘of a discarded type’ or ‘out of date’.
Yet the relationship between continued use and obsolescence is not quite as simple as it might appear. For example, it could not be claimed that just because materials continue to be used, they are not obsolete, or that if materials can be considered out of date, their use should automatically be discontinued. Obsolescence may be real or perceived, and it is the product of a combination of circumstances.
To persist in using an implement when a more effective one is available and affordable is not an offence punishable by law. Users will continue to achieve their objectives. Farmers using horses and ploughs can still prepare their fields and produce crops to meet their needs. They are, however, not competitive in the larger scene. This is obsolescence through conservatism, and can occur as a result of choice, indifference or ignorance. In the domain of CALL in university foreign language instruction, the consequences of this position would be lack of competitiveness with other institutions, and, for students, a relatively lower level of proficiency for effort invested.
There are other scenarios. Obsolescence can be the result of disadvantage when lack of financial resources removes the possibility of acquiring more effective tools. It can also be circumstantial, when the old is used because the new cannot be accommodated – like a television set or a computer in a community without electricity.
Clearly, if someone can attach the ‘long-in-the-tooth’ label to a piece of software, there must be some respects in which it can be deemed obsolete. In order to interpret the substance of the criticism, it would seem appropriate to reflect in turn on obsolescence in relation to the three fundamental facets of any CALL software: the Technology, the Language, and the Assistance to Learning.

Obsolescence and Technology

The ever-shortening ‘technology cycle’ is a universally recognised phenomenon, and it is self-sustaining at both the conceptual and commercial levels. Technological developments conOtantly create faster, cleverer and more comprehensive ways of performing operations. It does not go without saying, however, that what these operations are achieving is either cleverer or more comprehensive. A direct wireless implant into the ear of a foreign language learner is of little use if it can do nothing more than present the subject with a loop recording of a bilingual dictionary. Neither does an advance in technology necessarily do anything to sustain the development or improve the quality of the content of what it is processing. On the strictly functional level, as long as an appliance is capable of processing the input, that input can continue to serve its original purpose. In the 1960s, for example, record players were still commonly produced to accept 7-inch, 10-inch and 12-inch discs, and operated at 33, 45 and 78 r.p.m. So, even though 78s were no longer manufactured, they were not entirely obsolete. They were just becoming that way. By 1990, new record players no longer offered the 78 r.p.m. option, so 78s were obsolete. Vinyl records are now nearing the end of a similar path. The capacity of the contents (e.g. the voice of Nellie Melba) to inspire the admiration of the connoisseur, however, has little or nothing to do with whether they are delivered by phonograph cylinder, 78 record, vinyl disc or CD. Neither will any development in technology make it possible to produce a new original recording of those contents.
In the case of the Wollongong CALL materials, they will remain in the ‘old-fashioned’ rather than the ‘obsolete’ category as long as computers have the capacity to run the Hypercard application. It must nevertheless be acknowledged that a piece of software has a much greater potential to age than do techniques such as word processing, chat, or Web searches. A number of developments have already had a clear impact on Hypercard's working life. Processor speeds have increased one hundredfold. This is in most respects an advantage. Student complaints about slow response time, common in the early nineties when the software was run on Macintosh Classics, are a thing of the past. In some cases, however, the response time has outstripped the application, so that on MacOS 9 for example, exploring the ‘click-a-sound’ palette in the Spelling module can set in train irritating and apparently interminable repetitions of the one sound. There are other circumstances in which changes to management and priorities in the system inhibit response to instructions to play sound. System-governed redistribution of typed characters within a field can distort the on-screen display, which in turn interferes with the effectiveness of screen-based clicking operations. Updated font managers can cause font resources within a stack to be overridden, or the ID of a new font such as the cross-platform Ariel introduced in Macs to replace New York as the default font can clash with a stack-internal font (e.g. the font created to manage the graphic cues in the Reported Speech module).
Overall, however, on the operational level, the impact on Hypercard of changes to Mac hardware and systems has been negligible. It is not possible to retest every facet of a very complex suite of software and implement design changes with each new system release. To attempt to do so would be absurdly costly in terms of time and resources. Economy of scale may make it worthwhile for developers to invest hundreds of millions of dollars into the production of a new version of Game Boy, but it militates against even the most modest efforts to have CALL materials for French of the type we have described keep pace with ever-quickening change, particularly in a country of 20 million people whose mother tongue is English and where the provision of tangible support for foreign language study is a long way from the top of the list of national priorities. There is, moreover, no guarantee that changes made in order to accommodate or take advantage of the idiosyncrasies of a new system will not stop those materials from runnning satisfactorily on an earlier system, thus creating a situation of software rendering hardware obsolete.
In many respects it is what has not happened that has had the most profound effect on Hypercard materials. Hypercard does not run on PC, neither is it a satisfactory application for networking. For a time there were encouraging signs of developments to make it possible to import Hypercard into QuickTime, which runs on both platforms. Disappointingly, this has not eventuated and, as a consequence, the currency of any software developed on Hypercard has been prevented from appreciating, and enthusiasm to continue to coin further materials in it dampened. Moreover, ‘Apple Computer is not endorsing or promoting the use of HyperCard as there is no company directive to do HyperCard under Mac OS X’.3
While there are products such as Runtime Revolution and MetaCard which claim to be able to translate HyperCard (Macintosh OS) stacks into Windows OS stacks, there are serious overheads for small developers. An initial software licensing fee of approximately $US1,000, the possibility of additional annual fees, and the need for investment in appropriate hardware, all constitute a serious disincentive even to begin looking at the conversion. Additionally there are developmental overheads in converting multimedia resources: problems with fonts, sounds, images, screen size and layout and so on that need to be converted separately from the ‘stack’ conversion and then re-incorporated into the new versions of the stacks, as well as the lead time in the developer learning the new environment(s).
If the pedagogical value of the software remains high, the unrestrained evolution in the domain of hardware can actually work in favour of any teacher not easily wounded by the shafts of technosnobbery or sarcasm. The dismissal of a piece of CALL software solely on the grounds of the ‘status’ or ‘look’ of the technology on which it has been constructed is simply another manifestation of the imperfect interface between the teacher-designer and the IT specialist that frequently manifests itself at the production stage. It is the learner and the teacher who are best placed to assess the merits of a piece of CALL software, not the technologist. If changing the software is impracticable and runs the risk of rendering hardware obsolete, and changing hardware is expensive and runs the risk of rendering the software obsolete, an obvious solution is to retain the combination that works best. If there is no better software and no better hardware for the job, then any ‘obsolescence’ exists only in the eye of the beholder. And given that an extraordinarily high proportion of discarded hardware is in good working order and costs very little to buy, this solution is also economically astute, is likely to have the support of budget-conscious administrators, and actually provides language teachers with an opportunity to expand use of the resource.

Obsolescence and Linguistic Content

The change of language over time is a familiar phenomenon. The date of entry into the language of a word, or a particular usage of a word, is often recorded in dictionaries, and most dictionary users are familiar with the symbols used to indicate that a term has come to be considered old-fashioned or archaic. In theory, this factor has the potential to cause language-learning materials to date. In reality, its impact is slight. In spite of dramatic changes in the nature of foreign language teaching materials over the past half century, very little has changed at the level of basic vocabulary and grammar. This can be illustrated by examining a passage such as the following from Lamport-Smith (1935: 46-47), a reader that was still in use in junior secondary French classes in New South Wales secondary schools well into the 1950s.


The scene created here is indisputably a period piece, and this is reflected in the extremely dated picture accompanying the passage in the textbook (Fig. 2). The individual lexical items, however, even manivelle, torréfacteur, bougie, amidon and bonne, are all in common usage in 2001, though perhaps with modified connotations. A secondary message here, which applies to software designers as much as to the authors and publishers of print materials, is that graphics, and particularly photographs of daily life, have a far greater capacity than words to cause materials to appear outmoded.

Fig. 2: Illustration by Ferdinand Raffin, accompanying the passage ‘Chez l'Epicier’ in Le français par l'image , L. Lamport-Smith (1935: 46)

In many areas of language there is evidence of a ‘survival of the fittest’ or a ‘strength in numbers’principle whereby the closer a word is to the core of the system, and the more frequently it is used, the more resistant it is to change. For example, although the most commonly used verbs are the most irregular, they are the least likely ever to be regularised. This principle has also served as an anti-ageing force for the software in question in several respects. A conscious decision was taken at the design stage to make the materials text-book independent. The structural and functional grammar points covered in the various modules were chosen because they were common to a large, methodologically diverse range of beginner French textbooks of the last 40 years. They are core language features and have wide currency. And since these points are dealt with at sentence level rather than as an inextricable part of a larger unit of discourse (text, audio, or audio-visual), they are far less susceptible to the ravages of time than, for example, a unit or work built around a digital video recording of authentic conversation between two secondary school children in a 1980s French schoolyard. However they may rate in the foreign-language teaching fashion stakes, communicatively minimalist activities such as straightforward verb conjugation (e.g. Verb Kit and Verb Tense Recognition modules) must be considered virtually ageless.
Another design principle was, wherever possible, to use vocabulary appropriate to the level of difficulty of the grammar point. Because most of the grammar is elementary, most of the vocabulary is that of ‘le français fondamental’, i.e. it is ‘core’ vocabulary, and on the ‘survival of the fittest’ principle, little affected by the passage of time.
is a minor point of grammar. Within the Adjectives module, a small well of items was created for invariable adjectives. It included the word ‘sympa’ which is defined in the 1990 edition of ‘Le Petit Robert’ as ‘invariable adjective; first known use 1906; register: very familiar; meaning: sympathique’. In the 2000 edition, the meaning and date of entry into the language are unchanged, but its register has shifted from ‘very familiar’ to ‘familiar’, and it has become a regularly declined adjective –8211; i.e. it now takes an ‘s’ in the plural. For the software to accommodate that change, the only action required is the deletion of a small number of items from the bank.
In a corpus of some 22,000 items only two clear linguistic ‘wrinkles’ have appeared to date. The first
The second ‘wrinkle’ is in fact a set of wrinkles. It has appeared in the news snippets (over 10,000 of them) from the Web on which the Future Tense, Relative Pronouns, Infinitive Government and Infinitives & Participles modules were constructed, and can be seen clearly in items such as:
Shimon Peres s'est borné à remercier Yasser Arafat pour ‘ses efforts intenses pour amener nos deux peuples à la paix et à l'espoir’, mais il a également évoqué les difficultés [***] les deux parties avaient à ‘escalader les pentes glissantes’ de ces négociations. [que]
Avant ce vote, [***] l'issue ne faisait d'ailleurs aucun doute, le Premier ministre avait été assuré du soutien du président de l'UDF, Valéry Giscard d'Estaing et celui du RPR, Jacques Chirac, deux autres présidentiables de la droite, sur son action gouvernementale. [dont]
The grammar features covered in these modules, being of an intermediate rather than beginner level, are frequently couched in relatively sophisticated linguistic environments (vocabulary, syntax, grammar). They are consequently more likely to be affected by the principle of ‘the larger the unit of discourse, the higher the risk of ageing’ alluded to above. This risk was recognised at the design stage, but any negative impact it might have was considered to be far outweighed by the value of the linguistic authenticity of the press clips and of the wealth of cultural references they contained.
‘Any collection of news and current affairs items creates a rich cultural backdrop containing a blend of social and political events that are of abiding significance because they had an impact on national or international affairs [European union, the war in ex-Yugoslavia, the end of apartheid in South Africa, the Rwanda tragedy, the Middle East, the 50th anniversary of the Normandy invasion, the TGV, the Channel Tunnel], and of everyday matters (sport, community, education, politics, crime, transport, religion, agriculture, town planning, industry, youth, lifestyle, human interestq¥E that are of perennial relevance - the names and places may vary, but the themes, newsworthiness and intrinsic cultural relevance are constant.’ (McCarthy 2000)
This is one type of ageing that it is better to accept with dignity, given that the alternatives are far from satisfactory. Those alternatives include: renouncing any attempt to contextualise the grammar; updating or re-establishing the 9 million word corpus on a regular basis, scanning it for relevant examples, then updating the banks of items in each of the modules; or attempting to fabricate large banks of culturally pertinent but time-neutral items.

Obsolescence and Assistance to Learning

From a purely educational point of view, the only compelling reason to abandon a resource is if it loses the capacity to serve in a particular teaching and learning environment. This situation may be the result of such diverse factors as disappearance of the supporting framework, lack of integration, loss of the power to stimulate learning, or superseding by improved materials.

Curriculum Environment

Teaching manuals and textbooks come and go in all disciplines, their life span being a function of changing needs, fashions and tastes, and of the evolution of educational theories and priorities. In the increasingly probable situation of DVD and/or CD ROM replacing paper as the platform for the delivery of comprehensive, structured courses, it will be possible for entire suites of computer-delivered materials to be discarded in the same way as their print-based predecessors. And as with abandoned textbooks, the only chance of survival of any particularly useful segment (e.g. a dialogue, a piece of realia, or a language exercise) will be as an item stored away in the electronic section of the resource cabinets of conscientious teachers. Current trends in foreign language teaching appear to be increasingly in the direction of eclecticism, and the primacy of the communicative aspects of language places a strong emphasis on the teacher as an organiser, an informant, and an intermediary between the learner and the material. In this environment, computer-based activities serve principally as adjuncts and supports. Their relative autonomy gives them the capacity to ‘float’ above change at other levels, provided that the hardware is available to run them. Technological support for software, however, is a far more complex, costly and unpredictable matter than it was for audio cassettes or even video tapes.
Changes in student needs, reflected in curriculum change, can also marginalise any teaching materials, including software. It is very likely, however, that use of software that provides effective instruction in an independent learning environment will increase in the great majority of educational institutions, since its services are seen as a cost-efficient alternative to human resources.

Teacher Commitment

The continued use of any effective teaching resource is also heavily dependent on the individual teacher's energy, enthusiasm, organisational skills, methodological convictions and continuing employment, and the importance of this human factor should not be unNerestimated. The only honest answer for the author to give to the not uncommon question: ‘What will happen to all this when you go?’ (well, the only one apart from the expression of surprise at the implication by insouciant and insensitive 18-year-old students that a teacher in his mid fifties is close to retirement or some other form of demise) is ‘That depends.’. In asking the question students are recognising the commitment required on the part of the teacher not only in the development of the materials, but in initiating each new cohort of students into its use, maintaining both the software and the machines, linking use of the materials to other facets of the course, and ensuring that the computer-based tasks are integrated into course assessment. In the case of the grammar modules at Wollongong, this integration involves:

  • preparing and presenting handouts on the rationale behind CALL use;
  • preparing a schedule detailing the content of the various modules and students’ required level of achievement in numerous computer-based exercises (varying from 5 to 20, depending on the course);
  • emphasising and implementing the compulsory computer preparation;
  • preparing, posting and checking the sign-up sheets on which students indicate that they have completed the preparation;
  • where necessary (i.e. where there is any doubt that the information supplied by students on the sign-up sheet does not match their actual performance on the computers– e.g. in the early stages of first-year courses) checking the scores on all 15 computers in the private study laboratory;
  • keeping a record of the (fortunately very rare) students who fail to complete the computer preparation on time and ensuring that no result is declared at the end of session until the requirement has been met;
  • reproducing on-paper tests and administering them in an agreed timeslot out of normal lecture time (the tests, generated by the computer, correspond in scope and depth to the various compulsory preparation exercises completed by the students);
  • marking the on-paper tests and recording the marks.

Integration of the ‘En tête-à-tête’ cued speaking materials (with a class of 60 or more) involves:
  • ensuring that students have encountered the necessary communicative situations, vocabulary and grammar in the course of lectures (through dialogue presentation, speaking activities, grammar presentation and homework exercises);
  • presenting the cues and responses to the class as a whole via overhead transparencies– usually 10 dialogues per session;
  • distributing sets of cards to the class for pair work (to set this activity up involved a one-off preparation and collation of over 20,000 slips of paper: 300 dialogues, 2 cue cards (1 for each speaker) per dialogue, 40 sets of cards);
  • supervising a class in which 60 or more students are engaged in a speaking activity simultaneously;
  • initiation of students to the CD ROM activity with full audio support which enables them to work on the material privately outside of class;
  • distribution of the full set of cues and responses, after they have been completed in class, as a take-home private study resource;
  • preparing, conducting and grading the cassette-based end-of-session oral examination by means of which student mastery of the speaking skills are assessed.

Assessability

University students are the first to acknowledge that if a task does not count in a significant way towards their end-of-semester grade its priority will always be sufficiently low for it to remain on the ‘things I must get around to’ list, no matter how potentially useful the resource or how genuine their interest in the subject.
There is further evidence of this sobering reality in the fate of the bulk of the non-grammar activities (Fig. 1). Most of them deal with notions and speech functions (e.g. Personal Identification, Shopping, Weather, Date and Time) that are as basic and indispensable to communication as the grammar in the drill modules. They are far more sophisticated in design, incorporate sound and graphics, and are comprehensive, simple to use and stimulating. The flaw, which has made most of them inappropriate for use in the university environment in which they were produced, is that they are constructivist in character. There are no doubt many contexts in which this aspect would be considered a distinct plus. It is not hard, for example, to imagine them being used very creatively in a secondary school classroom where the system does more to foster, and students are more willing to engage in, learning activities for which the measure of success is personal satisfaction and an unquantified sense of achievement. The full suite of non-grammar learning activities is available on every computer in the private study laboratory, students are aware of their existence and know that their contents are relevant to their studies and have the potential to enhance their language skills, but they remain virtually unused. If disuse is obsolescence, then those materials are obsolete, and some of the main contributing factors have nothing to do with the computers, the language or the aid to learning. They are the result of external factors, such as class size (e.g. the first semester of 1st-year French, with over 60 independent and socio-culturally diverse students, is more than 2.5 times a big as the largest senior secondary school foreign language classes) and class time available to cover the syllabus (even in the best Australian university scenario of 6 hours class per week, students have only 30% of the face-to-face teaching their secondary school counterparts receive, and it is delivered over 26 teaching weeks in one academic year instead of between 200 and 240 weeks over 6 years).

Labour and Cost

One of the common base-level choices in CALL software design is whether to create a complete off-the-shelf activity whose contents cannot be modified, or a shell which gives teachers the freedom to import and amend the contents. The decision made at that point does not in itself determine whether the end product is educationally sound. But it may have an impact on its longevity. A fixed unit whose contents render it in some way inappropriate to a given instructional environment is likely to be of limited use and very susceptible to abandonment. But a shell, even one of outstanding quality in terms of the operations it allows, that requires regular or sustained effort on the part of the teacher to locate, import and maintain the contents, is probably doomed to a similar fate. This is a lesson that was learnt during the seventies and eighties in the era of the language laboratory whose demise was not principally the result of its functions having being superseded by computers with superior capacity for interactivity, multimedia operations and escape from linearity. Neither did it reflect the view that audio recording is not a good tool in foreign language instruction. By the time computers arrived on the scene a great many institutions were already referring to their cassette-based language laboratories as white elephants because teachers were simply not in a position to constantly prepare or update recorded material, to supervise its use, and to integrate it into the curriculum, assessment procedures and evolving educational theory. As with language laboratories, teachers are looking to computers as a way of improving their capacity to instruct without further increasing an already heavy workload.
Assuming that the capacity of teachers and designers to continue to develop quality materials is constant, one key to the viability of foreign language instructional software lies in successful management of the balance between the need for the materials and the effort and resources required to produce them. Although the needs base is most clearly defined within the individual institution, it is rarely possible at that level to invest thousands of hours into producing materials, or thousands of dollars into purchasing and adapting externally produced materials and systems, if there is no guarantee that they have the capacity to move freely across borders created by technology cycles and phases in educational philosophy, or that the need they were designed to meet will not evaporate. The smaller the clientele, the more likely it is to feel the impact of this principle. And the clientele for foreign language learning materials is extraordinarily fragmented by factors such as the age and the cultural and linguistic background of students, institutional priorities, financial resources, teacher preferences and government policies. Development costs must be weighed up against a realistic assessment of future use and of the capacity of the software to save resources or generate income.

Measured Steps

In terms of technological evolution, the change from Power Macs to iMacs, for example, was small. Where it did force people to upgrade, it was not usually for purposes of their routine in-house wordprocessing, but because of their desire or need to perform new tasks (downloading audio, video, animated graphics from the Web, streaming, connecting to high end applications, or dealing with higher version documents sent from outside). It did not represent a quantum leap of the same order as the advance from the printing press to the computer, or even from the Apple IIE to the Mac Classic. To treat every development in IT as a signal to update-or-scrap existing CALL software is a recipe for unnecessary frustration.
It is sobering to ask oneself the question of which foreign language software will still be here in 5 years time, let alone 50. In such a climate, it is important to counter the threat that CALL modules and packages may soon be viewed as yet another manifestation of ‘boom and bust’ in the history of foreign language teaching. One strategy is to make durability (of platform, content, and educational philosophy) a primary consideration at every stage of development, and to calculate on taking the longest possible development steps on the safest possible footing.

Image and Attitudes

To change for the sake of change, particularly when to do so is costly and gives no guarantee a superior product, has the potential to cause considerable long-term damage. And it is important to learn to dissociate ‘look’ from functionality. The notion of a ‘classic’ (in the sense of something simple and conventional whose popularity is largely unaffected by changing fashion) seems to have gained very little currency in the world of CALL software. There are classic design principles, but the materials that embody them tend to be ephemeral.
For a student or teacher to feel that fully operational software should be abandoned solely on the grounds of unfavourable reaction to some of its aesthetic qualities makes little sense. And from the point of view of perceptions in the broader community, it is perhaps unfortunate that standard English syntax happens to place adjectives before nouns in phrases such as ‘computer aided language learning’ thus unwittingly according semantic emphasis to the means (the computer) rather than the end (the learning), whereas, in a language such as French, where the same referent is labelled ‘enseignement assisté par ordinateur’, the structure is such as to give the substantive (‘enseignement’: teaching) primacy over the qualifier (‘computer-aided’).

The Student Perspective

As long as materials are operating smoothly, it is ultimately the learners who should decide on whether they are useful or not. It was reported in the early stages of use of the Wollongong CALL materials that ‘on the academic level, feedback from students is very close to 100% positive’ and that ‘negative comments relate almost exclusively to operational matters and are concentrated on two areas: the speed of the computers and the fact that totally accurate typing is required’ (McCarthy 1996: 26; see also McCarthy 1995: 40-41). It should be safe to assume that after 10 years of use, any halo effect must have well and truly dissipated. Nevertheless, in the second semester of 2000 an anonymous survey of all students enrolled in French (a completely different cohort from the one reported on earlier, and from a wide range of specialisations, including IT) revealed that without exception they found use of the CALL grammar materials to be helpful to their studies. In the second semester of 2001 another anonymous survey of all students sought their reaction to the observation that the materials were looking long in the tooth and must have outlived their usefulness. In the matter of aesthetics there were mixed responses, ranging from total endorsement of the cosmetic criticism to obliviousness to any signs of age. Operational problems related less to speed (the present machines are faster than the original Macintosh Classics), and more to the intolerance of the machine to any inaccuracy in typing, to the relatively slow load time (response time once it is loaded is not a problem), and to the fact that (being Hypercard-based) it cannot be used on PCs and does not lend itself to off-campus (on-line) use. Once again, all students were finding the materials useful in some way. Repeated mention was made of the advantages of immediate feedback and the possibility of individuals working at their own pace. Responses ranged from straightforward positive comments regarding the simplicity, thoroughness and usefulness of the materials to resounding endorsements (‘invaluable’, ‘absolutely necessary’, ‘one of the most positive aspects of the course’) and even downright indignation at any hint that its usefulness might be considered to have diminished (in the words of one student: ‘*** to that– it's not true!’).
Looks and technical limitations aside, students could not imagine anything doing a better job of reviewing and maintaining basic grammar. In addition, many of the students proceeded to offer their own surprisingly perceptive analytical comments, including:
  • ‘Grammar is grammar and does not change at the same rate as computers (or consumer appetites!)’;
  • ‘its pedagogical worth has not diminished one bit’;
  • [any problem with] ‘its appearance is far outweighed by its highly evolved nature and essentially flawless performance’;
  • ‘the immense (sic) cost and effort that would be involved in transferring the data from current programs to a modern GUI (Graphical User Interface) application would be beyond the budget of the University, let alone a small company or department. A major software producer for small level business [name supplied] charges upwards of $200 per hour for software development and repair’;
  • ‘as it [the grammar software] is for the most simple grammatical sentences, it really can't outdate’;
  • ‘ease of use, understandability, practicality and effectiveness are far more important than graphics or design’;
  • ‘as long as the computer performs its function and assists a student in developing his/her language skills, then aesthetics are irrelevant’;
  • ‘this software is just as relevant now as it was when it was first produced, and probably in the future’, ‘I think that changing the layout or look will not substantially improve the software’;
  • ‘The content is fantastic... At first I thought it was outdated and probably would not have utilised it as a learning resource. Because it was compulsory I realised how beneficial it was and do not see a great need to upgrade’;
  • ‘the grammar that it's teaching us doesn't change’;
  • ‘if there is no substantial change to be made in the content, it seems like a waste of resources to develop a new version of the same thing... the databases behind the software are quite adequate as they are’.

The essence of many of the preceding observations is summed up in one student's laconic, if hackneyed, ‘If it ain't broke, don't fix it’.
The purpose of this paper has not been to oppose development or resist change. It has been to contest the often unconscious use of ‘look’ as the sole or main criterion for assessing a piece of software. Moreover, it encourages software consumers to assess the shelf-life of products from the perspective of ‘best before’ rather than ‘use by’, as the former, by emphasising usefulness and minimum life span, keeps the focus on the recognised qualities of the contents, whereas the latter suggests that the product should be discarded on a given date regardless of its actual value or of the existence of a satisfactory substitute. Although it has been essentially a case study, many of the concepts and principles evoked are universals. They point clearly to two broad conclusions. The first is that the working life of a piece of CALL software can be lengthened considerably by taking full account at the design and development stages of the range of factors that can cause such materials to fall into disuse, and by consistently working towards minimising their impact. The second is that materials that continue to meet genuine student needs and that leave institutional registers of material and human resources in the black are well placed to resist challenges to their viability based on superficial criteria. Not having continually to revise or recreate allows the developer to take fresh steps unhindered. It is not particularly difficult to brand something a ‘dinosaur’. But the label alone does not make it extinct. It is a more challenging assignment to create something that looks like a dinosaur, but that is intelligent, robust, well-exercised... and has long teeth.

References


  • Lamport-Smith, L. (1935). Le français par l'image: Livre de lecture pour la seconde et latroisième année, Glasgow: Blackie & Son.
  • Le Petit, Robert. (1990). dictionnaire alphabétique et analogique de la langue française. Paris: Dictionnaires Le Robert.
  • Le Nouveau Petit, Robert. (2000). dictionnaire alphabétique et analogique de la langue française. Paris: Dictionnaires Le Robert.
  • McCarthy, B.N. (1994a). Language system, computer constraint and pedagogy: Three-cornered contest or three-part harmony? On-CALL - TheAustralian Journal of Computers and Language Education, 8(3): 11-20.
  • McCarthy, B.N. (1994b). Discerning the teacher behind the software. ReCall- Journal of the CTI Centre for Modern Languages, University of Hull, England,in association with EUROCALL, 6(2): 23-28.
  • McCarthy, B.N. (1994c). Designing materials for Computer Assisted LanguageLearning: Some preliminary considerations, BABEL - Journal of theAustralian Federation of Modern Language Teachers' Associations , 29(3), 24-27& 36.
  • McCarthy, B.N. (1995). Grammar Drills: What CALL can and cannot do. On-CALL- The Australian Journal of Computers and Language Education, 9 >(2), 30-41.
  • McCarthy, B.N. (1996). Fully Integrated CALL: Mission Accomplished. ReCall- Journal of the CTI Centre for Modern Languages, University of Hull, England,in association with EUROCALL, 8(2), 17-34.
  • McCarthy, B.N. (1999). Integration: the sine qua non of CALL.. CALL-EJOnline, 1(2). (ISSN 1442-438X).<http://www.clec.ritsumei.ac.jp/english/callejonline/4-2/mccarthy.html>
  • McCarthy, B.N. (2000). Harnessing CyberFrench for Specific Purposes. CALL-EJOnline, 1(3). (ISSN 1442-438X).<http://www.clec.ritsumei.ac.jp/english/callejonline/4-3/mccarthy.html>
  • McCarthy, B.N. (2001). It needn't be CALL-or-nothing: A case of computersas partners not managers in a multimedia teaching kit. CALL-EJ Online, 2(2). (ISSN 1442-438X). <http://www.clec.ritsumei.ac.jp/english/callejonline/5-2/mccarthy.htm>

Notes


  1. This article is based on a paper presented at EUROCALL 2001 Conference, Nijmegen, The Netherlands, 29 August - 1 September, 2001.
  2. The author wishes to acknowledge the invaluable contribution of Ray Stace, without whose expertise and feedback in the area of instructional design, and untiring commitment to programming, the materials would not have seen the light of day.
  3. Personal correspondence (6.6.01) from Tess Collins, Partnership Manager, Australia-New Zealand, Worldwide Developer Relations, Apple Computer.
source: http://callej.org/

Author

Brian McCarthy is Associate Professor in French at the University of Wollongong, N.S.W., Australia. His principal research interests are in foreign language teaching methodology, computer assisted language learning, software development, phonetics and translation.