2.4.2 Items of observation in the language classroom
For classroom observation as a learning tool Richards (1998:143) proposes three perspectives on a lesson for pre-service training to develop a deeper understanding of how and why teachers teach the way they do and the different ways teachers approach their lessons. They are:
1) Teacher-centered focus: the teacher is primary focus; factors include the teacher’s role, classroom management skills, questioning skills, presence, voice quality, manner, and quality instructions.
2) Curriculum-centered focus: the lesson as an instructional unit is the primary focus; factors include lesson goals, opening, structuring, task types, flow, and development and pacing.
3) Learner-centered focus: the learners are the primary focus; factors include the extent to which the lesson engaged them, participation patterns, and extent of language use.
Wallace (1998:68) substitutes the focus on the curriculum with the focus on the context in which the teacher teaches: the classroom layout, the teaching aids available and how they are used.
Low-inference and high-inference categoreis
The presentation of items involves constructing sets of categories into which occurrences must be coded unambiguously. In this respect Long (1980:3) introduces low-inference and high-inference measures. Low-inference categories include things that can be counted or coded without the observer having to infer their meaning from observable behaviour. Such categories according to Allwright and Bailey (2000:73) involve the number of times the student raises her/his hands, or the frequency with which the teacher uses the student’s name. High-frequency items demand that the observer make a judgement that goes beyond what is immediately observed. The samples of this type of categories cover factors like learner’s attention, or the social climate. I can conclude that observation data should cover categories of observable behaviour that does not require much interpretation.
2.5. Typology of observation
Typology of classroom observation instruments is worked out by Wallace (1991:66) and he presents the following oppositions:
1. system-based, ethnographic or ad-hoc
2. global or specific
3. evaluative, formative or research-related
4. teacher-focused, learner-focused or neutral in focus
5. quantitative or qualitative
He admits that some of the oppositions are not clear-cut and overlap. For example, observation techniques which are primarily evaluative may be employed for formative purposes, ethnographic approach is treated as global and qualitative. System based approach can focus on teacher’s activity and learners’ activities. System-based (systematic), ethnographic and ad-hoc approaches encompass other characteristics of the classification provided. Thus, I outline the features of the first opposition.
2.5.1 System-based approach
By system-based observation Wallace (1991:67) means the observation that is based on a system of fixed and pre-specified categories. They are global in nature, i.e. ‘they are intended to give general coverage of the most salient aspects of the classroom process’ (Wallace 1991:110). Any system contains a finite array of categories. The endeavour of all system-based observation instruments is the analysis of teacher-class interaction. The two most influential systems are devised by Bellack (1966:267) and by Flanders (1970:314). Wallace (1991:112) has identified the characteristic features of the first system as:
1) the data are measured from a transcript, i.e. the data have to be first recorded and then transcribed;
2) the central place of labelled units of discourse are structure, solicit, response, reaction.
In the ‘Flanders tradition’ there is a form of documented recall where tallies are made every three minutes under one range of categories. In chapter 2.6 the analysis of a range of interaction schemes, their advantages and disadvantages are presented with more details. They are widely used by researchers as they are ready-made, well known and ‘it does not to be trialled and validated’ (Wallace 1991:111).
2.5.2. Ethnographic approach
The observation techniques share many of qualities of ethnographic practices. Ethnography is a detailed sociological observation of people which immerses the researcher in an intense period of observation ‘which guides and informs all subsequent data gathering’. (Radnor 2002:49)
Ethnographical approach is originally developed from the methodologies of field anthropologists and sociologists concerned with studying human behaviour within the context in which that behaviour would naturally occur. Methodologically, ‘anthropological’ classroom studies are based on participant observation, during which the observer immerse him/herself in the ‘new culture’. Initial data gathered by the ethnographer are open-ended and relatively unstructured that ‘allows and encourages the development of new categories’ (Delamont and Hamilton 1976:13). An ethnographer uses a holistic framework. S/he makes no attempt to manipulate, control or eliminate variables. At the same time s/he reduces the breadth of research problems systematically to give more concentrated attention to the emerging salient issues.
The great strength of the ethnographic research is that it gets away from the simplistic behavioural emphasis of the pre-specified codes. (Delamont and Hamilton 1976:37).
The main purpose of the ethnographic approach is the search for meaning and is based on the description of the studied phenomenon. However, Lutz (1986:112) warns that not everyone who can write a paragraph describing an encounter between a teacher and a student is an ethnographer, and he points out that an observer should be trained in ethnographic methods, particularly participant-observer field methods.
2.5.3 Ad-hoc approach
The term ‘ad-hoc’ is used to describe something that has been devised for a particular purpose, ‘with no claims to generality’ (Wallace 1991:113). The ad-hoc approach relates to structured approaches but the categories derive from a particular problem or research topic. That is why this system is more popular with practising teachers. What is more this approach is flexible and eclectic, and involves both quantitative and qualitative data where each seems appropriate. Wallace (1991:113) assumes that each different area of concern will yield a different system of analysis. Ad-hoc approach is considered to be the most appropriate in teacher-training education as it is basically guided discovery approach that drive student-teachers to focus and reflect on an important area of language teaching, and provide a meta-language with which to discuss. The instrument of ad-hoc approach is known as observation tasks (Wajnryb 1992) and is described in Chapter 2.6.2.
2.6. Methods and techniques of observation
2.6.1 Classification of data collection techniques
Seliger and Shohamy (1989:158) present classification of data collection procedures according to the degree of explicitness. On one end of the scale they set broad and general techniques which do not focus on a particular type of data and are considered to be of a low degree, while at the other end they tend to put procedures which are more explicit and structured and thus reveal high degree of explicitness. Collecting data by procedures of a low degree of explicitness is done by means of open and informal description, which tends to be done simultaneously with its occurrence. Typical procedures of this kind are field notes, records, diaries, journals, lesson reports, personal logs, life history accounts, informal interviews with the subjects of observation. Collecting data by means of procedures of a high degree of explicitness involves the use of formal and structured types of data collection procedures. Examples of such procedures are interaction schemes, checklists, observation schedules, observation tasks, formal interviews, surveys, structured questionnaires, case studies, rating numerical scales. Different procedures imply different techniques for data collection. Data obtained from more structured observations are presented in the form of checks, tallies, frequencies, and ratings, while data obtained from the informal observations are presented in the form of narration, field-notes, or transcripts.
According to this classification I am going to describe a range of procedures that are applied to pre-service classroom observation.
2.6.2 Observation instruments
Field notes
Field notes are records of naturalistic observation in the natural context of the behaviour researched through direct listening and watching. The main focus of observation notes is accurate description rather than interpretation. An observer can write down interesting details on various aspects of school life in general and of the teaching process in particulars. ‘Each observational note represents a happening or event – it approximates the who, what, when, and how of the action observed’ (McKernan 1996:94). McKernan considers field notes as a useful tool as
1. they are simple records to keep requiring direct observation
2. no outside observer is necessary
3. problems can be studied in the teacher’s own time
4. they can function as an aide-memoire
5. they provide clues and data not dredged up by quantified means.
At the same time an observer should consider some drawbacks in the use of this technique presented by McKernan (1996:96) as follows:
1. It is difficult to record lengthy conversations
2. They can be fraught with problems of researcher response, bias, and subjectivity
3. It is time-consuming to write up on numerous characters
4. They are difficult to structure
5. They should triangulate with other methods, as diaries, analytic notes.
The case study
Elliot and Ebbutt (1986:75) treat case study as a research technique in which teachers identify, diagnose and attempt to resolve major problems they faced in teaching for understanding. Richards (1998:73) considers case materials help students to explore how teachers in different settings ‘arrive at lesson goals and teaching strategies, and to understand how expert teachers draw on pedagogical schemes and routines in the process of teaching’. McKernan (1996:76) reminds that the researcher or an observer should use a ‘conceptual framework’, which can relate to existing science. So, the researcher employs various concepts to make sense of the observed data.
Richards (1998:76) enumerates advantages for using case studies in teacher education:
1. students are provided with vicarious teaching problems that present real issues in context;
2. students can learn how to identify issues and frame problems;
3. cases can be used to model the process of analysis and inquiry in teaching;
4. students can acquire an enlarged repertoire and understanding of educational strategies.
5. cases help stimulate the habit of reflective inquiry.
Diary/journal
Some research employ both terms equally. Allport (1942:95) has made the point that ‘the spontaneous, intimate diary is the personal document par excellence’. Many researchers have kept diaries as self-evaluative tool of their own experience. The most notable study of a diary keeping method is described by Bailey (1990). She has used the diary study approach as one option for the classroom-centered research project required in the practicum. The resulting journals have focused on issues related to lesson planning and creativity, time management, problems faced by non-native teachers of English, classroom control, group work, and difficult student-teacher relations. Baily's (1990:218) sense of result is that diaries were often extremely useful exercises for the teachers-in-preparation, both in generating behavioural changes and in developing self-confidence.
Requirements to write the diary entries she identifies as follows:
a) to set aside time each day immediately following the class, in pleasant place free of interruptions;
b) the time allotted to writing about the language teaching or learning experience should at least equal the time spent in class;
c) to set up the conditions for writing so that the actual process of writing is or can become relatively free. It's difficult in getting started;
d) in recording entries in the original uncensored version of the diary, one should not worry about style, grammar, or organisation. The goal is to get complete and accurate data while the recollections are still fresh.
Her studies reveal some problems in keeping diaries. In actual practice, students experience difficulties in describing events freely, the process of writing seems to be tedious for them; they do not get used to criticize, reflect, express frustration, and raise questions in written form. Some students were reluctant to edit their private journals.
Porter, Goldstein, Leatherman, and Conrad (1990:240) consider the journal is not a personal diary. They emphasise that the journal is a place to go beyond notes made during observation by exploring, reacting, making connections. The journal entries are intended to be polished pieces of writing. But as diaries, as journal are not assessed. The problem with assessment is in that there is no rigid regulation about the frequency of entries per day or week. It depends on the nature and structure of the course. At the same time writing every week is considered to be productive since the journal is meant to be ongoing. Sometimes students need to process what they are reading and make connections among a number of readings.
Benefits of using journals Porter et al. (1990:287) sees as:
1) students can get help with areas of course content where they are having difficulty; get a teacher’s response;
2) they promote autonomous learning, encouraging students to take responsibility for their own learning and to develop their own ideas;
3) students can gain confidence in their ability to learn, to make sense of difficult material, and to have original insights;
4) the journal encourages students to make connections between course content and their own teaching;
5) the journals create interaction beyond the classroom, both between teacher and student, and among students. It allows an ongoing dialogue between teacher and students;
6) the journals make class more process oriented. Students input can in part shape the curriculum. The teacher can use this information to restructure the course.
Anecdotal records
Anecdotal records McKernan (1996:67) refers to narrative-verbatim descriptions of meaningful incidents and events which have been observed in the behavioural setting. They focus on narrative, conversation and dialogue and provide short, sharp incisive summaries of points that stick in the mind after the event. Anecdotal records are treated to be useful in teacher training education because they directly observe behavioural data which enable students to ‘see’ the incident and gain ‘inside’ perspective. One of the key tasks for the observer is to watch for the beginning and ending of ‘episodes’ of behaviour. McKernan (1996:68) sets some disadvantages of anecdotal records that are similar to diary keeping and journal as any piece of descriptive writing, such as:
1. they require extensive time to observe, write and interpret;
2. maintainenace of ‘objectivity’ is difficult;
3. observers require training in the use of anecdotes;
4. they are often reported without taking accounts of setting;
5. read out of context, they can be misunderstood and misinterpreted;
6. some observers focus on ‘negative’ or ‘undesirable’ events only.
Personal action logs
Personal action logs McKernan (1996:110) defines as record sheets which document a researcher’s activities over a lengthy time period ‘to get a full-blown representation’ of a day. Thornbury (1991:141) clarifies the purpose of log-keeping as ‘to direct trainees’ attention towards areas they may have overlooked or avoided; to measure the trainees’ assessment against our own; to make adjustments, if necessary, to the course design and/or content’. Logs may be kept in chart summary form, describing the main events with time sampling or in a more descriptive form similar to a diary. At the same time personal logs (McKernan 1996:111) are recommended to keep over a lengthy period of time and in connection with more extensive accounts, such as field notes, diaries and audio transcripts to validate findings.
Check-lists
The use of check-lists suggests the formulation of well-defined and ‘clearly delineated behaviour categories, which in turn presupposes more than a superficial acquaintance with the data’ (Hutt and Hutt 1970:38). It is used to focus ‘the observer’s attention to the presence, absence, or frequency of occurrence of each point of the prepared list as indicated by checkmarks’ (Hopkins and Antes 1985:467). Thus a prerequisite for obtaining reliable and valid data from check-lists is a set of clearly defined categories. For this reason a check-list would be unsuitable for recording behaviour with which the observer was not completely familiar or for recording the complete range of activities in a free-field situation. The researchers confirm that although in principle a large number of categories are feasible, in practice an observer is unable to cope reliably with more than fifteen. Different methodologists notice that as the number of categories increase, the problems involved in scanning these. That is why Hutt and Hutt (1970:69) offer from a practical view to have check-lists as compact as possible, since they are most commonly used in those situations where the observer is attempting to record unobtrusively and with the minimum of distraction to the subject.