AN ASSESSMENT OF PRE-SERVICE LANGUAGE TEACHERS ’ PRACTICUM OBSERVATION FORMS : DESCRIPTIVE OBSERVATION VS . CRITICAL OBSERVATION

Practicing the role of teacher and auditing/observing experienced teachers are essential parts of practicum studies of pre-service teachers. Regarding observation we differentiate between two kinds of practice: descriptive observation and critical observation. In this paper we reported on 38 pre-service teachers’ weekly practicum study observation reports of the classes they taught and audited over a twelve week period during their practicum study. The study examined the level of critical observation in the observation forms of pre-service teachers over twelve weeks’ period. Results showed that pre-service teachers mostly focused on the identification of techniques and strategies their cooperating teachers employed and only rarely were critical regarding the cooperating teachers’ lesson preparation, classroom management, communication with her/his students and his/her using methods and techniques during the classes. This paper discusses the drawbacks of simple, descriptive observation and provides guiding questions to help pre-service teachers conduct critical observations in their practicum study.


Introduction
In Turkey, language teacher education programs are offered by both education faculties and arts and science faculties of universities.As an obligatory part of the curriculum pre-service teachers attend practicum study for one semester and keep a log in which they write on their observation they conduct during their practicum.The practicum lasts for one semester during which pre-service teachers takes turns to teach their mentor's students who are seventh or eighth year primary school pupils.The observation forms have five sections: a) lesson plan and the cooperating teacher's preparation for the lesson, b) the methods and techniques employed, c) communication,d)classroom management, and e) comments.Each week for four hours pre-service teachers visit their primary or secondary school and take turns in teaching classes and after auditing the cooperating teacher's classes fill out observation forms.Preservice teachers register for teaching practicum for a semester.Most of them work in primary or secondary schools and they receive support, on the one hand, from their university counsellor; on the other, from the school cooperating teacher.Zeichner suggests (1990) field experiences are significant means through which to develop prospective teachers' understanding of the why, what, and how of teaching and learning.However, simply placing pre-service teachers in the field does not automatically result in a valuable experience for the teacher candidate.The purpose of this study is to evaluate the extent of critical observation, which can be defined as skilled and active interpretation and evaluations of observations in the observation forms of pre-service teachers.

Related Research
Observing experienced teachers is an essential part of most teaching practicum programs around the world.The basic appeal for observation is that with its tangible effects it seems to be a relatively simple activity to organize and it is a way of mastering specific types of behaviours which are observable in the lessons of good teachers (Richards, 1998).Preservice teacher preparatory programs generally combine observation and other research activities to help participants in their initial encounters with their future profession and with no doubt, observation as a key element in teachers' investigation emerges as one of the most important practices to help future teachers learn (Gonzalez, 2005).Baek and Ham (2009) suggest that recent researches on teaching practicum focuses on four themes: a) pre-service teacher's satisfaction, b) pre-service teacher's teaching performance, c) pre-service teacher's efficacy and d) pre-service teacher's understanding school as a field.Focusing on a different aspect, Baek and Ham (2009) then investigates the educational value of teaching practicum in secondary school.Referring to the results Bake and Ham argued that the teaching practicum had significantly improved pre-service teachers' practical teaching competence, readiness for teacher, and maturity in character, which implies that teaching practicum, is essentail in language teacher education programs.Regarding observation in language teacher education programs, Lally and Veleba (2000) draw our attention to the limited guidance and support given to pre-service teachers and offers keeping teaching diaries which can be used as an observation tool.Regarding the drawbacks of evaluation forms filled out during or after observation session Conle (1999) gives an example from her own faculty.She argues that the evaluation form they [85] devised at their faculty reinforces the perception that good teaching requires performance in front of the students; this is only a perception and not a general truth.When she discussed with her colleagues they also thought that the form did not seem to suit their teaching either.
In addition to such deficiencies, the theory or methodology of teaching a particular cooperating teacher influences the observation of pre-service teacher: that two teachers' classroom behaviours change in accordance with their philosophy of teaching causes pre-service teachers give contradictory accounts of the same event (Richards, 1998).Therefore, as a solution to this problem Richards (1998) suggests that: In using classroom observation in language teacher programs, it is therefore necessary to go beyond a focus on the identification of the techniques and strategies experienced teachers employ and to use observation as a way of collecting information that can be used to develop a deeper understanding of how and why teachers teach the way they do and the different ways teachers approach their lessons (p.142)."Going beyond a focus on the identification of the techniques and strategies experienced teachers employ" entails a formal observation which, according to Day (1990), can help preservice teachers in: •Developing a terminology for understanding and discussing the teaching process •Developing an awareness of the principles and decision making that underlie effective teaching •Distinguishing between effective and ineffective classroom practices •Identifying techniques and practices student teachers can apply to their own teaching.Thus, while on the one hand the purpose of this study is to assess the observation forms filled out by pre-service teachers during practicum study, on the other hand it provides a rubric to guide the prospective pre-service teachers.The rubric questions prepared aim to elicit multiple perspectives and generate various answers.

Participants
The participants in this study were 38 students (24 females and 14 males ranging between 21-25 years of age); senior Turkish pre-service teachers of English studying at the English Language and Literature Department of Kafkas University.They are graduates of either private or state secondary schools from all over Turkey.Therefore, they share common cultural characteristics.In the Spring Semester of 2009-2010 Academic Year, pre-service teachers registered for teaching practicum and were involved in classroom observations; they twice or three times had the opportunity to gain some practical teaching experience before they graduated.

Instruments
In this study, 38 files in which observation forms filled out by 38 preservice teachers from the English Language and Literature Department of Kafkas University were analyzed.Preservice teachers were required to write down lesson plans and fill out observation reports.The observation reports consist of two main parts: a) lesson plan and procedure b) observation form.In the lesson plan a brief summary of what has been done in the class and some factual information are given such as subject of the lesson, the students which will cover the subject, duration of class time, etc.The observation forms have five sub headings: a) lesson plan and the mentor teacher's getting prepared for the lesson, b) the methods and techniques employed, [86] c) communication, d) classroom management, and e) comments.In analyzing those papers we tried to find answers to the following research questions: 1. What do pre-service teachers write in their practicum study observation forms? 2. To what extent is their observation critical or descriptive?Since either the pre-service teachers were sometimes absent from the observation sessions or thinking what they wrote in the lesson plan and procedure section enough they did not write anything in the observation form, the total number of observation forms submitted within those 38 files was 420.Hence, out of 456 expected forms only 420 forms were submitted to the researcher.

Data analysis
All observation forms filled out by the participants in this study were analyzed using content analysis.Using this method the researcher searched through the data for and recurring themes emerging in five subheadings were identified.At the first stage, we tried to categorize each response as descriptive or critical referring to a model prepared Ho and Richards (1993;qtd in Liou 2001).The responses explaining how the teachers get prepared and make lesson plan; and which methods/techniques are applied in the classroom; the content of the lesson and the patterns of communication are labelled as Descriptive Observation (DO).On the other hand, responses providing personal opinions and justifications, or evaluating the lesson are labelled as Critical Observation (CO).In other words, the responses related providing factual information are categorized as DO, whereas those revealing student teacher's beliefs, ideas, thoughts about the issues dealt with in the observation sheet are categorized as CO.As the second step, for each re-emerging theme (time-of-mention=ToM), a frequency test was run utilizing the Statistical Package for Social Sciences (SPSS) computer program.

Results and discussion
As there are five sections in the observation form, we analyzed the responses in five subheadings titled as Item 1 to Item 5.In tables of the each subheading we provided the frequencies and percentages of the responses given.

Item 1: Responses to the lesson plan and the cooperating teacher's preparation for the class.
The first section of the observation sheet is about the cooperating teacher's lesson plan and getting prepared for the class.Themes emerged in the participants' response sheets are teacher's following textbook as a lesson plan (DO), teacher's bringing materials such as tape recorder, puppet, etc to the classroom (DO), and pre-service teachers' evaluations of the lesson plan (CO).Having a look at [88]

Item Themes
As can be seen in Table 3, we can see that Theme 1 emerged 192 times in the response sheets (43.6%) and Theme 2 emerged with 24.3 percentages.Theme 3 and 4 emerged with 20.2 and 11.8 percentages, respectively.We present the following verbatim excerpts from the response sheets of participants: Teacher-student and student-student communications were established.
(Theme 1) The teacher has a very successfulefficient communication with the classroom.(Theme 2) The teacher has full control over the class.

(Theme 3)
There is an appropriate atmosphere for teaching learning activities.
(Theme 4) Item 4: Responses regarding classroom management.For this section themes emerged in the participants' response sheets are evaluation of the teacher's management (CO), evaluation of the atmosphere in the classroom (CO), and teacher's control in the classroom (CO).Out of 38 pre-service teachers only three of them wrote down on the comments section because they seemed to be confused about what to write on this section.Since there was no instruction for how to fill out that section -the only thing pre-service teachers saw in the heading was "Comments"-they seemed not to be sure what to write in that section.This is because we have also skipped out this section from the rubric (see Appendix A for details) prepared for pre-service teachers.For this section themes emerged in the participants' response sheets are evaluation of the cooperating teacher's teaching (CO), use of materials and methods (CO) and personal feelings (DO).

Item
Themes ToM % 1. Students teachers' personal feelings 13 24.1 2. Pre-service teachers' evaluation of the cooperating teacher's teaching 22 40.7 3. Pre-service teachers' comment on the use of materials and methods 19 35.2 Table 5. Responses to the fifth section. [89] As can be seen in Table 5, we can see that Theme 1 emerged 22 times in the response sheets (40.7%) while Theme 2 and Theme 3 emerged with 35.2 and 24.1 percentages, respectively.We present the following verbatim excerpts from the response sheets of participants: I feel very excited because I regard this day as the first day of my teaching career.(Theme 1) The teacher established a cheerful learning atmosphere for the students.
(Theme 2) The materials and methods used were in line with the objectives of the lesson.
(Theme 3) As the above presented results display pre-service teachers in this study wrote down mainly descriptive observations for the first, second and third sections of the observation sheet.As the nature of the fourth and fifth sections encourage preservice teachers to evaluate and give their personal feelings, in these sections we see the samples of critical observations.The extent of these critical observations, however, does not go beyond such comments as "successful" or "efficient".One of the most complained points in professional development of teachers is that having getting experienced in teaching most teachers develop routines and it becomes high time for the experienced teacher to criticize himself/herself and engage in professional development.Preservice teacher education seems to the best point at which we could tell our students that everybody is in constant need of change in order to adapt to the changing conditions, even teachers of all branches need to reflect on and make necessary amendments on his/her way of teaching.Hence before assuming a critical attitude for his/her own teaching, pre-service teachers should learn and practice criticizing their mentor teacher's teaching.As with Conle's (1999) criticism of the evaluation form mentioned in her study, which was devised at their faculty and reinforces the perception that good teaching requires performance in front of the students; the form devised in our faculty seems not to provide pre-service teachers with enough guidance as to filling out the forms.Therefore, we have prepared a rubric to be referred to before beginning observation sessions in practicum study (see Appendix A for details).The questions in the rubric both helps the Turkish students who are to prepare such a report mentioned in this study and also to pre-service language teachers all around the world who are to observe language classes and write reports after observation sessions during the practicum study.

Conclusion
This study documented what pre-service teachers wrote in filling out their observation forms during the practicum study.The participant pre-service teachers filled out "observation forms" as a part of their practicum study and wrote both factual and evaluative remarks, albeit few, in those observation reports.They, however, wrote mainly on what was going on in the classroom summarizing, not reflecting, this is what many k-12 students do as well without evaluating or judging the lesson plan, methods/techniques used, the communication in the classroom and the teacher's classroom management.We believe that teacher educators' one of the major contributions would be fostering pre-service teachers to engage in critical observation processes for their own professional development and transform the language classroom.In conclusion, these findings highlight the need to expand critical questioning/observation activities for pre-service teachers' personal and professional development.The findings of this study support the claim that observation guidelines [90] should be tailored to engage pre-service teachers in critical thinking.Furthermore we believe that in a follow up study we should explore why the participants of this study did not evaluate and judge the lesson plan, methods/techniques used, the communication in the classroom and the teacher's classroom management, and only described what was going on in the classroom.Through a retrospective interview with the participants the main reason could be found out precisely.
plan and getting prepared for the lesson  Why do we need lesson plans? Are textbooks and other materials interesting and useful? Do they help students to practice and improve their language skills? Does the lesson plan include such important elements as the objectives, assessments, class activities? How does a lesson plan help teacher to achieve his/her goals? What do you think are the benefits and difficulties of preparing a lesson plan?B. Methods and techniques employed  Which techniques of the method the teacher employs are used? What is students' reaction to methods and techniques used? Do they look bored and frustrated, or enthusiastic and interested? In your opinion, for which techniques/methods are the materials for? What do you think are the strengths and limitations of the methods and techniques used?C. Communication  Do the lessons usually begin and end in the same way? How do students respond to teacher feed back? How does the teacher draw a lesson to a close? How do the teacher and the class move from one activity to another? Do the learners ask for clarification and how?  How does the teacher give instruction, respond to students' errors, and work with reluctant learners? Do the learners have an impact on classroom activities? Are there learners who are relatively more or less participatory during particular lesson phases?D. Classroom management  What are some characteristics of the teacher's instructional style that work well?And what are some characteristic you find to be less helpful? How does the teacher allot time within a lesson? How does the teacher assign ask to students? How does the teacher reinforce student answers? How does the teacher supervise students while they are learning  How does the teacher handle misbehaviour and off-task behaviour?

Table 1 .
Responses to the first section.

Table 1 ,
we can see that Theme 1 emerged 345 times in the observation sheets (73.9%) and Theme 2 emerged with 17.3 percentage.Theme 3 which reflects a critical observation emerged with only 8.8 percentages.We present the following verbatim excerpts from the sheets of preservice teachers:The teacher does not make a lesson plan because s/he follows the textbook.
(Theme 1) The teachers bring to the classroom a puppet to take the attention of the students.(Theme 2) The teacher has a successful lesson plan.(Theme 3)

Table 2 .
Responses to the second section.

Table 3 .
Responses to the third section.

Table 4 .
Responses to the fourth section.