RE: Assessment

The College of DuPage Student Outcomes Assessment Newsletter

Volume 3 Number 2 Winter Quarter, 2000

Outcomes Assessment General Index
Index of past issues of RE: Assessment
No frames view

What Our Transfer Students Say About Reading

In September, 1999, a total of 23 COD transfer students to Northern Illinois University participated in two different focus group sessions to determine how well they were prepared at COD for transfer to NIU. The study was commissioned by the COD Transfer Team and moderated by a disinterested party.

One of the questions asked was "How well prepared were you to handle the reading in NIU classes?" What follows is a direct quote from the moderator's report:

Wednesday session: Reading assignments at COD usually involved just the textbook, while at NIU additional reading materials were often assigned. All agreed that more reading was required at NIU. Several other adjustment problems were mentioned at this point. The most difficult adjustment was the change from three classes a quarter to five classes a semester. Other differences were fewer tests in NIU classes, fewer major projects at COD, and more feedback and more chances to improve grades at COD. The students speculated as to whether these differences were the normal progression between lower and upper level classes or an institutional difference between COD and NIU.

Thursday session: Most said they had more reading assignments at NIU than at COD. Students also commented that at COD instructors lecture mostly from the book, while at NIU lectures included more supplementary materials.

Each faculty member will have to decide how to respond to this feedback, but the observations of these students seem to reinforce the data generated by the CAAP tests regarding the progress our students make in college-level reading while they are with us.

The full report is available on the Student Outcomes Assessment web site: <www.cod.edu/outcomes>

Faculty Responses to the CAAP Reading Results

56 Faculty members responded to the Outcomes Committee's questionnaire concerning the 1999 CAAP Test results. Below are some of the more interesting comments and suggestions relating to the reading issue.

· The reading score DID NOT surprise me, as I have heard faculty say. . ."I don't assign extra reading because students don't do it." This attitude, & what I perceive are the results of it, DO disturb me.

· I've read that there is a direct correlation between low reading and high AV/computer use. Are we sacrificing one for the other? [The Library has over 10,000 instructional videos, and hundreds more are added each year.]

· I often feel like we do too much for our students in terms of handouts and organizing the material. Many students comment that they hardly read the texts for this very reason. Perhaps this is why reading scores declined.

· Based on experience at the Library reference desk, so many of our students are only willing to read short articles on their topicsor want to find an internet site that they can "cut and paste" into a written submission. A large number of students do not have the desire, vocabulary, and attention span to read book-length material.

· Some students don't even buy the text. They depend on handouts and notes.

· Across the curriculum, stress reading, writing, & analysis. Get rid of multiple choice, True-False, etc.

· At the discipline level, some courses might try a modified "great books" approach, in which all students in a multi-section course would read a "classic" in the field and develop a "conversation" that would go beyond the confines of a particular classroom.

· Develop a Reading Labincluding faculty courses on teaching reading across the curriculum and some individualized programs for students to improve comprehension and speed. In addition, develop a student/faculty/staff book club.

· Changes need to be made in [students'] attitudes & sense of priorities. Friends/Fun/Family/Work/School seems to be the order of the day.

· Ask students to think about the most important/most interesting area of their assigned reading; have them write out questions on the assigned reading; ask them to connect assigned reading to their lives or work in other courses.

· We need reading/writing across the curriculum. Part-timers should be made aware of the necessity of reading assignments as well. However, we hardly pay them enough to grade multiple essay assignments.

· At the institutional level, we need administrators who are not so focused on the "numbers game" that they want to "dumb down" courses so that everyone can "succeed." In some instances, I think faculty (especially part-timers) are given the message that it is more important to keep their students "happy" than to challenge them. If that message becomes pervasive, then we will have difficulties in meeting our Gen Ed goals.


F A Q

(Frequently Asked Questions)

Q. Isn't it the responsibility of the reading specialists in English to address any shortcomings our students may have in progressing in their college-level reading skills, rather than the responsibility of faculty in other disciplines?

A. The reading specialists deal with those students who enter COD with less-than-adequate reading skills that put them at risk for successfully completing entry-level courses. What the CAAP testing has pointed out is that, on average, those students who enter with acceptable reading skills are not developing their skills over time at the same rate as students at other community colleges and baccalaureate institutions. In other words, at the end of their sophomore year, our students are somewhat less able to comprehend college-level texts, research materials, and the professional literature of their career-fields than similar students at other institutions.

This is an issue for faculty in all disciplines to be concerned about. While some of our students do need remedial assistance, most just need to continue to improve their college reading skills within the context of their courses. The majority of our students have no problems in the mechanics of reading. Where they need our assistance and encouragement is in how to "decode" the information, how to deal with college-level writing that is dense in information, rich in ideas, and linked into subject area schemata. Each discipline has its own vocabulary and its own way of structuring discourse. Learning to read philosophy is different than learning to read sociology is different than learning to read chemistry. Thus, each faculty member should be helping students master the techniques for reading in the discipline.

How might this be done? First of all, there should be reading assignments that challenge and stretch the students' abilities. Then there should be structures to strongly encourage them to do the required reading; discussions or aids to assist in understanding the vocabulary and structure of discourse in the discipline; and CAT's to help both the students and the instructor identify problem areas in the reading assignments. These activities don't have to take up much class time. However, any time devoted to helping students become comfortable with the vocabulary, complex ideas, and structure of discourse within a discipline will be time well spent.

Q. Haven't the results of the CAAP testing for reading been somewhat skewed by the large number of non-native speakers of English on campus?

A. Perhaps, but not in the way one might think. Analysis of the data from the CAAP reading test shows that although our students who are non-native speakers of English may start out at a somewhat lower reading level than our native speakers, the non-native speakers show significantly more improvement over time than the native speakers. If they have skewed the numbers, it is in the direction of improved reading abilities. 

Assessment In Action
A Sharing of Ideas

CATs for Reading

CATs can be used to encourage students to do their reading assignments and do them on time; more importantly, they serve as feedback to both the students and the instructor on how well the reading material is being comprehended.

In her Accounting 151 class, Jeannie Folk takes advantage of apparatus that is included in the textbook she chose. Each chapter has three to four "before you go onreview it" sections, and each of those sections has three to four questions covering the material just read. Jeannie has her students write out the questions and their responses and turn them in the first day the chapter is to be covered in class. This ensures that the students have done the reading in a timely fashion and that their reading has been more than just cursory. She scans the responses for completeness, is alerted to any patterns of misunderstanding, and assigns completion points for each chapter response.

Jeannie notes, "In the past, my major complaint re reading was that (1) hardly anyone read the chapter before we covered it in classeven though reading the chapter was listed as an assignmentand (2) some students never read the chapter/textbookI guess they thought coming to class was enough." This approach has solved many of those concerns.

Peter Klassen takes a somewhat different approach with his Sociology students. He uses an abbreviated form of the RSQC2 CAT (Recall, Summarize, Question, Connect, and Comment). At the beginning of class, Peter has his students write out a list of the most important or meaningful points they recall from the reading assignment. He then has them integrate these points into a summary sentence that captures the essence of the reading assignment. Finally, he has them jot down one or two questions they might have relating to the reading. Peter quickly scans these RSQ responses and then makes them the focus for the class discussion.

Peter notes that the first time or two he does this as a class activity, there is some resistance from students, but after that, students find it a useful technique. He is also careful to explain why he is doing it in exactly this way. Some of his students have asked if they couldn't just write out everything in advance at the time they are doing the reading. Peter points out to them that by recalling the information at a later time, they have a much better indication of how well they have read and understood the material. His experience is similar to Jeannie's; many more students come to class having completed the reading assignments on time.

One last remark from Peter that is good advice to anyone who administers a CAT; explain to your students the purpose of the CAT and how it will benefit them. Students are much more receptive when they understand why an activity is structured in a particular way and what the payoff is to them personally.