91探花

For the last four years she鈥檚 been listening, and now it鈥檚 Catharine Beyer鈥檚 turn to speak. Beyer, together with Gerald Gillmore, director emeritus of the Office of Educational Assessment; Andrew Fisher, their research assistant; and four undergraduate researchers, has been probing the thoughts and feelings of 91探花students in an effort to find out how their schooling here affects their lives.

It鈥檚 called the 91探花Study of Undergraduate Learning, or 91探花SOUL, and as far as Beyer can tell it鈥檚 the only longitudinal (following the same group over time) study of the college student experience in recent times. First-year students 鈥� both freshmen and transfer 鈥� were enrolled in the study four years ago and then contacted periodically to answer questions about their experience. They were followed in this way through graduation.

For Beyer, it was a new way of interacting with students. She has taught for 18 years in the Interdisciplinary Writing Program, but a few years back she worked on several longitudinal studies of student writing. That鈥檚 where she met Gillmore.

鈥淛erry was thinking that it would be interesting to retain a panel of students that you could question every now and then as part of an assessment study,鈥� Beyer says. 鈥淪o you could find out, for example, whether they thought their classes were challenging and whether they thought they were learning critical thinking skills.鈥�

Half the group of 300 students, who were recruited from among those who filled out the entering student survey, completed online surveys and answered e-mail questions, while the other half did that and also submitted to interviews, participated in focus groups and compiled a yearly portfolio with an essay. The students were paid for their efforts, giving them incentive to remain in the study. The money came from state assessment funds with an additional contribution from the Office of Undergraduate Education.

鈥淭he study was not hypothesis driven,鈥� Beyer says. 鈥淚ts purpose was to describe what the undergraduate experience is. We wanted to find out what the University is doing well and what might be improved. We didn鈥檛 have a clue what we would find.鈥�

91探花SOUL sought information in six categories. Four were the categories that the state mandates be used for assessment: writing, critical thinking/problem solving, quantitative reasoning and information literacy. Gillmore and Beyer added understanding and appreciating diversity because past student surveys suggested that was an area of growth for students. Personal growth was added because students in previous studies talked about how they had changed as people as a result of their schooling.

So what are 91探花SOUL鈥檚 results? Difficult to encapsulate and incomplete at this point are two ways to answer that question. Although the study did ask some quantifiable survey questions, more often the questions were open-ended and the answers had to be analyzed and categorized in a slow, labor-intensive process. This means the researchers are still working on analysis even though the study has officially ended. It also means the results for the most part can鈥檛 be broken down into standard categories like 鈥渟trongly agree, somewhat agree,鈥� etc.

Which doesn鈥檛 mean that there is nothing to say. Much has been learned already, especially about the first two years, and Beyer has begun to talk about it.

鈥淭he bottom line is that students change while they are here,鈥� she told the audience at a recent presentation. 鈥淭hey change because they are challenged. They are changed by what we ask, by what they demand of themselves and by what life imposes on them. They leave different than when they arrived.鈥�

The first of these changes, for traditional college-age students, is a huge gain in independence. Away from their high school identities, they learn who they really are. 鈥淭hey learn what they want, not what someone else wants for them,鈥� Beyer says.

But students also receive 鈥� usually in their first quarter 鈥� what Beyer calls a 鈥渉ammering.鈥� They come here having been the best in their high schools or community colleges. Suddenly they discover that everyone around them is just as smart and they can鈥檛 count on outstanding grades with little effort.

This is a blow but it鈥檚 also a turning point, Beyer says. 鈥淭hey get over that and when they come back they come back really strong.鈥�

For some the hammering continues in other forms. Beyer told the story of one young man who had come to the 91探花with an interest in computers and an intention to major in business. But when he applied to the business school he was rejected 鈥� twice. He then took a class in informatics and enjoyed it so he applied to major in that. Again he was rejected 鈥� twice.

Bowed but not beaten, the young man took a geography class that involved service learning. He told Beyer: 鈥淏efore I came here, I was interested in making money. Geography changed this. Now I have this desire to change the world. After I graduate, I鈥檓 going to do Teach for America. I want to help empower people with education.鈥�

Young students are not the only ones who are changed. Beyer told of an older student who had returned to school with the idea of becoming a history teacher. He described to her how he was moved nearly to tears in an ethnic studies class, learning about the people who had been left out of the history classes he had taken when he was younger.

Results in the specific areas of the study include the following:

Quantitative Reasoning: Work in this area differs significantly from what students have had in the past. They鈥檙e used to working problems. Here they have to figure out what they are being asked, which formulas will work and then do the problems. Beyer says they find this 鈥渆normously difficult.鈥�

Writing/Critical Thinking: Students do not know there are differences in the types of thinking and writing required in different disciplines. They are used to writing only in English class. They have particular difficulties writing papers in which they must take a position and present supporting arguments.

Information Literacy: As students turn to the Web for information, the University has less control over what they are learning. 鈥淪omebody tosses out something in a lecture and students go to the Web to look it up,鈥� Beyer says. 鈥淚t鈥檚 exciting because they are ratcheting up their learning this way.鈥�

Diversity: Students are excited about the prospect of more diversity when they come to the UW. However, diversity isn鈥檛 always what we think it is 鈥� 鈥渟huffling people so they鈥檙e mixed.鈥� For many students of color, Beyer says, diversity means finally finding more people like themselves 鈥� something they didn鈥檛 have in high school.

Asked what the University could do to improve the undergraduate experience, Beyer says the most glaring need is for faculty to make the 鈥渂ones of our disciplines鈥� clear to first-year students, especially freshmen.

鈥淭hey need to understand what kinds of methods we鈥檙e using, how an argument is constructed in anthropology as opposed to art history or literature,鈥� she says. 鈥淭hen they鈥檒l have an easier time writing the papers we assign. We could accomplish that in part by showing them good student papers from the previous year.鈥�

Although making classes smaller would help too, Beyer knows that鈥檚 not going to happen in budget-cutting times. And the students feel differently about this than one might expect. 鈥淭he thing students think is most surprising in their first year is how small the 91探花seems,鈥� Beyer says. 鈥淎lready by their second quarter they feel they have a little community here, and that says a lot about the efforts we鈥檝e made, such as the Freshman Interest Groups.鈥�

In that tradition, Beyer is currently working with new- student orientation to plan a new event called Faculty Seminars. Between 150 and 300 faculty will meet with about 15 students each on the Friday before classes. Both teachers and students will have a booklet containing some of the results of 91探花SOUL that they鈥檒l be able to discuss. What should be in those booklets is the question Beyer is wrestling with now.

There are a number of reports outlining specific results of 91探花SOUL already available on the Web at (see sidebar below). Beyer and Gillmore continue to prepare new reports with the help of their research assistant Fisher. And the trio is working on a book.

鈥淚 feel a moral obligation to what the students told me,鈥� Beyer says. 鈥淚 feel like I鈥檓 haunted by voices, that they told me stuff about their experience here, and I need to get that word out there to people. I feel missionary-like about that.鈥�

91探花SOUL reports available

• What are the most important things you want to learn at the UW?
  
• What personal skills/abilities do you want to develop while you are at the UW?
  
• Describe a high school or community college project or assignment that required you to use problem-solving and critical- thinking skills.
  
• What was the hardest paper you wrote before you came to UW?
  
• Thinking about what you expected when you came to the UW, what, if anything, has surprised you the most?
  
• Student perceptions of academic expectations at the UW
  
• Critical thinking and problem solving
  
• Did you learn something important outside your classes this year?
  
• Attitudes about diversity
  
• Did you accomplish what you set out to accomplish this year?
  
• What do your professors do that leads you to think they care about your learning?
  
• Critical thinking and problem solving in the first two years
  
• Writing at the UW: The first year