Critical Thinking Video Assignment Assessment

Episode 3

With four quintels aboard, we were now ready to leave. The skipper saw mares’ tails in the north.

Stephen

I wonder what quintels are? I think maybe it’s a sea term, a word that means perhaps the weight aboard. Yes maybe it’s how much fish they had aboard. [So you think it was fish?] I think fish or maybe something they had found in the water but I think fish more because of the word “catch.” [Why were they worried about the mares’ tails?] I’m not sure. Mares’ tails, let me see, mares are horses but horses are not going to be in the water. The mares’ tails are in the north. Here farmers watch the north for bad weather, so maybe the fishermen do the same thing. Yeah, I think that’s it, it’s a cloud formation which could mean strong winds and hail or something which I think could be dangerous if you were in a boat and had a lot of weight aboard. [Any questions?] No.

Colleen

They were finished with their shopping and were ready to go home. [What did they have aboard?] Quintels. [What are quintels?] I don’t know. [Why were they worried about the mares’ tails?] There were a group of horses on the street and they were afraid they would attack the car. [Any questions?] No.

Commentary

Stephen is successful in his efforts to incorporate the new information into an evolving interpretation. From the outset Stephen acknowledges that he does not know the meaning of quintel and seeks a resolution of this unknown. He derives a meaning consistent with his evolving interpretations and with the textual evidence. In his attempt to understand the expression mares’ tails he first acknowledges that he does not know the meaning of the expression. Thence, he establishes what he does know from the background knowledge (mares are horses, horses are not going to be in the water, there is nothing around except sky and water, farmers watch the north for bad weather) and textual information (the men are on the bay, they have things aboard, the mares’ tails are in the north) and inferences he has previously made (the men are in a boat, they are fishing). He integrates this knowledge into a comparison between the concerns of Alberta farmers with which he is familiar, and what he takes to be analogous concerns of fishermen. On seeing the pertinence of this analogy he draws the conclusion that the mares’ tails must be a cloud formation foreboding inclement weather. He claims support for his conclusion in the fact that it would explain the skipper’s concern for the mares’ tails, indicating that he did not lose sight of the overall task of understanding the story.

Colleen maintains her original interpretation but does not incorporate all the new textual information into it. She works with the information on the men’s leaving and the mares’ tails, but appears to ignore or remain vague about other information. For example, she says the cargo was comprised of quintels but indicates no effort to determine what these things are. She cites the fact that the men were ready to leave and suggests that they have finished their shopping, but does not attempt to explain the use of such words as skipper, cargo, and aboard in the context for shopping for clothes. She interprets mares’ tails as a group of horses the possibly would attack the men, but gives no account of what the horses might be doing on the street. Basically, she appears to grow tolerant of ambiguity and incompleteness in her interpretation.

Interestingly, each student believes that he or she has read the passage. The question becomes, what does it mean “to read” something? Comprehensive, legitimate critical thinking enables us to explore the meaning of the concept “to read” and to come to understand that there is a spectrum of quality of readings, some superficial and mechanical, some deep and thorough. Specifically, Colleen has scrambled to piece together meanings that have little relationship to the writer’s ideas. Colleen has “read” the passage but we can quickly see that the quality of her thinking lacks characteristics that we equate with sound reasoning, with critical thinking. She has been ineffective in thinking within the system of meanings inherent in what was said in the passage she tried to read. That her responses were inconsistent did not seem to disturb her, almost as if she had no sense of how to figure out what she was reading. The consequences for Colleen in this episode of thinking are minimal.

However, consider how vulnerable she will be outside school, when much more than grades or teacher approval is riding on her ability to think effectively in other systems, such as health care, parenting, upgrading job skills or becoming a proficient consumer.

On the other hand, Stephen has “read” the passage by means of critical reasoning, effectively decoding not only the words but the writer’s thoughts. He has taken the initiative to reconstruct in his mind as much as he can of the logic of the images and concepts that the writer conveyed through the system of language. Stephen also explored the implications of his ideas and was clear about what he understood and failed to understand. He demonstrated intellectual perseverance in striving to make sense when struggling with difficult passages. He expected to make sense of the passage, to grasp the author’s ideas, and finally he did. These habits, traits and abilities are among those we find in individuals for whom critical thinking is a comprehensive, substantial system of thought embedded, ideally, in every aspect of their lives. Although Colleen and Stephen have each “read” the passage, a useful distinction can be drawn between “critical reading” and “uncritical reading.”

Most reading is performed at the lower end of the spectrum in school today. Very little instruction is given in the thinking skills that critical readers use. Colleen will only be able to improve with professional assistance, that is, with instruction that helps her assess her thinking using intellectual standards and a sense of the elements of thought. She needs help in learning how to think through the elements of a problem. Of course, instruction alone is insufficient. She will also need to apply her will and acquire self-discipline. She will need extensive practice and expectations placed on her effort.

As we stretch ourselves to develop our bodies we naturally feel some physical stress. So, too, do we feel intellectual stress as we stretch our minds to develop our thinking. Students must learn intellectual perseverance, intellectual responsibility, intellectual integrity to develop true intellectual “fitness.” This is a lifetime process that merely begins in school. Most students are not well informed about the consequences of their uncritical thinking habits. It is likely that no one has presented these ideas to them so that they realistically grasp the possibility of intellectual development. Let’s now look at two student written responses and examine the quality of the thinking displayed, keeping in mind the implications for the students’ future effectiveness.

Are We Hitting the Target,
Assessing Student Thinking in Writing?

The Assignment: The students in Ms. Tamari’s 8th grade class were asked to write a paragraph in which they were to explain what the most important characteristics of a “friend” are and why they are most important. Here are the written responses of two students, Susan and Carl.

Susan

A friend is someone who cares a lot about you, who likes to be with you, and who helps you out when you get in trouble. The most important characteristics of a friend are loyalty, helpfulness, and honesty. First, it’s important for a friend to be loyal because you want to depend on your friend. If someone is not loyal that person may turn against you, especially if she meets someone he or she likes better than you. Second, it’s important for a friend to be helpful, because often a person needs help and if you have no friends it can be real hard to feel so alone. And finally, it’s important for a friend to be honest because very few people will tell you something about yourself that you don’t want to hear. An honest friend will try to help you improve, even though she knows it may hurt your feelings. It’s okay to hear some things from a friend because you know that she isn’t trying to hurt you.

Observations

Susan is basically doing a good job critically analyzing which characteristics are desirable in a friend. First of all, it is clear that she understands the issue. First she clarifies the concept of a friend. Then she asserts three characteristics of a good friend. Then she takes each one in order and gives good reasons in support of each of them. Her writing is clear, relevant to the issue, systematic, well-reasoned, and reflects deep thinking for her age.

Now let’s look at the writing of Carl.

Carl

The most important thing is to have a lot of friends who like to do the things you like to do. Then you can go places and have fun. I mostly like other boys for my friends because they like sports like me. Girls sometimes play sports too but not as good as boys. I like to play baseball, football, and basketball. Sometimes I like to play Hockey. There are no good places to play in my neighborhood and sometimes my mother makes me come in too early. She sometimes makes me very mad because she screws up my life. All she ever wants me to do is work around the house. I don’t think she knows anything about having friends. Maybe if she had played sports when she was little she’d let me play more and not just think about work, work, and more work.

Observations

Almost all of Carl’s writing is irrelevant to the issue of what are the most desirable characteristics of a friend. He seems simply to be writing thoughts down as they occur to him in a stream of consciousness, in an associational way. Carl begins by confusing the question “What are the most important characteristics in a friend?” with “Is it important to know a lot of people who share pleasures with you?” He then moves to the question “Who do I like?” Then he moves to the question “What do I like to do?” and then on to “What’s wrong with my neighborhood?” The final question, “Why doesn’t my mother let me do what I want to do?” indicates that he has ended up far off course, yet it is unlikely that he realizes it. Until Carl learns to discipline his mind to stick to the question at hand, he will have trouble doing any quality thinking.

Learning to write out our thinking is one of the best ways to improve it. It goes without saying that excellence in writing requires excellence in thinking.

Writing requires that one systematize one’s thinking, arranging thought in a progression that makes the system of one’s thought accessible to others. When the writer’s thinking lacks a clear purpose, lacks focus, lacks documentation and logic, and standards by which to judge the merit of the ideas, these flaws are revealed in the written work.

Writing, then, which is excellent is excellently thought through and is produced by someone with definite standards for both thinking and writing. (See the chapters: “Why Students and Teachers Don’t Reason Well” and “Pseudo Critical Thinking in the Educational Establishment.”) It is obvious as we read the responses of Carl and Susan that each has a very different understanding of what is well-thought-out thinking and writing, critical and uncritical thinking and writing. The consequences for Carl’s uncritical thinking are minimal in 8th grade, but how will he be affected when he demonstrates the same confusions on the job?

School instruction is focused on “subject matter.” We usually, but wrongfully, think of school subjects as little more than masses of facts and definitions to be memorized. We don’t often recognize that what is really important about school subjects is that they—when properly learned provide us raw materials upon which to practice thinking in a more proficient and insightful manner. They introduce us to new “systems” in which to think. As you read the next section, see if you can think of school subjects in this more illuminating and penetrating way.

Are We Hitting the Target?
Assessing Student Thinking in Academic Subjects.

Subject Matter, Especially in High School and College Courses

Though we often do not think of it this way, all subject matter — history, literature, geography, biology, chemistry, physics, mathematics — is part of a system of logically ordered parts. A historian studies a period and creates a “story” that puts events into meaningful patterns. In literature we study periods with their distinctive visions, their distinctive values, their distinctive modes of expression. One period is “romantic,” one is “classic,” one is “realist,” and so forth. Or we study the outlook of an author, the way he or she sees the world: Dickens, Austen, Hemingway, Faulkner. In geography we develop systems for dividing up the surface of the earth into continents, countries, climates. We develop organized, logical ways to look at the surface, especially the physical surface, of the earth. In geology, we use a system to arrange time into geological time periods, and correlate principal physical and biological features with those periods. In biology, we develop systems for making sense of multiple forms of living and pre-living things. In math, we develop systems — arithmetic, geometry, algebra, calculus — for dealing with the quantitative dimensions of the world.

Everywhere there are systems inherent in subject matter, networks of logically ordered parts functioning in relation to each other for a definite human purpose. Critical thinking, with its system-unlocking orientation, is the perfect set of tools to take command of the systems inherent in subject matter. It is perfect, that is, only if we understand what it is and how to use it. Most students, unfortunately, have never been introduced to critical thinking, so cannot systematically use it to guide and empower their learning. Most students try to learn what is in fact systematized, by randomly memorizing fragments of the system as if they had no relation to each other. Compare the two following students talking about studying history.

Anna: “I don’t really like history too much. There is too much to try to remember. And it’s all about olden times, with a lot of dates and different wars and people doing things we don’t do anymore. You learn about presidents and kings and what they did and about when things happened. History is all about the past. It’s boring and I never use it. How could you? Things are really different now. “

Carra: “We do it differently in Mrs Brown’s class. Do you know that we’re all part of history? For example, in my mind I remember all of my past as a kind of story I tell myself. That’s how I remember things and that’s also how I figure things out. Think about it. Whenever you talk about yourself, you’re like a historian trying to help people figure things out about you. Everyone is really interested in their own history and in the history of the people they know. That’s what gossip is all about. Also the news. It’s like the history of yesterday. In her class we talk about how the history writer puts together the story he writes.

We also look at how the story might be told differently, I mean ‘cause what we read is only a tiny part of what the writer knows, and what the writer knows is only a tiny part of what actually happened. You have to look at it from different points of view or else you don’t have a chance of figuring out what most likely really happened. We are learning how to tell the difference between “facts” and how different people filter and interpret the facts depending on their own interests. We also try to notice what is left out of the history stories we read. Mrs. Brown says we are learning to think like history writers do and face the problems that they face. I think its fun to try to figure out history . . . how to tell a story in the most honest way, and how to see when people twist a story to make themselves look good.”

Observations

Anna and Carra, in their reactions to history, model the distinction between the way subjects have traditionally been taught ( as a lot of stuff to remember for a test) and the way they should be taught (as a way to figure things out). The traditional student never gets the real point of the subject and hence does not transfer what she learns to the “real” world. By teaching history in a critical manner students can readily transfer what they learn to “life-centered” situations. They can improve their own everyday historical thinking.

Critical thinking is valuable, of course, not only in school but in the world beyond school as well. If we are teaching properly, our students not only learn how to apply critical thinking effectively to their reading, writing, and subject-matter learning, they also begin to apply it to their everyday lives. The wonderful result is they not only reason historically about what is in their history textbook, for example, they also begin to reason much better about the “historical” issues in their daily life, as Carra is doing above. They not only reason scientifically about what is in their science textbook, they also begin to reason scientifically about the ‘scientific” questions in their daily life. They not only hear about ethical principles when talking about characters in stories in their literature class, they also begin to use ethical reasoning when dealing with the ethical issues embedded in their lives.

Indeed, if we do our job correctly, students begin to discover that all the kinds of reasoning that they learn to do at school have application in the “real” world. They not only start to talk about and value reasoning in school, they also begin to discover how actually to do it, how to realistically and effectively to apply intellectual standards to their own thought in virtually every context of their lives. The result is that students, for the first time in their lives, begin to evaluate their own thinking and do so in a way that is increasingly disciplined and objective. Let’s look at three examples of college students beginning to discover the value of applying intellectual standards to their own work and thinking.

Mandy: “I am often inconsistent. The most difficult aspect of my weakness is my attempt at achieving consistency between that of word and deed. That is, I use a double standard. I often say one thing and do another.”

Kristin: “This semester I have learned how to organize my thinking through critical thinking. In organizing my thinking logically I have learned to break down my thought processes down into specific parts. By breaking my thought process down into specific parts I can see some of my strengths and weaknesses. When I do not organize my thought logically, my writing often becomes trivial, irrelevant and vague.”

Laurie: “It is important to recognize key concepts when one thinks. If I need to figure out a problem and do not understand the key concepts, I will not be able to come to a logical conclusion. I am more and more aware of the need to pay attention to key concepts. One particular example occurred this winter when I went snowboarding for the first time.

The relevant concepts of snowboarding are: one needs to torque the body, the back leg is your anchor, and the edges of the board are used to slow down and in turn control the speed of the board. My friend explained to me that it usually takes a whole day to learn to snowboard, but because I paid close attention to the concepts and kept them carefully in mind, I was able to learn quickly. Most students do not realize that concepts are important in learning. In fact, I think that most students don’t know what concepts are. I certainly didn’t.”

These examples demonstrate that some students are prepared to take advantage of critical thinking instruction, though others are less ready. The teacher’s challenge, however, is to meet the student’s needs and respond effectively with appropriate instruction.

Identifying the Target:
Critical Thinking in the Workplace

With accelerating change and the increasing complexity of problems facing us at the dawn of the 21st Century, we are striving to compete within the new global economic realities. John Sculley, CEO of Apple Computer, Inc. reported to President-elect Clinton in December of 1992:

What Is Critical Thinking?

Critical thinking is a higher-order cognitive skill that is indispensable to students, readying them to respond to a variety of complex problems that are sure to arise in their personal and professional lives. The  cognitive skills at the foundation of critical thinking are  analysis, interpretation, evaluation, explanation, inference, and self-regulation. Below is an image that represents each of these skills (Facione, 2010, Critical thinking: What it is and why it counts).

 

*Image retrieved from Rasmussen College

When students think critically, they actively engage in these processes:

  • Communication
  • Analysis
  • Synthesis
  • Problem-solving
  • Evaluation
  • Reflection

*Adapted from Saint Petersburg College

To create environments that engage students in these processes, instructors need to ask questions, encourage the expression of diverse opinions, and involve students in a variety of hands-on activities that force them to be involved in their learning.

Types of Critical Thinking Skills

Instructors should select activities based on the level of thinking they want students to do and the learning objectives for the course or assignment. The chart below describes questions to ask in order to show that students can demonstrate different levels of critical thinking.

Level of critical thinking Skills students demonstrateQuestions to ask
Lower levels
Rememberingrecognize, describe, list, identify, retrieve
  • What do we already know about…?
  • What are the principles of … ?
  • How does … tie in with what we learned before?
Understandingexplain, generalize, estimate, predict, describe
  • Summarize…or explain…
  • What will happen if?
  • What does….mean?
Higher levels
Applyingcarry out, use, implement, show, solve
  • What would happen if…?
  • How could…be used to…?
  • What is the counterargument for..?
Analyzingcompare, organize, deconstruct
  • Why is…important?
  • What are the implications of…?
  • Explain why/Explain how…
Evaluatingcheck, judge, critique, conclude, explain
  • Why is…happening?
  • What is the best..and why?
  • How does…affect?
Creatingconstruct, plan, design, produce
  • What is the solution to the problem?
  • What do you think causes..? Why?
  • What is another way to look at?

*Adapted from Brown University’s Harriet W Sheridan Center for Teaching and Learning

Using Online Tools to Teach Critical Thinking Skills

Online instructors can use technology tools to create activities that help students develop both lower-level and higher-level critical thinking skills.

  • Reflection activities. Reflection activities provide students with opportunities to track their learning and demonstrate their progress throughout the semester. To enhance the level of critical thinking students do through reflective activities, tell students to cite course materials that have helped them advance their knowledge and thinking.
    • Example: Use Google Doc, a collaboration feature in Canvas, and tell students to keep a journal in which they reflect on what they are learning, describe the progress they are making in the class, and cite course materials that have been most relevant to their progress. Students can share the Google Doc with you, and instructors can comment on their work.
  • Peer review activities. Peer review activities enable students to demonstrate communication skills by giving feedback on each other’s work, expose students to alternative perspectives, and allow students to question what they are reading. Doing peer review activities online can protects students’ anonymity, making students more likely to be honest in their feedback (Lin, S. S., Liu, E. Z. F., & Yuan, S. M., 2001,  Web‐based peer assessment: feedback for students with various thinking‐styles).
    • Example: Use the peer review assignment feature in Canvas and manually or automatically form peer review groups. These groups can be anonymous or display students’ names. Tell students to give feedback to two of their peers on the first draft of a research paper. Use the rubric feature in Canvas to create a rubric for students to use. Show students the rubric along with the assignment instructions so that students know what they will be evaluated on and how to evaluate their peers.
  • Discussion forums. Discussion forums allow students to communicate with their peers, answer questions that require them to demonstrate both lower-level and higher-level critical thinking skills, and analyze course content. When instructors set clear guidelines for participation and model critical thinking skills through their participation in discussion forums, students can also demonstrate how they are engaging in the critical thinking process.
    • Example: Use the discussions feature in Canvas and tell students to have a debate about a video they watched. Pose the debate questions in the discussion forum, and give students instructions to take a side of the debate and cite course readings to support their arguments.  
  • Small group activities. Small group activities allow students to communicate, problem solve, hear different perspectives, and collaborate to analyze and synthesize course content. By assigning small group activities, instructors can engage students in multiple levels of critical thinking.
    • Example: Use goreact, a tool for creating and commenting on online presentations, and tell students to design a presentation that summarizes and raises questions about a reading. Tell students to comment on the strengths and weaknesses of the author’s argument. Students can post the links to their goreact presentations in a discussion forum or an assignment using the insert link feature in Canvas.
  • Digital Storytelling Activities. Telling digital stories allows students to use multimedia (images, audio, video) to present information. Digital stories can include 1) personal narratives, 2) stories that document events, and 3) stories that inform and instruct. Creating digital stories allows students to evaluate, reflect on, or analyze course content (Robin, 2006, Digital storytelling: A powerful technology tool for the 21st century classroom).
    • Example:  Use goreact, a narrated Powerpoint, or a Google Doc and instruct students to tell a story that informs readers and listeners about how the course content they are learning is useful in their professional lives. In the story, tell students to offer specific examples of readings and class activities that they are finding most relevant to their professional work. Links to the goreact presentation and Google doc can be submitted via a discussion forum or an assignment in Canvas. The Powerpoint file can be submitted via a discussion or submitted in an assignment.

Pulling it All Together

Critical thinking is an invaluable skill that students need to be successful in their professional and personal lives. Instructors can be thoughtful and purposeful about creating learning objectives that promote lower and higher-level critical thinking skills, and about using technology to implement activities that support these learning objectives. Below are some additional resources about critical thinking.

Additional Resources

Articles

Carmichael, E., & Farrell, H. (2012). Evaluation of the Effectiveness of Online Resources in Developing Student Critical Thinking: Review of Literature and Case Study of a Critical Thinking Online Site. Journal of University Teaching and Learning Practice9(1), 4.

Lai, E. R. (2011). Critical thinking: A literature review. Pearson’s Research Reports6, 40-41.

Landers, H (n.d.). Using Peer Teaching In The Classroom. Retrieved electronically from http://teaching.colostate.edu/tips/tip.cfm?tipid=180

Lynch, C. L., & Wolcott, S. K. (2001). Helping your students develop critical thinking skills (IDEA Paper# 37. In Manhattan, KS: The IDEA Center.

Mandernach, B. J. (2006). Thinking critically about critical thinking: Integrating online tools to Promote Critical Thinking. Insight: A collection of faculty scholarship, 1, 41-50.

Yang, Y. T. C., & Wu, W. C. I. (2012). Digital storytelling for enhancing student academic achievement, critical thinking, and learning motivation: A year-long experimental study. Computers & Education, 59(2), 339-352.

Websites

Insight Assessment: Measuring Thinking Worldwide

http://www.insightassessment.com/

Michigan State University’s Office of Faculty  & Organizational Development, Critical Thinking: http://fod.msu.edu/oir/critical-thinking

The Critical Thinking Community

http://www.criticalthinking.org/pages/defining-critical-thinking/766

 

 



0 comments

Leave a Reply

Your email address will not be published. Required fields are marked *