Changing the way you learn

Higher-Order Thinking, Problem Solving, and Critical Thinking

Assessing Higher Order Thinking Skills
1. Use tasks that require use of knowledge and skill in new or novel situations
2. Use novel material to assess higher order thinking
3. Context-Dependent Item Sets (-A.K.A. Interpretive Exercises)
  1. Introductory material followed by items
    1. Reading excerpts, pictures, graphs, drawings, paragraphs, poems, formulas, tables of numbers, lists of words or symbols, specimens, maps, films, sound recordings
  2. Advantages
    1. relatively close to the real-world contexts
    2. provides the same context for all students
    3. lessens the burden of memorizing
    4. may moderate the effects of prior experience
    5. only means to test certain intellectual abilities
  3. Disadvantages
    1. difficult to construct sets
    2. intro material must be carefully created
    3. performance on one item set may not generalize well
    4. the set often requires students to use additional abilities beyond the assessment task focus
    5. may need special facilities/equipment
  4. Layout
    1. poor arrangement may cause students to misread or misinterpret
    2. Use side heading and directions to point students to the introductory material & tasks
    3. center introductory material
    4. items below introductory material
    5. introductory material and items on the same page
  5. Ability to use Reference Materials
    1. Reference-using skills
      1. alphabetizing, using tables of contents and indexes, using encyclopedias, using dictionaries, using general reference materials (calendars, maps and globes, textbooks, periodical indexes, atlases, and so on), using library services, using the Internet and computer-based CDs
    2. Interpretive materials
      1. section of an index, a section of a table of contents, a part of an atlas, a picture of a computer screen
  6. Graphs and Tables
    1. comprehending the topic
    2. recognizing what is shown by each part
    3. reading amounts
    4. comparing two or more values
    5. interpreting relationships, trends, & main points
  7. Maps
    1. orienting maps, determining direction, locating and/or describing places on maps and globes, determining distances, tracing routes of travel, and interpreting time zones, landscapes, features
Concept Learning
1. What are concepts?
  1. concept is a class or category of similar things (objects, people, events, or relations)
  2. forms the basis for their higher-order learning
  3. instances, examples, or exemplars are individual members of the concept category
  4. concrete concept class
    1. has one or more common physical, tangible qualities that can be heard, seen, tasted, felt, or smelled
      1. IE: large, triangle, green, house, dog
  5. defined concept classdefined concept class
    1. can be defined in the same way by attributes that are not tangible
      1. often relationships among other concepts
      2. sometimes called abstract or relational concepts
      3. usually learned by definitions
      4. IE: diagonal,beside, friendliness, uncle, mother
2. Some concepts are learned initially as concrete concepts and later as defined concepts
3. Understanding isn't just showing examples. Understanding is showing how concepts are related to each other and linked together in complex ways through schemata or networks
  1. schema is the way knowledge is represented in our minds
    1. connected concepts, information, rules, problem-solving strategies, conditions for actions
4. Assessment Strategies
  1. Give the Name
    1. Over generalizations are not caught
  2. discriminating examples from nonexamples
    1. doesn't require concept name
    2. allows teacher control of assessment situation
    3. doesn't assess deeper understanding
  3. producing their own examples
    1. students to think up examples
      1. useful for assessing simple (not complex) concepts
  4. using the concept in performance assessment
    1. Demonstrates deeper understanding
    2. Complex assessment with concept application
      1. use the concept to solve problems; relate the concept to other concepts principles and generalizations; use the concept to learn new material
  5. Defined Concept Learning
    1. weaker strategies (may not be suitable for younger students)
      1. produce a definition
      2. produce new concept exemplars
    2. stronger strategies
      1. discriminate exemplars from nonexemplars
      2. identify components and demonstrate relationships
Assessing Rules & Principles Comprehension
1. Strategies for assessment
  1. produce or identify consequences
  2. produce consequences & explain why
  3. produce an explanation only
  4. draw a conclusion based on application of the principle
2. Difficult to interpret, so questions you have to answer about the students’ responses to evaluate them properly
  1. Are the students’ examples new, or were they presented in the class or in the assigned materials?
  2. Why can’t students give good examples?
  3. Do they understand the principle?
  4. Is there weak content specific knowledge being used to apply the principle?
Problem Solving
1. Nature of Problem Solving
  1. Requires use of higher-order "problem solving" processes
  2. “No-brainers” are NOT problem solving
2. Well Structured
  1. Most textbook questions/exercises
  2. Clearly laid out
  3. Give students opportunities to rehearse procedures or algorithms
  4. Not authentic/real life
3. Ill-Structured
  1. students organize the information
  2. More Authentic/real life
  3. students clarify the problem
  4. students obtain the information
  5. students recognize there may be multiple correct answers
4. General vs. Specific Problem Solving
  1. General
    1. Strategies apply across subject areas but in less powerful ways
    2. Used when operating outside of a comfort/expertise zone
  2. Specific
    1. Strategies apply strongly to specific content areas but not across subject areas
    2. Used by people who are more expert/comfortable with the subject
5. 10 step heuristic for Solving Problems
  1. see the whole picture, not just details
    1. withhold judgment; do not rush to a solution
      1. create a model of the problem
        pictures, sketches, diagrams, graphs, equations, or symbols
        try different models if the first doesn't help
        state the problem as a question
        try different questions if the first doesn't work
        think outside of the box
        work backward
        keep track of partial solutions
        use analogies to compare the problem to others
        talk around and through it in many ways until you find a solution
6. IDEAL problem solver
  1. Identify the problem
    1. Define & represent the problem
      1. Explore possible strategies
        Act on strategies
        Look back and evaluate the effects of your activities
Critical Thinking
1. Assessing critical thinking
  1. checklists can help keep track of students' uses of critical thinking skills
  2. Rating scales help record teacher judgment of the quality of critical thinking
2. Advanced clarification
  1. Interact with others
3. “ Critical thinking is a process, the goal of which is to make reasonable decisions about what to believe and what to do” ( Ennis, 1996 , p. xvii)
  1. Reasonable thinking
  2. Reflective thinking
  3. Focused thinking
  4. Deciding what to believe or do
  5. Abilities and dispositions
4. 5 areas of critical thinking abilities
  1. Elementary Clarification
    1. Basic Support
      1. InferenceInference
        Advanced clarification
        Strategies & tactics
        Decide on an action
        Interact with others
        Define terms & judge definitions
        Identify assumptions
        Make & evaluate
        deductions
        inductions
        judgments
      2. Judge the credibility of a source
      3. Make & judge observations
    2. Focus on a question
    3. Analyze arguments
    4. Ask & answer questions that clarify and challenge
Reading Skills
1. Traditional procedure
  1. Read-->answer questions
  2. Locate possible passages
    1. Write initial test items
      1. Rewrite the passage to focus on targets
        Consider rewriting some of the items
        Repeat rewriting as necessary
2. Authentic reading assessment
  1. Reading comprehension is focus
  2. Longer passages from primary sources
  3. Can be combined with writing & experimenting etc.
3. MAZE item type
  1. Embed multiple-choice questions to check for comprehension
    1. Design so students need to read and understand the passage
    2. Information required for a correct answer should all be in the passage
    3. All of the items’ options should be common words

Next up

Higher-Order Thinking, Problem Solving, and Critical Thinking

Description

Resource summary

Similar

	Created by John Marttila almost 10 years ago