critical thinking dispositions

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Front Psychol

How Do Critical Thinking Ability and Critical Thinking Disposition Relate to the Mental Health of University Students?

Associated data.

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Theories of psychotherapy suggest that human mental problems associate with deficiencies in critical thinking. However, it currently remains unclear whether both critical thinking skill and critical thinking disposition relate to individual differences in mental health. This study explored whether and how the critical thinking ability and critical thinking disposition of university students associate with individual differences in mental health in considering impulsivity that has been revealed to be closely related to both critical thinking and mental health. Regression and structural equation modeling analyses based on a Chinese university student sample ( N = 314, 198 females, M age = 18.65) revealed that critical thinking skill and disposition explained a unique variance of mental health after controlling for impulsivity. Furthermore, the relationship between critical thinking and mental health was mediated by motor impulsivity (acting on the spur of the moment) and non-planning impulsivity (making decisions without careful forethought). These findings provide a preliminary account of how human critical thinking associate with mental health. Practically, developing mental health promotion programs for university students is suggested to pay special attention to cultivating their critical thinking dispositions and enhancing their control over impulsive behavior.

Introduction

Although there is no consistent definition of critical thinking (CT), it is usually described as “purposeful, self-regulatory judgment that results in interpretation, analysis, evaluation, and inference, as well as explanations of the evidential, conceptual, methodological, criteriological, or contextual considerations that judgment is based upon” (Facione, 1990 , p. 2). This suggests that CT is a combination of skills and dispositions. The skill aspect mainly refers to higher-order cognitive skills such as inference, analysis, and evaluation, while the disposition aspect represents one's consistent motivation and willingness to use CT skills (Dwyer, 2017 ). An increasing number of studies have indicated that CT plays crucial roles in the activities of university students such as their academic performance (e.g., Ghanizadeh, 2017 ; Ren et al., 2020 ), professional work (e.g., Barry et al., 2020 ), and even the ability to cope with life events (e.g., Butler et al., 2017 ). An area that has received less attention is how critical thinking relates to impulsivity and mental health. This study aimed to clarify the relationship between CT (which included both CT skill and CT disposition), impulsivity, and mental health among university students.

Relationship Between Critical Thinking and Mental Health

Associating critical thinking with mental health is not without reason, since theories of psychotherapy have long stressed a linkage between mental problems and dysfunctional thinking (Gilbert, 2003 ; Gambrill, 2005 ; Cuijpers, 2019 ). Proponents of cognitive behavioral therapy suggest that the interpretation by people of a situation affects their emotional, behavioral, and physiological reactions. Those with mental problems are inclined to bias or heuristic thinking and are more likely to misinterpret neutral or even positive situations (Hollon and Beck, 2013 ). Therefore, a main goal of cognitive behavioral therapy is to overcome biased thinking and change maladaptive beliefs via cognitive modification skills such as objective understanding of one's cognitive distortions, analyzing evidence for and against one's automatic thinking, or testing the effect of an alternative way of thinking. Achieving these therapeutic goals requires the involvement of critical thinking, such as the willingness and ability to critically analyze one's thoughts and evaluate evidence and arguments independently of one's prior beliefs. In addition to theoretical underpinnings, characteristics of university students also suggest a relationship between CT and mental health. University students are a risky population in terms of mental health. They face many normative transitions (e.g., social and romantic relationships, important exams, financial pressures), which are stressful (Duffy et al., 2019 ). In particular, the risk increases when students experience academic failure (Lee et al., 2008 ; Mamun et al., 2021 ). Hong et al. ( 2010 ) found that the stress in Chinese college students was primarily related to academic, personal, and negative life events. However, university students are also a population with many resources to work on. Critical thinking can be considered one of the important resources that students are able to use (Stupple et al., 2017 ). Both CT skills and CT disposition are valuable qualities for college students to possess (Facione, 1990 ). There is evidence showing that students with a higher level of CT are more successful in terms of academic performance (Ghanizadeh, 2017 ; Ren et al., 2020 ), and that they are better at coping with stressful events (Butler et al., 2017 ). This suggests that that students with higher CT are less likely to suffer from mental problems.

Empirical research has reported an association between CT and mental health among college students (Suliman and Halabi, 2007 ; Kargar et al., 2013 ; Yoshinori and Marcus, 2013 ; Chen and Hwang, 2020 ; Ugwuozor et al., 2021 ). Most of these studies focused on the relationship between CT disposition and mental health. For example, Suliman and Halabi ( 2007 ) reported that the CT disposition of nursing students was positively correlated with their self-esteem, but was negatively correlated with their state anxiety. There is also a research study demonstrating that CT disposition influenced the intensity of worry in college students either by increasing their responsibility to continue thinking or by enhancing the detached awareness of negative thoughts (Yoshinori and Marcus, 2013 ). Regarding the relationship between CT ability and mental health, although there has been no direct evidence, there were educational programs examining the effect of teaching CT skills on the mental health of adolescents (Kargar et al., 2013 ). The results showed that teaching CT skills decreased somatic symptoms, anxiety, depression, and insomnia in adolescents. Another recent CT skill intervention also found a significant reduction in mental stress among university students, suggesting an association between CT skills and mental health (Ugwuozor et al., 2021 ).

The above research provides preliminary evidence in favor of the relationship between CT and mental health, in line with theories of CT and psychotherapy. However, previous studies have focused solely on the disposition aspect of CT, and its link with mental health. The ability aspect of CT has been largely overlooked in examining its relationship with mental health. Moreover, although the link between CT and mental health has been reported, it remains unknown how CT (including skill and disposition) is associated with mental health.

Impulsivity as a Potential Mediator Between Critical Thinking and Mental Health

One important factor suggested by previous research in accounting for the relationship between CT and mental health is impulsivity. Impulsivity is recognized as a pattern of action without regard to consequences. Patton et al. ( 1995 ) proposed that impulsivity is a multi-faceted construct that consists of three behavioral factors, namely, non-planning impulsiveness, referring to making a decision without careful forethought; motor impulsiveness, referring to acting on the spur of the moment; and attentional impulsiveness, referring to one's inability to focus on the task at hand. Impulsivity is prominent in clinical problems associated with psychiatric disorders (Fortgang et al., 2016 ). A number of mental problems are associated with increased impulsivity that is likely to aggravate clinical illnesses (Leclair et al., 2020 ). Moreover, a lack of CT is correlated with poor impulse control (Franco et al., 2017 ). Applications of CT may reduce impulsive behaviors caused by heuristic and biased thinking when one makes a decision (West et al., 2008 ). For example, Gregory ( 1991 ) suggested that CT skills enhance the ability of children to anticipate the health or safety consequences of a decision. Given this, those with high levels of CT are expected to take a rigorous attitude about the consequences of actions and are less likely to engage in impulsive behaviors, which may place them at a low risk of suffering mental problems. To the knowledge of the authors, no study has empirically tested whether impulsivity accounts for the relationship between CT and mental health.

This study examined whether CT skill and disposition are related to the mental health of university students; and if yes, how the relationship works. First, we examined the simultaneous effects of CT ability and CT disposition on mental health. Second, we further tested whether impulsivity mediated the effects of CT on mental health. To achieve the goals, we collected data on CT ability, CT disposition, mental health, and impulsivity from a sample of university students. The results are expected to shed light on the mechanism of the association between CT and mental health.

Participants and Procedure

A total of 314 university students (116 men) with an average age of 18.65 years ( SD = 0.67) participated in this study. They were recruited by advertisements from a local university in central China and majoring in statistics and mathematical finance. The study protocol was approved by the Human Subjects Review Committee of the Huazhong University of Science and Technology. Each participant signed a written informed consent describing the study purpose, procedure, and right of free. All the measures were administered in a computer room. The participants were tested in groups of 20–30 by two research assistants. The researchers and research assistants had no formal connections with the participants. The testing included two sections with an interval of 10 min, so that the participants had an opportunity to take a break. In the first section, the participants completed the syllogistic reasoning problems with belief bias (SRPBB), the Chinese version of the California Critical Thinking Skills Test (CCSTS-CV), and the Chinese Critical Thinking Disposition Inventory (CCTDI), respectively. In the second session, they completed the Barrett Impulsivity Scale (BIS-11), Depression Anxiety Stress Scale-21 (DASS-21), and University Personality Inventory (UPI) in the given order.

Measures of Critical Thinking Ability

The Chinese version of the California Critical Thinking Skills Test was employed to measure CT skills (Lin, 2018 ). The CCTST is currently the most cited tool for measuring CT skills and includes analysis, assessment, deduction, inductive reasoning, and inference reasoning. The Chinese version included 34 multiple choice items. The dependent variable was the number of correctly answered items. The internal consistency (Cronbach's α) of the CCTST is 0.56 (Jacobs, 1995 ). The test–retest reliability of CCTST-CV is 0.63 ( p < 0.01) (Luo and Yang, 2002 ), and correlations between scores of the subscales and the total score are larger than 0.5 (Lin, 2018 ), supporting the construct validity of the scale. In this study among the university students, the internal consistency (Cronbach's α) of the CCTST-CV was 0.5.

The second critical thinking test employed in this study was adapted from the belief bias paradigm (Li et al., 2021 ). This task paradigm measures the ability to evaluate evidence and arguments independently of one's prior beliefs (West et al., 2008 ), which is a strongly emphasized skill in CT literature. The current test included 20 syllogistic reasoning problems in which the logical conclusion was inconsistent with one's prior knowledge (e.g., “Premise 1: All fruits are sweet. Premise 2: Bananas are not sweet. Conclusion: Bananas are not fruits.” valid conclusion). In addition, four non-conflict items were included as the neutral condition in order to avoid a habitual response from the participants. They were instructed to suppose that all the premises are true and to decide whether the conclusion logically follows from the given premises. The measure showed good internal consistency (Cronbach's α = 0.83) in a Chinese sample (Li et al., 2021 ). In this study, the internal consistency (Cronbach's α) of the SRPBB was 0.94.

Measures of Critical Thinking Disposition

The Chinese Critical Thinking Disposition Inventory was employed to measure CT disposition (Peng et al., 2004 ). This scale has been developed in line with the conceptual framework of the California critical thinking disposition inventory. We measured five CT dispositions: truth-seeking (one's objectivity with findings even if this requires changing one's preconceived opinions, e.g., a person inclined toward being truth-seeking might disagree with “I believe what I want to believe.”), inquisitiveness (one's intellectual curiosity. e.g., “No matter what the topic, I am eager to know more about it”), analyticity (the tendency to use reasoning and evidence to solve problems, e.g., “It bothers me when people rely on weak arguments to defend good ideas”), systematically (the disposition of being organized and orderly in inquiry, e.g., “I always focus on the question before I attempt to answer it”), and CT self-confidence (the trust one places in one's own reasoning processes, e.g., “I appreciate my ability to think precisely”). Each disposition aspect contained 10 items, which the participants rated on a 6-point Likert-type scale. This measure has shown high internal consistency (overall Cronbach's α = 0.9) (Peng et al., 2004 ). In this study, the CCTDI scale was assessed at Cronbach's α = 0.89, indicating good reliability.

Measure of Impulsivity

The well-known Barrett Impulsivity Scale (Patton et al., 1995 ) was employed to assess three facets of impulsivity: non-planning impulsivity (e.g., “I plan tasks carefully”); motor impulsivity (e.g., “I act on the spur of the moment”); attentional impulsivity (e.g., “I concentrate easily”). The scale includes 30 statements, and each statement is rated on a 5-point scale. The subscales of non-planning impulsivity and attentional impulsivity were reversely scored. The BIS-11 has good internal consistency (Cronbach's α = 0.81, Velotti et al., 2016 ). This study showed that the Cronbach's α of the BIS-11 was 0.83.

Measures of Mental Health

The Depression Anxiety Stress Scale-21 was used to assess mental health problems such as depression (e.g., “I feel that life is meaningless”), anxiety (e.g., “I find myself getting agitated”), and stress (e.g., “I find it difficult to relax”). Each dimension included seven items, which the participants were asked to rate on a 4-point scale. The Chinese version of the DASS-21 has displayed a satisfactory factor structure and internal consistency (Cronbach's α = 0.92, Wang et al., 2016 ). In this study, the internal consistency (Cronbach's α) of the DASS-21 was 0.94.

The University Personality Inventory that has been commonly used to screen for mental problems of college students (Yoshida et al., 1998 ) was also used for measuring mental health. The 56 symptom-items assessed whether an individual has experienced the described symptom during the past year (e.g., “a lack of interest in anything”). The UPI showed good internal consistency (Cronbach's α = 0.92) in a Chinese sample (Zhang et al., 2015 ). This study showed that the Cronbach's α of the UPI was 0.85.

Statistical Analyses

We first performed analyses to detect outliers. Any observation exceeding three standard deviations from the means was replaced with a value that was three standard deviations. This procedure affected no more than 5‰ of observations. Hierarchical regression analysis was conducted to determine the extent to which facets of critical thinking were related to mental health. In addition, structural equation modeling with Amos 22.0 was performed to assess the latent relationship between CT, impulsivity, and mental health.

Descriptive Statistics and Bivariate Correlations

Table 1 presents descriptive statistics and bivariate correlations of all the variables. CT disposition such as truth-seeking, systematicity, self-confidence, and inquisitiveness was significantly correlated with DASS-21 and UPI, but neither CCTST-CV nor SRPBB was related to DASS-21 and UPI. Subscales of BIS-11 were positively correlated with DASS-21 and UPI, but were negatively associated with CT dispositions.

Descriptive results and correlations between all measured variables ( N = 314).

Regression Analyses

Hierarchical regression analyses were conducted to examine the effects of CT skill and disposition on mental health. Before conducting the analyses, scores in DASS-21 and UPI were reversed so that high scores reflected high levels of mental health. Table 2 presents the results of hierarchical regression. In model 1, the sum of the Z-score of DASS-21 and UPI served as the dependent variable. Scores in the CT ability tests and scores in the five dimensions of CCTDI served as predictors. CT skill and disposition explained 13% of the variance in mental health. CT skills did not significantly predict mental health. Two dimensions of dispositions (truth seeking and systematicity) exerted significantly positive effects on mental health. Model 2 examined whether CT predicted mental health after controlling for impulsivity. The model containing only impulsivity scores (see model-2 step 1 in Table 2 ) explained 15% of the variance in mental health. Non-planning impulsivity and motor impulsivity showed significantly negative effects on mental health. The CT variables on the second step explained a significantly unique variance (6%) of CT (see model-2 step 2). This suggests that CT skill and disposition together explained the unique variance in mental health after controlling for impulsivity. 1

Hierarchical regression models predicting mental health from critical thinking skills, critical thinking dispositions, and impulsivity ( N = 314).

CCTST-CV, The Chinese version of the California Critical Thinking Skills Test; SRPBB, Syllogistic Reasoning Problems with Belief Bias .

Structural equation modeling was performed to examine whether impulsivity mediated the relationship between CT disposition (CT ability was not included since it did not significantly predict mental health) and mental health. Since the regression results showed that only motor impulsivity and non-planning impulsivity significantly predicted mental health, we examined two mediation models with either motor impulsivity or non-planning impulsivity as the hypothesized mediator. The item scores in the motor impulsivity subscale were randomly divided into two indicators of motor impulsivity, as were the scores in the non-planning subscale. Scores of DASS-21 and UPI served as indicators of mental health and dimensions of CCTDI as indicators of CT disposition. In addition, a bootstrapping procedure with 5,000 resamples was established to test for direct and indirect effects. Amos 22.0 was used for the above analyses.

The mediation model that included motor impulsivity (see Figure 1 ) showed an acceptable fit, χ ( 23 ) 2 = 64.71, RMSEA = 0.076, CFI = 0.96, GFI = 0.96, NNFI = 0.93, SRMR = 0.073. Mediation analyses indicated that the 95% boot confidence intervals of the indirect effect and the direct effect were (0.07, 0.26) and (−0.08, 0.32), respectively. As Hayes ( 2009 ) indicates, an effect is significant if zero is not between the lower and upper bounds in the 95% confidence interval. Accordingly, the indirect effect between CT disposition and mental health was significant, while the direct effect was not significant. Thus, motor impulsivity completely mediated the relationship between CT disposition and mental health.

Illustration of the mediation model: Motor impulsivity as mediator variable between critical thinking dispositions and mental health. CTD-l = Truth seeking; CTD-2 = Analyticity; CTD-3 = Systematically; CTD-4 = Self-confidence; CTD-5 = Inquisitiveness. MI-I and MI-2 were sub-scores of motor impulsivity. Solid line represents significant links and dotted line non-significant links. ** p < 0.01.

The mediation model, which included non-planning impulsivity (see Figure 2 ), also showed an acceptable fit to the data, χ ( 23 ) 2 = 52.75, RMSEA = 0.064, CFI = 0.97, GFI = 0.97, NNFI = 0.95, SRMR = 0.06. The 95% boot confidence intervals of the indirect effect and the direct effect were (0.05, 0.33) and (−0.04, 0.38), respectively, indicating that non-planning impulsivity completely mediated the relationship between CT disposition and mental health.

Illustration of the mediation model: Non-planning impulsivity asmediator variable between critical thinking dispositions and mental health. CTD-l = Truth seeking; CTD-2 = Analyticity; CTD-3 = Systematically; CTD-4 = Self-confidence; CTD-5 = Inquisitiveness. NI-I and NI-2 were sub-scores of Non-planning impulsivity. Solid line represents significant links and dotted line non-significant links. ** p < 0.01.

This study examined how critical thinking skill and disposition are related to mental health. Theories of psychotherapy suggest that human mental problems are in part due to a lack of CT. However, empirical evidence for the hypothesized relationship between CT and mental health is relatively scarce. This study explored whether and how CT ability and disposition are associated with mental health. The results, based on a university student sample, indicated that CT skill and disposition explained a unique variance in mental health. Furthermore, the effect of CT disposition on mental health was mediated by motor impulsivity and non-planning impulsivity. The finding that CT exerted a significant effect on mental health was in accordance with previous studies reporting negative correlations between CT disposition and mental disorders such as anxiety (Suliman and Halabi, 2007 ). One reason lies in the assumption that CT disposition is usually referred to as personality traits or habits of mind that are a remarkable predictor of mental health (e.g., Benzi et al., 2019 ). This study further found that of the five CT dispositions, only truth-seeking and systematicity were associated with individual differences in mental health. This was not surprising, since the truth-seeking items mainly assess one's inclination to crave for the best knowledge in a given context and to reflect more about additional facts, reasons, or opinions, even if this requires changing one's mind about certain issues. The systematicity items target one's disposition to approach problems in an orderly and focused way. Individuals with high levels of truth-seeking and systematicity are more likely to adopt a comprehensive, reflective, and controlled way of thinking, which is what cognitive therapy aims to achieve by shifting from an automatic mode of processing to a more reflective and controlled mode.

Another important finding was that motor impulsivity and non-planning impulsivity mediated the effect of CT disposition on mental health. The reason may be that people lacking CT have less willingness to enter into a systematically analyzing process or deliberative decision-making process, resulting in more frequently rash behaviors or unplanned actions without regard for consequences (Billieux et al., 2010 ; Franco et al., 2017 ). Such responses can potentially have tangible negative consequences (e.g., conflict, aggression, addiction) that may lead to social maladjustment that is regarded as a symptom of mental illness. On the contrary, critical thinkers have a sense of deliberativeness and consider alternate consequences before acting, and this thinking-before-acting mode would logically lead to a decrease in impulsivity, which then decreases the likelihood of problematic behaviors and negative moods.

It should be noted that although the raw correlation between attentional impulsivity and mental health was significant, regression analyses with the three dimensions of impulsivity as predictors showed that attentional impulsivity no longer exerted a significant effect on mental effect after controlling for the other impulsivity dimensions. The insignificance of this effect suggests that the significant raw correlation between attentional impulsivity and mental health was due to the variance it shared with the other impulsivity dimensions (especially with the non-planning dimension, which showed a moderately high correlation with attentional impulsivity, r = 0.67).

Some limitations of this study need to be mentioned. First, the sample involved in this study is considered as a limited sample pool, since all the participants are university students enrolled in statistics and mathematical finance, limiting the generalization of the findings. Future studies are recommended to recruit a more representative sample of university students. A study on generalization to a clinical sample is also recommended. Second, as this study was cross-sectional in nature, caution must be taken in interpreting the findings as causal. Further studies using longitudinal, controlled designs are needed to assess the effectiveness of CT intervention on mental health.

In spite of the limitations mentioned above, the findings of this study have some implications for research and practice intervention. The result that CT contributed to individual differences in mental health provides empirical support for the theory of cognitive behavioral therapy, which focuses on changing irrational thoughts. The mediating role of impulsivity between CT and mental health gives a preliminary account of the mechanism of how CT is associated with mental health. Practically, although there is evidence that CT disposition of students improves because of teaching or training interventions (e.g., Profetto-Mcgrath, 2005 ; Sanja and Krstivoje, 2015 ; Chan, 2019 ), the results showing that two CT disposition dimensions, namely, truth-seeking and systematicity, are related to mental health further suggest that special attention should be paid to cultivating these specific CT dispositions so as to enhance the control of students over impulsive behaviors in their mental health promotions.

Conclusions

This study revealed that two CT dispositions, truth-seeking and systematicity, were associated with individual differences in mental health. Furthermore, the relationship between critical thinking and mental health was mediated by motor impulsivity and non-planning impulsivity. These findings provide a preliminary account of how human critical thinking is associated with mental health. Practically, developing mental health promotion programs for university students is suggested to pay special attention to cultivating their critical thinking dispositions (especially truth-seeking and systematicity) and enhancing the control of individuals over impulsive behaviors.

Data Availability Statement

Ethics statement.

The studies involving human participants were reviewed and approved by HUST Critical Thinking Research Center (Grant No. 2018CT012). The patients/participants provided their written informed consent to participate in this study.

Author Contributions

XR designed the study and revised the manuscript. ZL collected data and wrote the manuscript. SL assisted in analyzing the data. SS assisted in re-drafting and editing the manuscript. All the authors contributed to the article and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

1 We re-analyzed the data by controlling for age and gender of the participants in the regression analyses. The results were virtually the same as those reported in the study.

Funding. This work was supported by the Social Science Foundation of China (grant number: BBA200034).

• Barry A., Parvan K., Sarbakhsh P., Safa B., Allahbakhshian A. (2020). Critical thinking in nursing students and its relationship with professional self-concept and relevant factors . Res. Dev. Med. Educ. 9 , 7–7. 10.34172/rdme.2020.007 [ CrossRef ] [ Google Scholar ]
• Benzi I. M. A., Emanuele P., Rossella D. P., Clarkin J. F., Fabio M. (2019). Maladaptive personality traits and psychological distress in adolescence: the moderating role of personality functioning . Pers. Indiv. Diff. 140 , 33–40. 10.1016/j.paid.2018.06.026 [ CrossRef ] [ Google Scholar ]
• Billieux J., Gay P., Rochat L., Van der Linden M. (2010). The role of urgency and its underlying psychological mechanisms in problematic behaviours . Behav. Res. Ther. 48 , 1085–1096. 10.1016/j.brat.2010.07.008 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Butler H. A., Pentoney C., Bong M. P. (2017). Predicting real-world outcomes: Critical thinking ability is a better predictor of life decisions than intelligence . Think. Skills Creat. 25 , 38–46. 10.1016/j.tsc.2017.06.005 [ CrossRef ] [ Google Scholar ]
• Chan C. (2019). Using digital storytelling to facilitate critical thinking disposition in youth civic engagement: a randomized control trial . Child. Youth Serv. Rev. 107 :104522. 10.1016/j.childyouth.2019.104522 [ CrossRef ] [ Google Scholar ]
• Chen M. R. A., Hwang G. J. (2020). Effects of a concept mapping-based flipped learning approach on EFL students' English speaking performance, critical thinking awareness and speaking anxiety . Br. J. Educ. Technol. 51 , 817–834. 10.1111/bjet.12887 [ CrossRef ] [ Google Scholar ]
• Cuijpers P. (2019). Targets and outcomes of psychotherapies for mental disorders: anoverview . World Psychiatry. 18 , 276–285. 10.1002/wps.20661 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Duffy M. E., Twenge J. M., Joiner T. E. (2019). Trends in mood and anxiety symptoms and suicide-related outcomes among u.s. undergraduates, 2007–2018: evidence from two national surveys . J. Adolesc. Health. 65 , 590–598. 10.1016/j.jadohealth.2019.04.033 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Dwyer C. P. (2017). Critical Thinking: Conceptual Perspectives and Practical Guidelines . Cambridge: Cambridge University Press. [ Google Scholar ]
• Facione P. A. (1990). Critical Thinking: Astatement of Expert Consensus for Purposes of Educational Assessment and Instruction . Millibrae, CA: The California Academic Press. [ Google Scholar ]
• Fortgang R. G., Hultman C. M., van Erp T. G. M., Cannon T. D. (2016). Multidimensional assessment of impulsivity in schizophrenia, bipolar disorder, and major depressive disorder: testing for shared endophenotypes . Psychol. Med. 46 , 1497–1507. 10.1017/S0033291716000131 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Franco A. R., Costa P. S., Butler H. A., Almeida L. S. (2017). Assessment of undergraduates' real-world outcomes of critical thinking in everyday situations . Psychol. Rep. 120 , 707–720. 10.1177/0033294117701906 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Gambrill E. (2005). Critical thinking, evidence-based practice, and mental health, in Mental Disorders in the Social Environment: Critical Perspectives , ed Kirk S. A. (New York, NY: Columbia University Press; ), 247–269. [ Google Scholar ]
• Ghanizadeh A. (2017). The interplay between reflective thinking, critical thinking, self-monitoring, and academic achievement in higher education . Higher Educ. 74 . 101–114. 10.1007/s10734-016-0031-y [ CrossRef ] [ Google Scholar ]
• Gilbert T. (2003). Some reflections on critical thinking and mental health . Teach. Phil. 24 , 333–339. 10.5840/teachphil200326446 [ CrossRef ] [ Google Scholar ]
• Gregory R. (1991). Critical thinking for environmental health risk education . Health Educ. Q. 18 , 273–284. 10.1177/109019819101800302 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Hayes A. F. (2009). Beyond Baron and Kenny: Statistical mediation analysis in the newmillennium . Commun. Monogr. 76 , 408–420. 10.1080/03637750903310360 [ CrossRef ] [ Google Scholar ]
• Hollon S. D., Beck A. T. (2013). Cognitive and cognitive-behavioral therapies, in Bergin and Garfield's Handbook of Psychotherapy and Behavior Change, Vol. 6 . ed Lambert M. J. (Hoboken, NJ: Wiley; ), 393–442. [ Google Scholar ]
• Hong L., Lin C. D., Bray M. A., Kehle T. J. (2010). The measurement of stressful events in chinese college students . Psychol. Sch. 42 , 315–323. 10.1002/pits.20082 [ CrossRef ] [ Google Scholar ]
• Jacobs S. S. (1995). Technical characteristics and some correlates of the california critical thinking skills test, forms a and b . Res. Higher Educ. 36 , 89–108. [ Google Scholar ]
• Kargar F. R., Ajilchi B., Goreyshi M. K., Noohi S. (2013). Effect of creative and critical thinking skills teaching on identity styles and general health in adolescents . Proc. Soc. Behav. Sci. 84 , 464–469. 10.1016/j.sbspro.2013.06.585 [ CrossRef ] [ Google Scholar ]
• Leclair M. C., Lemieux A. J., Roy L., Martin M. S., Latimer E. A., Crocker A. G. (2020). Pathways to recovery among homeless people with mental illness: Is impulsiveness getting in the way? Can. J. Psychiatry. 65 , 473–483. 10.1177/0706743719885477 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Lee H. S., Kim S., Choi I., Lee K. U. (2008). Prevalence and risk factors associated with suicide ideation and attempts in korean college students . Psychiatry Investig. 5 , 86–93. 10.4306/pi.2008.5.2.86 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Li S., Ren X., Schweizer K., Brinthaupt T. M., Wang T. (2021). Executive functions as predictors of critical thinking: behavioral and neural evidence . Learn. Instruct. 71 :101376. 10.1016/j.learninstruc.2020.101376 [ CrossRef ] [ Google Scholar ]
• Lin Y. (2018). Developing Critical Thinking in EFL Classes: An Infusion Approach . Singapore: Springer Publications. [ Google Scholar ]
• Luo Q. X., Yang X. H. (2002). Revising on Chinese version of California critical thinkingskillstest . Psychol. Sci. (Chinese). 25 , 740–741. [ Google Scholar ]
• Mamun M. A., Misti J. M., Hosen I., Mamun F. A. (2021). Suicidal behaviors and university entrance test-related factors: a bangladeshi exploratory study . Persp. Psychiatric Care. 4 , 1–10. 10.1111/ppc.12783 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Patton J. H., Stanford M. S., Barratt E. S. (1995). Factor structure of the Barratt impulsiveness scale . J Clin. Psychol. 51 , 768–774. 10.1002/1097-4679(199511)5 1 :63.0.CO;2-1 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Peng M. C., Wang G. C., Chen J. L., Chen M. H., Bai H. H., Li S. G., et al.. (2004). Validity and reliability of the Chinese critical thinking disposition inventory . J. Nurs. China (Zhong Hua Hu Li Za Zhi). 39 , 644–647. [ Google Scholar ]
• Profetto-Mcgrath J. (2005). Critical thinking and evidence-based practice . J. Prof. Nurs. 21 , 364–371. 10.1016/j.profnurs.2005.10.002 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ren X., Tong Y., Peng P., Wang T. (2020). Critical thinking predicts academic performance beyond general cognitive ability: evidence from adults and children . Intelligence 82 :101487. 10.1016/j.intell.2020.101487 [ CrossRef ] [ Google Scholar ]
• Sanja M., Krstivoje S. (2015). Developing critical thinking in elementary mathematics education through a suitable selection of content and overall student performance . Proc. Soc. Behav. Sci. 180 , 653–659. 10.1016/j.sbspro.2015.02.174 [ CrossRef ] [ Google Scholar ]
• Stupple E., Maratos F. A., Elander J., Hunt T. E., Aubeeluck A. V. (2017). Development of the critical thinking toolkit (critt): a measure of student attitudes and beliefs about critical thinking . Think. Skills Creat. 23 , 91–100. 10.1016/j.tsc.2016.11.007 [ CrossRef ] [ Google Scholar ]
• Suliman W. A., Halabi J. (2007). Critical thinking, self-esteem, and state anxiety of nursing students . Nurse Educ. Today. 27 , 162–168. 10.1016/j.nedt.2006.04.008 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Ugwuozor F. O., Otu M. S., Mbaji I. N. (2021). Critical thinking intervention for stress reduction among undergraduates in the Nigerian Universities . Medicine 100 :25030. 10.1097/MD.0000000000025030 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Velotti P., Garofalo C., Petrocchi C., Cavallo F., Popolo R., Dimaggio G. (2016). Alexithymia, emotion dysregulation, impulsivity and aggression: a multiple mediation model . Psychiatry Res. 237 , 296–303. 10.1016/j.psychres.2016.01.025 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Wang K., Shi H. S., Geng F. L., Zou L. Q., Tan S. P., Wang Y., et al.. (2016). Cross-cultural validation of the depression anxiety stress scale−21 in China . Psychol. Assess. 28 :e88. 10.1037/pas0000207 [ PubMed ] [ CrossRef ] [ Google Scholar ]
• West R. F., Toplak M. E., Stanovich K. E. (2008). Heuristics and biases as measures of critical thinking: associations with cognitive ability and thinking dispositions . J. Educ. Psychol. 100 , 930–941. 10.1037/a0012842 [ CrossRef ] [ Google Scholar ]
• Yoshida T., Ichikawa T., Ishikawa T., Hori M. (1998). Mental health of visually and hearing impaired students from the viewpoint of the University Personality Inventory . Psychiatry Clin. Neurosci. 52 , 413–418. [ PubMed ] [ Google Scholar ]
• Yoshinori S., Marcus G. (2013). The dual effects of critical thinking disposition on worry. PLoS ONE 8 :e79714. 10.1371/journal.pone.007971 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Zhang J., Lanza S., Zhang M., Su B. (2015). Structure of the University personality inventory for chinese college students . Psychol. Rep. 116 , 821–839. 10.2466/08.02.PR0.116k26w3 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]

A Crash Course in Critical Thinking

What you need to know—and read—about one of the essential skills needed today..

Posted April 8, 2024 | Reviewed by Michelle Quirk

• In research for "A More Beautiful Question," I did a deep dive into the current crisis in critical thinking.
• Many people may think of themselves as critical thinkers, but they actually are not.
• Here is a series of questions you can ask yourself to try to ensure that you are thinking critically.

Conspiracy theories. Inability to distinguish facts from falsehoods. Widespread confusion about who and what to believe.

These are some of the hallmarks of the current crisis in critical thinking—which just might be the issue of our times. Because if people aren’t willing or able to think critically as they choose potential leaders, they’re apt to choose bad ones. And if they can’t judge whether the information they’re receiving is sound, they may follow faulty advice while ignoring recommendations that are science-based and solid (and perhaps life-saving).

Moreover, as a society, if we can’t think critically about the many serious challenges we face, it becomes more difficult to agree on what those challenges are—much less solve them.

On a personal level, critical thinking can enable you to make better everyday decisions. It can help you make sense of an increasingly complex and confusing world.

In the new expanded edition of my book A More Beautiful Question ( AMBQ ), I took a deep dive into critical thinking. Here are a few key things I learned.

First off, before you can get better at critical thinking, you should understand what it is. It’s not just about being a skeptic. When thinking critically, we are thoughtfully reasoning, evaluating, and making decisions based on evidence and logic. And—perhaps most important—while doing this, a critical thinker always strives to be open-minded and fair-minded . That’s not easy: It demands that you constantly question your assumptions and biases and that you always remain open to considering opposing views.

In today’s polarized environment, many people think of themselves as critical thinkers simply because they ask skeptical questions—often directed at, say, certain government policies or ideas espoused by those on the “other side” of the political divide. The problem is, they may not be asking these questions with an open mind or a willingness to fairly consider opposing views.

When people do this, they’re engaging in “weak-sense critical thinking”—a term popularized by the late Richard Paul, a co-founder of The Foundation for Critical Thinking . “Weak-sense critical thinking” means applying the tools and practices of critical thinking—questioning, investigating, evaluating—but with the sole purpose of confirming one’s own bias or serving an agenda.

In AMBQ , I lay out a series of questions you can ask yourself to try to ensure that you’re thinking critically. Here are some of the questions to consider:

• Why do I believe what I believe?
• Are my views based on evidence?
• Have I fairly and thoughtfully considered differing viewpoints?
• Am I truly open to changing my mind?

Of course, becoming a better critical thinker is not as simple as just asking yourself a few questions. Critical thinking is a habit of mind that must be developed and strengthened over time. In effect, you must train yourself to think in a manner that is more effortful, aware, grounded, and balanced.

For those interested in giving themselves a crash course in critical thinking—something I did myself, as I was working on my book—I thought it might be helpful to share a list of some of the books that have shaped my own thinking on this subject. As a self-interested author, I naturally would suggest that you start with the new 10th-anniversary edition of A More Beautiful Question , but beyond that, here are the top eight critical-thinking books I’d recommend.

The Demon-Haunted World: Science as a Candle in the Dark , by Carl Sagan

This book simply must top the list, because the late scientist and author Carl Sagan continues to be such a bright shining light in the critical thinking universe. Chapter 12 includes the details on Sagan’s famous “baloney detection kit,” a collection of lessons and tips on how to deal with bogus arguments and logical fallacies.

Clear Thinking: Turning Ordinary Moments Into Extraordinary Results , by Shane Parrish

The creator of the Farnham Street website and host of the “Knowledge Project” podcast explains how to contend with biases and unconscious reactions so you can make better everyday decisions. It contains insights from many of the brilliant thinkers Shane has studied.

Good Thinking: Why Flawed Logic Puts Us All at Risk and How Critical Thinking Can Save the World , by David Robert Grimes

A brilliant, comprehensive 2021 book on critical thinking that, to my mind, hasn’t received nearly enough attention . The scientist Grimes dissects bad thinking, shows why it persists, and offers the tools to defeat it.

Think Again: The Power of Knowing What You Don't Know , by Adam Grant

Intellectual humility—being willing to admit that you might be wrong—is what this book is primarily about. But Adam, the renowned Wharton psychology professor and bestselling author, takes the reader on a mind-opening journey with colorful stories and characters.

Think Like a Detective: A Kid's Guide to Critical Thinking , by David Pakman

The popular YouTuber and podcast host Pakman—normally known for talking politics —has written a terrific primer on critical thinking for children. The illustrated book presents critical thinking as a “superpower” that enables kids to unlock mysteries and dig for truth. (I also recommend Pakman’s second kids’ book called Think Like a Scientist .)

Rationality: What It Is, Why It Seems Scarce, Why It Matters , by Steven Pinker

The Harvard psychology professor Pinker tackles conspiracy theories head-on but also explores concepts involving risk/reward, probability and randomness, and correlation/causation. And if that strikes you as daunting, be assured that Pinker makes it lively and accessible.

How Minds Change: The Surprising Science of Belief, Opinion and Persuasion , by David McRaney

David is a science writer who hosts the popular podcast “You Are Not So Smart” (and his ideas are featured in A More Beautiful Question ). His well-written book looks at ways you can actually get through to people who see the world very differently than you (hint: bludgeoning them with facts definitely won’t work).

A Healthy Democracy's Best Hope: Building the Critical Thinking Habit , by M Neil Browne and Chelsea Kulhanek

Neil Browne, author of the seminal Asking the Right Questions: A Guide to Critical Thinking, has been a pioneer in presenting critical thinking as a question-based approach to making sense of the world around us. His newest book, co-authored with Chelsea Kulhanek, breaks down critical thinking into “11 explosive questions”—including the “priors question” (which challenges us to question assumptions), the “evidence question” (focusing on how to evaluate and weigh evidence), and the “humility question” (which reminds us that a critical thinker must be humble enough to consider the possibility of being wrong).

Warren Berger is a longtime journalist and author of A More Beautiful Question .

• Find a Therapist
• Find a Treatment Center
• Find a Support Group
• International
• New Zealand
• South Africa
• Switzerland
• Asperger's
• Bipolar Disorder
• Chronic Pain
• Eating Disorders
• Passive Aggression
• Personality
• Goal Setting
• Positive Psychology
• Stopping Smoking
• Low Sexual Desire
• Relationships
• Child Development
• Therapy Center NEW
• Diagnosis Dictionary
• Types of Therapy

Understanding what emotional intelligence looks like and the steps needed to improve it could light a path to a more emotionally adept world.

• Coronavirus Disease 2019
• Affective Forecasting
• Neuroscience

Critical Thinking Dispositions: Their Nature and Assessability

• Robert H. Ennis

Developed By

• Français (Canada)

Information

• For Readers
• For Authors
• For Librarians

• Table of Contents
• New in this Archive
• Chronological
• Editorial Information
• About the SEP
• Editorial Board
• How to Cite the SEP
• Special Characters
• Support the SEP
• PDFs for SEP Friends
• Make a Donation
• SEPIA for Libraries
• Entry Contents

Bibliography

Academic tools.

• Friends PDF Preview
• Author and Citation Info
• Back to Top

Critical Thinking

Critical thinking is a widely accepted educational goal. Its definition is contested, but the competing definitions can be understood as differing conceptions of the same basic concept: careful thinking directed to a goal. Conceptions differ with respect to the scope of such thinking, the type of goal, the criteria and norms for thinking carefully, and the thinking components on which they focus. Its adoption as an educational goal has been recommended on the basis of respect for students’ autonomy and preparing students for success in life and for democratic citizenship. “Critical thinkers” have the dispositions and abilities that lead them to think critically when appropriate. The abilities can be identified directly; the dispositions indirectly, by considering what factors contribute to or impede exercise of the abilities. Standardized tests have been developed to assess the degree to which a person possesses such dispositions and abilities. Educational intervention has been shown experimentally to improve them, particularly when it includes dialogue, anchored instruction, and mentoring. Controversies have arisen over the generalizability of critical thinking across domains, over alleged bias in critical thinking theories and instruction, and over the relationship of critical thinking to other types of thinking.

2.1 Dewey’s Three Main Examples

2.2 dewey’s other examples, 2.3 further examples, 2.4 non-examples, 3. the definition of critical thinking, 4. its value, 5. the process of thinking critically, 6. components of the process, 7. contributory dispositions and abilities, 8.1 initiating dispositions, 8.2 internal dispositions, 9. critical thinking abilities, 10. required knowledge, 11. educational methods, 12.1 the generalizability of critical thinking, 12.2 bias in critical thinking theory and pedagogy, 12.3 relationship of critical thinking to other types of thinking, other internet resources, related entries.

Use of the term ‘critical thinking’ to describe an educational goal goes back to the American philosopher John Dewey (1910), who more commonly called it ‘reflective thinking’. He defined it as

active, persistent and careful consideration of any belief or supposed form of knowledge in the light of the grounds that support it, and the further conclusions to which it tends. (Dewey 1910: 6; 1933: 9)

and identified a habit of such consideration with a scientific attitude of mind. His lengthy quotations of Francis Bacon, John Locke, and John Stuart Mill indicate that he was not the first person to propose development of a scientific attitude of mind as an educational goal.

In the 1930s, many of the schools that participated in the Eight-Year Study of the Progressive Education Association (Aikin 1942) adopted critical thinking as an educational goal, for whose achievement the study’s Evaluation Staff developed tests (Smith, Tyler, & Evaluation Staff 1942). Glaser (1941) showed experimentally that it was possible to improve the critical thinking of high school students. Bloom’s influential taxonomy of cognitive educational objectives (Bloom et al. 1956) incorporated critical thinking abilities. Ennis (1962) proposed 12 aspects of critical thinking as a basis for research on the teaching and evaluation of critical thinking ability.

Since 1980, an annual international conference in California on critical thinking and educational reform has attracted tens of thousands of educators from all levels of education and from many parts of the world. Also since 1980, the state university system in California has required all undergraduate students to take a critical thinking course. Since 1983, the Association for Informal Logic and Critical Thinking has sponsored sessions in conjunction with the divisional meetings of the American Philosophical Association (APA). In 1987, the APA’s Committee on Pre-College Philosophy commissioned a consensus statement on critical thinking for purposes of educational assessment and instruction (Facione 1990a). Researchers have developed standardized tests of critical thinking abilities and dispositions; for details, see the Supplement on Assessment . Educational jurisdictions around the world now include critical thinking in guidelines for curriculum and assessment. Political and business leaders endorse its importance.

For details on this history, see the Supplement on History .

2. Examples and Non-Examples

Before considering the definition of critical thinking, it will be helpful to have in mind some examples of critical thinking, as well as some examples of kinds of thinking that would apparently not count as critical thinking.

Dewey (1910: 68–71; 1933: 91–94) takes as paradigms of reflective thinking three class papers of students in which they describe their thinking. The examples range from the everyday to the scientific.

Transit : “The other day, when I was down town on 16th Street, a clock caught my eye. I saw that the hands pointed to 12:20. This suggested that I had an engagement at 124th Street, at one o'clock. I reasoned that as it had taken me an hour to come down on a surface car, I should probably be twenty minutes late if I returned the same way. I might save twenty minutes by a subway express. But was there a station near? If not, I might lose more than twenty minutes in looking for one. Then I thought of the elevated, and I saw there was such a line within two blocks. But where was the station? If it were several blocks above or below the street I was on, I should lose time instead of gaining it. My mind went back to the subway express as quicker than the elevated; furthermore, I remembered that it went nearer than the elevated to the part of 124th Street I wished to reach, so that time would be saved at the end of the journey. I concluded in favor of the subway, and reached my destination by one o’clock.” (Dewey 1910: 68-69; 1933: 91-92)

Ferryboat : “Projecting nearly horizontally from the upper deck of the ferryboat on which I daily cross the river is a long white pole, having a gilded ball at its tip. It suggested a flagpole when I first saw it; its color, shape, and gilded ball agreed with this idea, and these reasons seemed to justify me in this belief. But soon difficulties presented themselves. The pole was nearly horizontal, an unusual position for a flagpole; in the next place, there was no pulley, ring, or cord by which to attach a flag; finally, there were elsewhere on the boat two vertical staffs from which flags were occasionally flown. It seemed probable that the pole was not there for flag-flying.

“I then tried to imagine all possible purposes of the pole, and to consider for which of these it was best suited: (a) Possibly it was an ornament. But as all the ferryboats and even the tugboats carried poles, this hypothesis was rejected. (b) Possibly it was the terminal of a wireless telegraph. But the same considerations made this improbable. Besides, the more natural place for such a terminal would be the highest part of the boat, on top of the pilot house. (c) Its purpose might be to point out the direction in which the boat is moving.

“In support of this conclusion, I discovered that the pole was lower than the pilot house, so that the steersman could easily see it. Moreover, the tip was enough higher than the base, so that, from the pilot's position, it must appear to project far out in front of the boat. Morevoer, the pilot being near the front of the boat, he would need some such guide as to its direction. Tugboats would also need poles for such a purpose. This hypothesis was so much more probable than the others that I accepted it. I formed the conclusion that the pole was set up for the purpose of showing the pilot the direction in which the boat pointed, to enable him to steer correctly.” (Dewey 1910: 69-70; 1933: 92-93)

Bubbles : “In washing tumblers in hot soapsuds and placing them mouth downward on a plate, bubbles appeared on the outside of the mouth of the tumblers and then went inside. Why? The presence of bubbles suggests air, which I note must come from inside the tumbler. I see that the soapy water on the plate prevents escape of the air save as it may be caught in bubbles. But why should air leave the tumbler? There was no substance entering to force it out. It must have expanded. It expands by increase of heat, or by decrease of pressure, or both. Could the air have become heated after the tumbler was taken from the hot suds? Clearly not the air that was already entangled in the water. If heated air was the cause, cold air must have entered in transferring the tumblers from the suds to the plate. I test to see if this supposition is true by taking several more tumblers out. Some I shake so as to make sure of entrapping cold air in them. Some I take out holding mouth downward in order to prevent cold air from entering. Bubbles appear on the outside of every one of the former and on none of the latter. I must be right in my inference. Air from the outside must have been expanded by the heat of the tumbler, which explains the appearance of the bubbles on the outside. But why do they then go inside? Cold contracts. The tumbler cooled and also the air inside it. Tension was removed, and hence bubbles appeared inside. To be sure of this, I test by placing a cup of ice on the tumbler while the bubbles are still forming outside. They soon reverse” (Dewey 1910: 70–71; 1933: 93–94).

Dewey (1910, 1933) sprinkles his book with other examples of critical thinking. We will refer to the following.

Weather : A man on a walk notices that it has suddenly become cool, thinks that it is probably going to rain, looks up and sees a dark cloud obscuring the sun, and quickens his steps (1910: 6–10; 1933: 9–13).

Disorder : A man finds his rooms on his return to them in disorder with his belongings thrown about, thinks at first of burglary as an explanation, then thinks of mischievous children as being an alternative explanation, then looks to see whether valuables are missing, and discovers that they are (1910: 82–83; 1933: 166–168).

Typhoid : A physician diagnosing a patient whose conspicuous symptoms suggest typhoid avoids drawing a conclusion until more data are gathered by questioning the patient and by making tests (1910: 85–86; 1933: 170).

Blur : A moving blur catches our eye in the distance, we ask ourselves whether it is a cloud of whirling dust or a tree moving its branches or a man signaling to us, we think of other traits that should be found on each of those possibilities, and we look and see if those traits are found (1910: 102, 108; 1933: 121, 133).

Suction pump : In thinking about the suction pump, the scientist first notes that it will draw water only to a maximum height of 33 feet at sea level and to a lesser maximum height at higher elevations, selects for attention the differing atmospheric pressure at these elevations, sets up experiments in which the air is removed from a vessel containing water (when suction no longer works) and in which the weight of air at various levels is calculated, compares the results of reasoning about the height to which a given weight of air will allow a suction pump to raise water with the observed maximum height at different elevations, and finally assimilates the suction pump to such apparently different phenomena as the siphon and the rising of a balloon (1910: 150–153; 1933: 195–198).

Diamond : A passenger in a car driving in a diamond lane reserved for vehicles with at least one passenger notices that the diamond marks on the pavement are far apart in some places and close together in others. Why? The driver suggests that the reason may be that the diamond marks are not needed where there is a solid double line separating the diamond line from the adjoining lane, but are needed when there is a dotted single line permitting crossing into the diamond lane. Further observation confirms that the diamonds are close together when a dotted line separates the diamond lane from its neighbour, but otherwise far apart.

Rash : A woman suddenly develops a very itchy red rash on her throat and upper chest. She recently noticed a mark on the back of her right hand, but was not sure whether the mark was a rash or a scrape. She lies down in bed and thinks about what might be causing the rash and what to do about it. About two weeks before, she began taking blood pressure medication that contained a sulfa drug, and the pharmacist had warned her, in view of a previous allergic reaction to a medication containing a sulfa drug, to be on the alert for an allergic reaction; however, she had been taking the medication for two weeks with no such effect. The day before, she began using a new cream on her neck and upper chest; against the new cream as the cause was mark on the back of her hand, which had not been exposed to the cream. She began taking probiotics about a month before. She also recently started new eye drops, but she supposed that manufacturers of eye drops would be careful not to include allergy-causing components in the medication. The rash might be a heat rash, since she recently was sweating profusely from her upper body. Since she is about to go away on a short vacation, where she would not have access to her usual physician, she decides to keep taking the probiotics and using the new eye drops but to discontinue the blood pressure medication and to switch back to the old cream for her neck and upper chest. She forms a plan to consult her regular physician on her return about the blood pressure medication.

Candidate : Although Dewey included no examples of thinking directed at appraising the arguments of others, such thinking has come to be considered a kind of critical thinking. We find an example of such thinking in the performance task on the Collegiate Learning Assessment (CLA+), which its sponsoring organization describes as

a performance-based assessment that provides a measure of an institution’s contribution to the development of critical-thinking and written communication skills of its students. (Council for Aid to Education 2017)

A sample task posted on its website requires the test-taker to write a report for public distribution evaluating a fictional candidate’s policy proposals and their supporting arguments, using supplied background documents, with a recommendation on whether to endorse the candidate.

Immediate acceptance of an idea that suggests itself as a solution to a problem (e.g., a possible explanation of an event or phenomenon, an action that seems likely to produce a desired result) is “uncritical thinking, the minimum of reflection” (Dewey 1910: 13). On-going suspension of judgment in the light of doubt about a possible solution is not critical thinking (Dewey 1910: 108). Critique driven by a dogmatically held political or religious ideology is not critical thinking; thus Paulo Freire (1968 [1970]) is using the term (e.g., at 1970: 71, 81, 100, 146) in a more politically freighted sense that includes not only reflection but also revolutionary action against oppression. Derivation of a conclusion from given data using an algorithm is not critical thinking.

What is critical thinking? There are many definitions. Ennis (2016) lists 14 philosophically oriented scholarly definitions and three dictionary definitions. Following Rawls (1971), who distinguished his conception of justice from a utilitarian conception but regarded them as rival conceptions of the same concept, Ennis maintains that the 17 definitions are different conceptions of the same concept. Rawls articulated the shared concept of justice as

a characteristic set of principles for assigning basic rights and duties and for determining… the proper distribution of the benefits and burdens of social cooperation. (Rawls 1971: 5)

Bailin et al. (1999b) claim that, if one considers what sorts of thinking an educator would take not to be critical thinking and what sorts to be critical thinking, one can conclude that educators typically understand critical thinking to have at least three features.

• It is done for the purpose of making up one’s mind about what to believe or do.
• The person engaging in the thinking is trying to fulfill standards of adequacy and accuracy appropriate to the thinking.
• The thinking fulfills the relevant standards to some threshold level.

One could sum up the core concept that involves these three features by saying that critical thinking is careful goal-directed thinking. This core concept seems to apply to all the examples of critical thinking described in the previous section. As for the non-examples, their exclusion depends on construing careful thinking as excluding jumping immediately to conclusions, suspending judgment no matter how strong the evidence, reasoning from an unquestioned ideological or religious perspective, and routinely using an algorithm to answer a question.

If the core of critical thinking is careful goal-directed thinking, conceptions of it can vary according to its presumed scope, its presumed goal, one’s criteria and threshold for being careful, and the thinking component on which one focuses As to its scope, some conceptions (e.g., Dewey 1910, 1933) restrict it to constructive thinking on the basis of one’s own observations and experiments, others (e.g., Ennis 1962; Fisher & Scriven 1997; Johnson 1992) to appraisal of the products of such thinking. Ennis (1991) and Bailin et al. (1999b) take it to cover both construction and appraisal. As to its goal, some conceptions restrict it to forming a judgment (Dewey 1910, 1933; Lipman 1987; Facione 1990a). Others allow for actions as well as beliefs as the end point of a process of critical thinking (Ennis 1991; Bailin et al. 1999b). As to the criteria and threshold for being careful, definitions vary in the term used to indicate that critical thinking satisfies certain norms: “intellectually disciplined” (Scriven & Paul 1987), “reasonable” (Ennis 1991), “skillful” (Lipman 1987), “skilled” (Fisher & Scriven 1997), “careful” (Bailin & Battersby 2009). Some definitions specify these norms, referring variously to “consideration of any belief or supposed form of knowledge in the light of the grounds that support it and the further conclusions to which it tends” (Dewey 1910, 1933); “the methods of logical inquiry and reasoning” (Glaser 1941); “conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication” (Scriven & Paul 1987); the requirement that “it is sensitive to context, relies on criteria, and is self-correcting” (Lipman 1987); “evidential, conceptual, methodological, criteriological, or contextual considerations” (Facione 1990a); and “plus-minus considerations of the product in terms of appropriate standards (or criteria)” (Johnson 1992). Stanovich and Stanovich (2010) propose to ground the concept of critical thinking in the concept of rationality, which they understand as combining epistemic rationality (fitting one’s beliefs to the world) and instrumental rationality (optimizing goal fulfillment); a critical thinker, in their view, is someone with “a propensity to override suboptimal responses from the autonomous mind” (2010: 227). These variant specifications of norms for critical thinking are not necessarily incompatible with one another, and in any case presuppose the core notion of thinking carefully. As to the thinking component singled out, some definitions focus on suspension of judgment during the thinking (Dewey 1910; McPeck 1981), others on inquiry while judgment is suspended (Bailin & Battersby 2009), others on the resulting judgment (Facione 1990a), and still others on the subsequent emotive response (Siegel 1988).

In educational contexts, a definition of critical thinking is a “programmatic definition” (Scheffler 1960: 19). It expresses a practical program for achieving an educational goal. For this purpose, a one-sentence formulaic definition is much less useful than articulation of a critical thinking process, with criteria and standards for the kinds of thinking that the process may involve. The real educational goal is recognition, adoption and implementation by students of those criteria and standards. That adoption and implementation in turn consists in acquiring the knowledge, abilities and dispositions of a critical thinker.

Conceptions of critical thinking generally do not include moral integrity as part of the concept. Dewey, for example, took critical thinking to be the ultimate intellectual goal of education, but distinguished it from the development of social cooperation among school children, which he took to be the central moral goal. Ennis (1996, 2011) added to his previous list of critical thinking dispositions a group of dispositions to care about the dignity and worth of every person, which he described as a “correlative” (1996) disposition without which critical thinking would be less valuable and perhaps harmful. An educational program that aimed at developing critical thinking but not the correlative disposition to care about the dignity and worth of every person, he asserted, “would be deficient and perhaps dangerous” (Ennis 1996: 172).

Dewey thought that education for reflective thinking would be of value to both the individual and society; recognition in educational practice of the kinship to the scientific attitude of children’s native curiosity, fertile imagination and love of experimental inquiry “would make for individual happiness and the reduction of social waste” (Dewey 1910: iii). Schools participating in the Eight-Year Study took development of the habit of reflective thinking and skill in solving problems as a means to leading young people to understand, appreciate and live the democratic way of life characteristic of the United States (Aikin 1942: 17–18, 81). Harvey Siegel (1988: 55–61) has offered four considerations in support of adopting critical thinking as an educational ideal. (1) Respect for persons requires that schools and teachers honour students’ demands for reasons and explanations, deal with students honestly, and recognize the need to confront students’ independent judgment; these requirements concern the manner in which teachers treat students. (2) Education has the task of preparing children to be successful adults, a task that requires development of their self-sufficiency. (3) Education should initiate children into the rational traditions in such fields as history, science and mathematics. (4) Education should prepare children to become democratic citizens, which requires reasoned procedures and critical talents and attitudes. To supplement these considerations, Siegel (1988: 62–90) responds to two objections: the ideology objection that adoption of any educational ideal requires a prior ideological commitment and the indoctrination objection that cultivation of critical thinking cannot escape being a form of indoctrination.

Despite the diversity of our 11 examples, one can recognize a common pattern. Dewey analyzed it as consisting of five phases:

• suggestions , in which the mind leaps forward to a possible solution;
• an intellectualization of the difficulty or perplexity into a problem to be solved, a question for which the answer must be sought;
• the use of one suggestion after another as a leading idea, or hypothesis , to initiate and guide observation and other operations in collection of factual material;
• the mental elaboration of the idea or supposition as an idea or supposition ( reasoning , in the sense on which reasoning is a part, not the whole, of inference); and
• testing the hypothesis by overt or imaginative action. (Dewey 1933: 106–107; italics in original)

The process of reflective thinking consisting of these phases would be preceded by a perplexed, troubled or confused situation and followed by a cleared-up, unified, resolved situation (Dewey 1933: 106). The term ‘phases’ replaced the term ‘steps’ (Dewey 1910: 72), thus removing the earlier suggestion of an invariant sequence. Variants of the above analysis appeared in (Dewey 1916: 177) and (Dewey 1938: 101–119).

The variant formulations indicate the difficulty of giving a single logical analysis of such a varied process. The process of critical thinking may have a spiral pattern, with the problem being redefined in the light of obstacles to solving it as originally formulated. For example, the person in Transit might have concluded that getting to the appointment at the scheduled time was impossible and have reformulated the problem as that of rescheduling the appointment for a mutually convenient time. Further, defining a problem does not always follow after or lead immediately to an idea of a suggested solution. Nor should it do so, as Dewey himself recognized in describing the physician in Typhoid as avoiding any strong preference for this or that conclusion before getting further information (Dewey 1910: 85; 1933: 170). People with a hypothesis in mind, even one to which they have a very weak commitment, have a so-called “confirmation bias” (Nickerson 1998): they are likely to pay attention to evidence that confirms the hypothesis and to ignore evidence that counts against it or for some competing hypothesis. Detectives, intelligence agencies, and investigators of airplane accidents are well advised to gather relevant evidence systematically and to postpone even tentative adoption of an explanatory hypothesis until the collected evidence rules out with the appropriate degree of certainty all but one explanation. Dewey’s analysis of the critical thinking process can be faulted as well for requiring acceptance or rejection of a possible solution to a defined problem, with no allowance for deciding in the light of the available evidence to suspend judgment. Further, given the great variety of kinds of problems for which reflection is appropriate, there is likely to be variation in its component events. Perhaps the best way to conceptualize the critical thinking process is as a checklist whose component events can occur in a variety of orders, selectively, and more than once. These component events might include (1) noticing a difficulty, (2) defining the problem, (3) dividing the problem into manageable sub-problems, (4) formulating a variety of possible solutions to the problem or sub-problem, (5) determining what evidence is relevant to deciding among possible solutions to the problem or sub-problem, (6) devising a plan of systematic observation or experiment that will uncover the relevant evidence, (7) carrying out the plan of systematic observation or experimentation, (8) noting the results of the systematic observation or experiment, (9) gathering relevant testimony and information from others, (10) judging the credibility of testimony and information gathered from others, (11) drawing conclusions from gathered evidence and accepted testimony, and (12) accepting a solution that the evidence adequately supports (cf. Hitchcock 2017: 485).

Checklist conceptions of the process of critical thinking are open to the objection that they are too mechanical and procedural to fit the multi-dimensional and emotionally charged issues for which critical thinking is urgently needed (Paul 1984). For such issues, a more dialectical process is advocated, in which competing relevant world views are identified, their implications explored, and some sort of creative synthesis attempted.

If one considers the critical thinking process illustrated by the 11 examples, one can identify distinct kinds of mental acts and mental states that form part of it. To distinguish, label and briefly characterize these components is a useful preliminary to identifying abilities, skills, dispositions, attitudes, habits and the like that contribute causally to thinking critically. Identifying such abilities and habits is in turn a useful preliminary to setting educational goals. Setting the goals is in its turn a useful preliminary to designing strategies for helping learners to achieve the goals and to designing ways of measuring the extent to which learners have done so. Such measures provide both feedback to learners on their achievement and a basis for experimental research on the effectiveness of various strategies for educating people to think critically. Let us begin, then, by distinguishing the kinds of mental acts and mental events that can occur in a critical thinking process.

• Observing : One notices something in one’s immediate environment (sudden cooling of temperature in Weather , bubbles forming outside a glass and then going inside in Bubbles , a moving blur in the distance in Blur , a rash in Rash ). Or one notes the results of an experiment or systematic observation (valuables missing in Disorder , no suction without air pressure in Suction pump )
• Feeling : One feels puzzled or uncertain about something (how to get to an appointment on time in Transit , why the diamonds vary in frequency in Diamond ). One wants to resolve this perplexity. One feels satisfaction once one has worked out an answer (to take the subway express in Transit , diamonds closer when needed as a warning in Diamond ).
• Wondering : One formulates a question to be addressed (why bubbles form outside a tumbler taken from hot water in Bubbles , how suction pumps work in Suction pump , what caused the rash in Rash ).
• Imagining : One thinks of possible answers (bus or subway or elevated in Transit , flagpole or ornament or wireless communication aid or direction indicator in Ferryboat , allergic reaction or heat rash in Rash ).
• Inferring : One works out what would be the case if a possible answer were assumed (valuables missing if there has been a burglary in Disorder , earlier start to the rash if it is an allergic reaction to a sulfa drug in Rash ). Or one draws a conclusion once sufficient relevant evidence is gathered (take the subway in Transit , burglary in Disorder , discontinue blood pressure medication and new cream in Rash ).
• Knowledge : One uses stored knowledge of the subject-matter to generate possible answers or to infer what would be expected on the assumption of a particular answer (knowledge of a city’s public transit system in Transit , of the requirements for a flagpole in Ferryboat , of Boyle’s law in Bubbles , of allergic reactions in Rash ).
• Experimenting : One designs and carries out an experiment or a systematic observation to find out whether the results deduced from a possible answer will occur (looking at the location of the flagpole in relation to the pilot’s position in Ferryboat , putting an ice cube on top of a tumbler taken from hot water in Bubbles , measuring the height to which a suction pump will draw water at different elevations in Suction pump , noticing the frequency of diamonds when movement to or from a diamond lane is allowed in Diamond ).
• Consulting : One finds a source of information, gets the information from the source, and makes a judgment on whether to accept it. None of our 11 examples include searching for sources of information. In this respect they are unrepresentative, since most people nowadays have almost instant access to information relevant to answering any question, including many of those illustrated by the examples. However, Candidate includes the activities of extracting information from sources and evaluating its credibility.
• Identifying and analyzing arguments : One notices an argument and works out its structure and content as a preliminary to evaluating its strength. This activity is central to Candidate . It is an important part of a critical thinking process in which one surveys arguments for various positions on an issue.
• Judging : One makes a judgment on the basis of accumulated evidence and reasoning, such as the judgment in Ferryboat that the purpose of the pole is to provide direction to the pilot.
• Deciding : One makes a decision on what to do or on what policy to adopt, as in the decision in Transit to take the subway.

By definition, a person who does something voluntarily is both willing and able to do that thing at that time. Both the willingness and the ability contribute causally to the person’s action, in the sense that the voluntary action would not occur if either (or both) of these were lacking. For example, suppose that one is standing with one’s arms at one’s sides and one voluntarily lifts one’s right arm to an extended horizontal position. One would not do so if one were unable to lift one’s arm, if for example one’s right side was paralyzed as the result of a stroke. Nor would one do so if one were unwilling to lift one’s arm, if for example one were participating in a street demonstration at which a white supremacist was urging the crowd to lift their right arm in a Nazi salute and one were unwilling to express support in this way for the racist Nazi ideology. The same analysis applies to a voluntary mental process of thinking critically. It requires both willingness and ability to think critically, including willingness and ability to perform each of the mental acts that compose the process and to coordinate those acts in a sequence that is directed at resolving the initiating perplexity.

Consider willingness first. We can identify causal contributors to willingness to think critically by considering factors that would cause a person who was able to think critically about an issue nevertheless not to do so (Hamby 2014). For each factor, the opposite condition thus contributes causally to willingness to think critically on a particular occasion. For example, people who habitually jump to conclusions without considering alternatives will not think critically about issues that arise, even if they have the required abilities. The contrary condition of willingness to suspend judgment is thus a causal contributor to thinking critically.

Now consider ability. In contrast to the ability to move one’s arm, which can be completely absent because a stroke has left the arm paralyzed, the ability to think critically is a developed ability, whose absence is not a complete absence of ability to think but absence of ability to think well. We can identify the ability to think well directly, in terms of the norms and standards for good thinking. In general, to be able do well the thinking activities that can be components of a critical thinking process, one needs to know the concepts and principles that characterize their good performance, to recognize in particular cases that the concepts and principles apply, and to apply them. The knowledge, recognition and application may be procedural rather than declarative. It may be domain-specific rather than widely applicable, and in either case may need subject-matter knowledge, sometimes of a deep kind.

Reflections of the sort illustrated by the previous two paragraphs have led scholars to identify the knowledge, abilities and dispositions of a “critical thinker”, i.e., someone who thinks critically whenever it is appropriate to do so. We turn now to these three types of causal contributors to thinking critically. We start with dispositions, since arguably these are the most powerful contributors to being a critical thinker, can be fostered at an early stage of a child’s development, and are susceptible to general improvement (Glaser 1941: 175)

8. Critical Thinking Dispositions

Educational researchers use the term ‘dispositions’ broadly for the habits of mind and attitudes that contribute causally to being a critical thinker. Some writers (e.g., Paul & Elder 2006; Hamby 2014; Bailin & Battersby 2016) propose to use the term ‘virtues’ for this dimension of a critical thinker. The virtues in question, although they are virtues of character, concern the person’s ways of thinking rather than the person’s ways of behaving towards others. They are not moral virtues but intellectual virtues, of the sort articulated by Zagzebski (1996) and discussed by Turri, Alfano, and Greco (2017).

On a realistic conception, thinking dispositions or intellectual virtues are real properties of thinkers. They are general tendencies, propensities, or inclinations to think in particular ways in particular circumstances, and can be genuinely explanatory (Siegel 1999). Sceptics argue that there is no evidence for a specific mental basis for the habits of mind that contribute to thinking critically, and that it is pedagogically misleading to posit such a basis (Bailin et al. 1999a). Whatever their status, critical thinking dispositions need motivation for their initial formation in a child—motivation that may be external or internal. As children develop, the force of habit will gradually become important in sustaining the disposition (Nieto & Valenzuela 2012). Mere force of habit, however, is unlikely to sustain critical thinking dispositions. Critical thinkers must value and enjoy using their knowledge and abilities to think things through for themselves. They must be committed to, and lovers of, inquiry.

A person may have a critical thinking disposition with respect to only some kinds of issues. For example, one could be open-minded about scientific issues but not about religious issues. Similarly, one could be confident in one’s ability to reason about the theological implications of the existence of evil in the world but not in one’s ability to reason about the best design for a guided ballistic missile.

Critical thinking dispositions can usefully be divided into initiating dispositions (those that contribute causally to starting to think critically about an issue) and internal dispositions (those that contribute causally to doing a good job of thinking critically once one has started) (Facione 1990a: 25). The two categories are not mutually exclusive. For example, open-mindedness, in the sense of willingness to consider alternative points of view to one’s own, is both an initiating and an internal disposition.

Using the strategy of considering factors that would block people with the ability to think critically from doing so, we can identify as initiating dispositions for thinking critically attentiveness, a habit of inquiry, self-confidence, courage, open-mindedness, willingness to suspend judgment, trust in reason, wanting evidence for one’s beliefs, and seeking the truth. We consider briefly what each of these dispositions amounts to, in each case citing sources that acknowledge them.

• Attentiveness : One will not think critically if one fails to recognize an issue that needs to be thought through. For example, the pedestrian in Weather would not have looked up if he had not noticed that the air was suddenly cooler. To be a critical thinker, then, one needs to be habitually attentive to one’s surroundings, noticing not only what one senses but also sources of perplexity in messages received and in one’s own beliefs and attitudes (Facione 1990a: 25; Facione, Facione, & Giancarlo 2001).
• Habit of inquiry : Inquiry is effortful, and one needs an internal push to engage in it. For example, the student in Bubbles could easily have stopped at idle wondering about the cause of the bubbles rather than reasoning to a hypothesis, then designing and executing an experiment to test it. Thus willingness to think critically needs mental energy and initiative. What can supply that energy? Love of inquiry, or perhaps just a habit of inquiry. Hamby (2015) has argued that willingness to inquire is the central critical thinking virtue, one that encompasses all the others. It is recognized as a critical thinking disposition by Dewey (1910: 29; 1933: 35), Glaser (1941: 5), Ennis (1987: 12; 1991: 8), Facione (1990a: 25), Bailin et al. (1999b: 294), Halpern (1998: 452), and Facione, Facione, & Giancarlo (2001).
• Self-confidence : Lack of confidence in one’s abilities can block critical thinking. For example, if the woman in Rash lacked confidence in her ability to figure things out for herself, she might just have assumed that the rash on her chest was the allergic reaction to her medication against which the pharmacist had warned her. Thus willingness to think critically requires confidence in one’s ability to inquire (Facione 1990a: 25; Facione, Facione, & Giancarlo 2001).
• Courage : Fear of thinking for oneself can stop one from doing it. Thus willingness to think critically requires intellectual courage (Paul & Elder 2006: 16).
• Open-mindedness : A dogmatic attitude will impede thinking critically. For example, a person who adheres rigidly to a “pro-choice” position on the issue of the legal status of induced abortion is likely to be unwilling to consider seriously the issue of when in its development an unborn child acquires a moral right to life. Thus willingness to think critically requires open-mindedness, in the sense of a willingness to examine questions to which one already accepts an answer but which further evidence or reasoning might cause one to answer differently (Dewey 1933; Facione 1990a; Ennis 1991; Bailin et al. 1999b; Halpern 1998, Facione, Facione, & Giancarlo 2001). Paul (1981) emphasizes open-mindedness about alternative world-views, and recommends a dialectical approach to integrating such views as central to what he calls “strong sense” critical thinking.
• Willingness to suspend judgment : Premature closure on an initial solution will block critical thinking. Thus willingness to think critically requires a willingness to suspend judgment while alternatives are explored (Facione 1990a; Ennis 1991; Halpern 1998).
• Trust in reason : Since distrust in the processes of reasoned inquiry will dissuade one from engaging in it, trust in them is an initiating critical thinking disposition (Facione 1990a, 25; Bailin et al. 1999b: 294; Facione, Facione, & Giancarlo 2001; Paul & Elder 2006). In reaction to an allegedly exclusive emphasis on reason in critical thinking theory and pedagogy, Thayer-Bacon (2000) argues that intuition, imagination, and emotion have important roles to play in an adequate conception of critical thinking that she calls “constructive thinking”. From her point of view, critical thinking requires trust not only in reason but also in intuition, imagination, and emotion.
• Seeking the truth : If one does not care about the truth but is content to stick with one’s initial bias on an issue, then one will not think critically about it. Seeking the truth is thus an initiating critical thinking disposition (Bailin et al. 1999b: 294; Facione, Facione, & Giancarlo 2001). A disposition to seek the truth is implicit in more specific critical thinking dispositions, such as trying to be well-informed, considering seriously points of view other than one’s own, looking for alternatives, suspending judgment when the evidence is insufficient, and adopting a position when the evidence supporting it is sufficient.

Some of the initiating dispositions, such as open-mindedness and willingness to suspend judgment, are also internal critical thinking dispositions, in the sense of mental habits or attitudes that contribute causally to doing a good job of critical thinking once one starts the process. But there are many other internal critical thinking dispositions. Some of them are parasitic on one’s conception of good thinking. For example, it is constitutive of good thinking about an issue to formulate the issue clearly and to maintain focus on it. For this purpose, one needs not only the corresponding ability but also the corresponding disposition. Ennis (1991: 8) describes it as the disposition “to determine and maintain focus on the conclusion or question”, Facione (1990a: 25) as “clarity in stating the question or concern”. Other internal dispositions are motivators to continue or adjust the critical thinking process, such as willingness to persist in a complex task and willingness to abandon nonproductive strategies in an attempt to self-correct (Halpern 1998: 452). For a list of identified internal critical thinking dispositions, see the Supplement on Internal Critical Thinking Dispositions .

Some theorists postulate skills, i.e., acquired abilities, as operative in critical thinking. It is not obvious, however, that a good mental act is the exercise of a generic acquired skill. Inferring an expected time of arrival, as in Transit , has some generic components but also uses non-generic subject-matter knowledge. Bailin et al. (1999a) argue against viewing critical thinking skills as generic and discrete, on the ground that skilled performance at a critical thinking task cannot be separated from knowledge of concepts and from domain-specific principles of good thinking. Talk of skills, they concede, is unproblematic if it means merely that a person with critical thinking skills is capable of intelligent performance.

Despite such scepticism, theorists of critical thinking have listed as general contributors to critical thinking what they variously call abilities (Glaser 1941; Ennis 1962, 1991), skills (Facione 1990a; Halpern 1998) or competencies (Fisher & Scriven 1997). Amalgamating these lists would produce a confusing and chaotic cornucopia of more than 50 possible educational objectives, with only partial overlap among them. It makes sense instead to try to understand the reasons for the multiplicity and diversity, and to make a selection according to one’s own reasons for singling out abilities to be developed in a critical thinking curriculum. Two reasons for diversity among lists of critical thinking abilities are the underlying conception of critical thinking and the envisaged educational level. Appraisal-only conceptions, for example, involve a different suite of abilities than constructive-only conceptions. Some lists, such as those in (Glaser 1941), are put forward as educational objectives for secondary school students, whereas others are proposed as objectives for college students (e.g., Facione 1990a).

The abilities described in the remaining paragraphs of this section emerge from reflection on the general abilities needed to do well the thinking activities identified in section 6 as components of the critical thinking process described in section 5 . The derivation of each collection of abilities is accompanied by citation of sources that list such abilities and of standardized tests that claim to test them.

Observational abilities : Careful and accurate observation sometimes requires specialist expertise and practice, as in the case of observing birds and observing accident scenes. However, there are general abilities of noticing what one’s senses are picking up from one’s environment and of being able to articulate clearly and accurately to oneself and others what one has observed. It helps in exercising them to be able to recognize and take into account factors that make one’s observation less trustworthy, such as prior framing of the situation, inadequate time, deficient senses, poor observation conditions, and the like. It helps as well to be skilled at taking steps to make one’s observation more trustworthy, such as moving closer to get a better look, measuring something three times and taking the average, and checking what one thinks one is observing with someone else who is in a good position to observe it. It also helps to be skilled at recognizing respects in which one’s report of one’s observation involves inference rather than direct observation, so that one can then consider whether the inference is justified. These abilities come into play as well when one thinks about whether and with what degree of confidence to accept an observation report, for example in the study of history or in a criminal investigation or in assessing news reports. Observational abilities show up in some lists of critical thinking abilities (Ennis 1962: 90; Facione 1990a: 16; Ennis 1991: 9). There are items testing a person’s ability to judge the credibility of observation reports in the Cornell Critical Thinking Tests, Levels X and Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005). Norris and King (1983, 1985, 1990a, 1990b) is a test of ability to appraise observation reports.

Emotional abilities : The emotions that drive a critical thinking process are perplexity or puzzlement, a wish to resolve it, and satisfaction at achieving the desired resolution. Children experience these emotions at an early age, without being trained to do so. Education that takes critical thinking as a goal needs only to channel these emotions and to make sure not to stifle them. Collaborative critical thinking benefits from ability to recognize one’s own and others’ emotional commitments and reactions.

Questioning abilities : A critical thinking process needs transformation of an inchoate sense of perplexity into a clear question. Formulating a question well requires not building in questionable assumptions, not prejudging the issue, and using language that in context is unambiguous and precise enough (Ennis 1962: 97; 1991: 9).

Imaginative abilities : Thinking directed at finding the correct causal explanation of a general phenomenon or particular event requires an ability to imagine possible explanations. Thinking about what policy or plan of action to adopt requires generation of options and consideration of possible consequences of each option. Domain knowledge is required for such creative activity, but a general ability to imagine alternatives is helpful and can be nurtured so as to become easier, quicker, more extensive, and deeper (Dewey 1910: 34–39; 1933: 40–47). Facione (1990a) and Halpern (1998) include the ability to imagine alternatives as a critical thinking ability.

Inferential abilities : The ability to draw conclusions from given information, and to recognize with what degree of certainty one’s own or others’ conclusions follow, is universally recognized as a general critical thinking ability. All 11 examples in section 2 of this article include inferences, some from hypotheses or options (as in Transit , Ferryboat and Disorder ), others from something observed (as in Weather and Rash ). None of these inferences is formally valid. Rather, they are licensed by general, sometimes qualified substantive rules of inference (Toulmin 1958) that rest on domain knowledge—that a bus trip takes about the same time in each direction, that the terminal of a wireless telegraph would be located on the highest possible place, that sudden cooling is often followed by rain, that an allergic reaction to a sulfa drug generally shows up soon after one starts taking it. It is a matter of controversy to what extent the specialized ability to deduce conclusions from premisses using formal rules of inference is needed for critical thinking. Dewey (1933) locates logical forms in setting out the products of reflection rather than in the process of reflection. Ennis (1981a), on the other hand, maintains that a liberally-educated person should have the following abilities: to translate natural-language statements into statements using the standard logical operators, to use appropriately the language of necessary and sufficient conditions, to deal with argument forms and arguments containing symbols, to determine whether in virtue of an argument’s form its conclusion follows necessarily from its premisses, to reason with logically complex propositions, and to apply the rules and procedures of deductive logic. Inferential abilities are recognized as critical thinking abilities by Glaser (1941: 6), Facione (1990a: 9), Ennis (1991: 9), Fisher & Scriven (1997: 99, 111), and Halpern (1998: 452). Items testing inferential abilities constitute two of the five subtests of the Watson Glaser Critical Thinking Appraisal (Watson & Glaser 1980a, 1980b, 1994), two of the four sections in the Cornell Critical Thinking Test Level X (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005), three of the seven sections in the Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005), 11 of the 34 items on Forms A and B of the California Critical Thinking Skills Test (Facione 1990b, 1992), and a high but variable proportion of the 25 selected-response questions in the Collegiate Learning Assessment (Council for Aid to Education 2017).

Experimenting abilities : Knowing how to design and execute an experiment is important not just in scientific research but also in everyday life, as in Rash . Dewey devoted a whole chapter of his How We Think (1910: 145–156; 1933: 190–202) to the superiority of experimentation over observation in advancing knowledge. Experimenting abilities come into play at one remove in appraising reports of scientific studies. Skill in designing and executing experiments includes the acknowledged abilities to appraise evidence (Glaser 1941: 6), to carry out experiments and to apply appropriate statistical inference techniques (Facione 1990a: 9), to judge inductions to an explanatory hypothesis (Ennis 1991: 9), and to recognize the need for an adequately large sample size (Halpern 1998). The Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005) includes four items (out of 52) on experimental design. The Collegiate Learning Assessment (Council for Aid to Education 2017) makes room for appraisal of study design in both its performance task and its selected-response questions.

Consulting abilities : Skill at consulting sources of information comes into play when one seeks information to help resolve a problem, as in Candidate . Ability to find and appraise information includes ability to gather and marshal pertinent information (Glaser 1941: 6), to judge whether a statement made by an alleged authority is acceptable (Ennis 1962: 84), to plan a search for desired information (Facione 1990a: 9), and to judge the credibility of a source (Ennis 1991: 9). Ability to judge the credibility of statements is tested by 24 items (out of 76) in the Cornell Critical Thinking Test Level X (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005) and by four items (out of 52) in the Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005). The College Learning Assessment’s performance task requires evaluation of whether information in documents is credible or unreliable (Council for Aid to Education 2017).

Argument analysis abilities : The ability to identify and analyze arguments contributes to the process of surveying arguments on an issue in order to form one’s own reasoned judgment, as in Candidate . The ability to detect and analyze arguments is recognized as a critical thinking skill by Facione (1990a: 7–8), Ennis (1991: 9) and Halpern (1998). Five items (out of 34) on the California Critical Thinking Skills Test (Facione 1990b, 1992) test skill at argument analysis. The College Learning Assessment (Council for Aid to Education 2017) incorporates argument analysis in its selected-response tests of critical reading and evaluation and of critiquing an argument.

Judging skills and deciding skills : Skill at judging and deciding is skill at recognizing what judgment or decision the available evidence and argument supports, and with what degree of confidence. It is thus a component of the inferential skills already discussed.

Lists and tests of critical thinking abilities often include two more abilities: identifying assumptions and constructing and evaluating definitions.

In addition to dispositions and abilities, critical thinking needs knowledge: of critical thinking concepts, of critical thinking principles, and of the subject-matter of the thinking.

We can derive a short list of concepts whose understanding contributes to critical thinking from the critical thinking abilities described in the preceding section. Observational abilities require an understanding of the difference between observation and inference. Questioning abilities require an understanding of the concepts of ambiguity and vagueness. Inferential abilities require an understanding of the difference between conclusive and defeasible inference (traditionally, between deduction and induction), as well as of the difference between necessary and sufficient conditions. Experimenting abilities require an understanding of the concepts of hypothesis, null hypothesis, assumption and prediction, as well as of the concept of statistical significance and of its difference from importance. They also require an understanding of the difference between an experiment and an observational study, and in particular of the difference between a randomized controlled trial, a prospective correlational study and a retrospective (case-control) study. Argument analysis abilities require an understanding of the concepts of argument, premiss, assumption, conclusion and counter-consideration. Additional critical thinking concepts are proposed by Bailin et al. (1999b: 293), Fisher & Scriven (1997: 105–106), and Black (2012).

According to Glaser (1941: 25), ability to think critically requires knowledge of the methods of logical inquiry and reasoning. If we review the list of abilities in the preceding section, however, we can see that some of them can be acquired and exercised merely through practice, possibly guided in an educational setting, followed by feedback. Searching intelligently for a causal explanation of some phenomenon or event requires that one consider a full range of possible causal contributors, but it seems more important that one implements this principle in one’s practice than that one is able to articulate it. What is important is “operational knowledge” of the standards and principles of good thinking (Bailin et al. 1999b: 291–293). But the development of such critical thinking abilities as designing an experiment or constructing an operational definition can benefit from learning their underlying theory. Further, explicit knowledge of quirks of human thinking seems useful as a cautionary guide. Human memory is not just fallible about details, as people learn from their own experiences of misremembering, but is so malleable that a detailed, clear and vivid recollection of an event can be a total fabrication (Loftus 2017). People seek or interpret evidence in ways that are partial to their existing beliefs and expectations, often unconscious of their “confirmation bias” (Nickerson 1998). Not only are people subject to this and other cognitive biases (Kahneman 2011), of which they are typically unaware, but it may be counter-productive for one to make oneself aware of them and try consciously to counteract them or to counteract social biases such as racial or sexual stereotypes (Kenyon & Beaulac 2014). It is helpful to be aware of these facts and of the superior effectiveness of blocking the operation of biases—for example, by making an immediate record of one’s observations, refraining from forming a preliminary explanatory hypothesis, blind refereeing, double-blind randomized trials, and blind grading of students’ work.

Critical thinking about an issue requires substantive knowledge of the domain to which the issue belongs. Critical thinking abilities are not a magic elixir that can be applied to any issue whatever by somebody who has no knowledge of the facts relevant to exploring that issue. For example, the student in Bubbles needed to know that gases do not penetrate solid objects like a glass, that air expands when heated, that the volume of an enclosed gas varies directly with its temperature and inversely with its pressure, and that hot objects will spontaneously cool down to the ambient temperature of their surroundings unless kept hot by insulation or a source of heat. Critical thinkers thus need a rich fund of subject-matter knowledge relevant to the variety of situations they encounter. This fact is recognized in the inclusion among critical thinking dispositions of a concern to become and remain generally well informed.

Experimental educational interventions, with control groups, have shown that education can improve critical thinking skills and dispositions, as measured by standardized tests. For information about these tests, see the Supplement on Assessment .

What educational methods are most effective at developing the dispositions, abilities and knowledge of a critical thinker? Abrami et al. (2015) found that in the experimental and quasi-experimental studies that they analyzed dialogue, anchored instruction, and mentoring each increased the effectiveness of the educational intervention, and that they were most effective when combined. They also found that in these studies a combination of separate instruction in critical thinking with subject-matter instruction in which students are encouraged to think critically was more effective than either by itself. However, the difference was not statistically significant; that is, it might have arisen by chance.

Most of these studies lack the longitudinal follow-up required to determine whether the observed differential improvements in critical thinking abilities or dispositions continue over time, for example until high school or college graduation. For details on studies of methods of developing critical thinking skills and dispositions, see the Supplement on Educational Methods .

12. Controversies

Scholars have denied the generalizability of critical thinking abilities across subject domains, have alleged bias in critical thinking theory and pedagogy, and have investigated the relationship of critical thinking to other kinds of thinking.

McPeck (1981) attacked the thinking skills movement of the 1970s, including the critical thinking movement. He argued that there are no general thinking skills, since thinking is always thinking about some subject-matter. It is futile, he claimed, for schools and colleges to teach thinking as if it were a separate subject. Rather, teachers should lead their pupils to become autonomous thinkers by teaching school subjects in a way that brings out their cognitive structure and that encourages and rewards discussion and argument. As some of his critics (e.g., Paul 1985; Siegel 1985) pointed out, McPeck’s central argument needs elaboration, since it has obvious counter-examples in writing and speaking, for which (up to a certain level of complexity) there are teachable general abilities even though they are always about some subject-matter. To make his argument convincing, McPeck needs to explain how thinking differs from writing and speaking in a way that does not permit useful abstraction of its components from the subject-matters with which it deals. He has not done so. Nevertheless, his position that the dispositions and abilities of a critical thinker are best developed in the context of subject-matter instruction is shared by many theorists of critical thinking, including Dewey (1910, 1933), Glaser (1941), Passmore (1980), Weinstein (1990), and Bailin et al. (1999b).

McPeck’s challenge prompted reflection on the extent to which critical thinking is subject-specific. McPeck argued for a strong subject-specificity thesis, according to which it is a conceptual truth that all critical thinking abilities are specific to a subject. (He did not however extend his subject-specificity thesis to critical thinking dispositions. In particular, he took the disposition to suspend judgment in situations of cognitive dissonance to be a general disposition.) Conceptual subject-specificity is subject to obvious counter-examples, such as the general ability to recognize confusion of necessary and sufficient conditions. A more modest thesis, also endorsed by McPeck, is epistemological subject-specificity, according to which the norms of good thinking vary from one field to another. Epistemological subject-specificity clearly holds to a certain extent; for example, the principles in accordance with which one solves a differential equation are quite different from the principles in accordance with which one determines whether a painting is a genuine Picasso. But the thesis suffers, as Ennis (1989) points out, from vagueness of the concept of a field or subject and from the obvious existence of inter-field principles, however broadly the concept of a field is construed. For example, the principles of hypothetico-deductive reasoning hold for all the varied fields in which such reasoning occurs. A third kind of subject-specificity is empirical subject-specificity, according to which as a matter of empirically observable fact a person with the abilities and dispositions of a critical thinker in one area of investigation will not necessarily have them in another area of investigation.

The thesis of empirical subject-specificity raises the general problem of transfer. If critical thinking abilities and dispositions have to be developed independently in each school subject, how are they of any use in dealing with the problems of everyday life and the political and social issues of contemporary society, most of which do not fit into the framework of a traditional school subject? Proponents of empirical subject-specificity tend to argue that transfer is more likely to occur if there is critical thinking instruction in a variety of domains, with explicit attention to dispositions and abilities that cut across domains. But evidence for this claim is scanty. There is a need for well-designed empirical studies that investigate the conditions that make transfer more likely.

It is common ground in debates about the generality or subject-specificity of critical thinking dispositions and abilities that critical thinking about any topic requires background knowledge about the topic. For example, the most sophisticated understanding of the principles of hypothetico-deductive reasoning is of no help unless accompanied by some knowledge of what might be plausible explanations of some phenomenon under investigation.

Critics have objected to bias in the theory, pedagogy and practice of critical thinking. Commentators (e.g., Alston 1995; Ennis 1998) have noted that anyone who takes a position has a bias in the neutral sense of being inclined in one direction rather than others. The critics, however, are objecting to bias in the pejorative sense of an unjustified favoring of certain ways of knowing over others, frequently alleging that the unjustly favoured ways are those of a dominant sex or culture (Bailin 1995). These ways favour:

• reinforcement of egocentric and sociocentric biases over dialectical engagement with opposing world-views (Paul 1981, 1984; Warren 1998)
• distancing from the object of inquiry over closeness to it (Martin 1992; Thayer-Bacon 1992)
• indifference to the situation of others over care for them (Martin 1992)
• orientation to thought over orientation to action (Martin 1992)
• being reasonable over caring to understand people’s ideas (Thayer-Bacon 1993)
• being neutral and objective over being embodied and situated (Thayer-Bacon 1995a)
• doubting over believing (Thayer-Bacon 1995b)
• reason over emotion, imagination and intuition (Thayer-Bacon 2000)
• solitary thinking over collaborative thinking (Thayer-Bacon 2000)
• written and spoken assignments over other forms of expression (Alston 2001)
• attention to written and spoken communications over attention to human problems (Alston 2001)
• winning debates in the public sphere over making and understanding meaning (Alston 2001)

A common thread in this smorgasbord of accusations is dissatisfaction with focusing on the logical analysis and evaluation of reasoning and arguments. While these authors acknowledge that such analysis and evaluation is part of critical thinking and should be part of its conceptualization and pedagogy, they insist that it is only a part. Paul (1981), for example, bemoans the tendency of atomistic teaching of methods of analyzing and evaluating arguments to turn students into more able sophists, adept at finding fault with positions and arguments with which they disagree but even more entrenched in the egocentric and sociocentric biases with which they began. Martin (1992) and Thayer-Bacon (1992) cite with approval the self-reported intimacy with their subject-matter of leading researchers in biology and medicine, an intimacy that conflicts with the distancing allegedly recommended in standard conceptions and pedagogy of critical thinking. Thayer-Bacon (2000) contrasts the embodied and socially embedded learning of her elementary school students in a Montessori school, who used their imagination, intuition and emotions as well as their reason, with conceptions of critical thinking as

thinking that is used to critique arguments, offer justifications, and make judgments about what are the good reasons, or the right answers. (Thayer-Bacon 2000: 127–128)

Alston (2001) reports that her students in a women’s studies class were able to see the flaws in the Cinderella myth that pervades much romantic fiction but in their own romantic relationships still acted as if all failures were the woman’s fault and still accepted the notions of love at first sight and living happily ever after. Students, she writes, should

be able to connect their intellectual critique to a more affective, somatic, and ethical account of making risky choices that have sexist, racist, classist, familial, sexual, or other consequences for themselves and those both near and far… critical thinking that reads arguments, texts, or practices merely on the surface without connections to feeling/desiring/doing or action lacks an ethical depth that should infuse the difference between mere cognitive activity and something we want to call critical thinking. (Alston 2001: 34)

Some critics portray such biases as unfair to women. Thayer-Bacon (1992), for example, has charged modern critical thinking theory with being sexist, on the ground that it separates the self from the object and causes one to lose touch with one’s inner voice, and thus stigmatizes women, who (she asserts) link self to object and listen to their inner voice. Her charge does not imply that women as a group are on average less able than men to analyze and evaluate arguments. Facione (1990c) found no difference by sex in performance on his California Critical Thinking Skills Test. Kuhn (1991: 280–281) found no difference by sex in either the disposition or the competence to engage in argumentative thinking.

The critics propose a variety of remedies for the biases that they allege. In general, they do not propose to eliminate or downplay critical thinking as an educational goal. Rather, they propose to conceptualize critical thinking differently and to change its pedagogy accordingly. Their pedagogical proposals arise logically from their objections. They can be summarized as follows:

• Focus on argument networks with dialectical exchanges reflecting contesting points of view rather than on atomic arguments, so as to develop “strong sense” critical thinking that transcends egocentric and sociocentric biases (Paul 1981, 1984).
• Foster closeness to the subject-matter and feeling connected to others in order to inform a humane democracy (Martin 1992).
• Develop “constructive thinking” as a social activity in a community of physically embodied and socially embedded inquirers with personal voices who value not only reason but also imagination, intuition and emotion (Thayer-Bacon 2000).
• In developing critical thinking in school subjects, treat as important neither skills nor dispositions but opening worlds of meaning (Alston 2001).
• Attend to the development of critical thinking dispositions as well as skills, and adopt the “critical pedagogy” practised and advocated by Freire (1968 [1970]) and hooks (1994) (Dalgleish, Girard, & Davies 2017).

A common thread in these proposals is treatment of critical thinking as a social, interactive, personally engaged activity like that of a quilting bee or a barn-raising (Thayer-Bacon 2000) rather than as an individual, solitary, distanced activity symbolized by Rodin’s The Thinker . One can get a vivid description of education with the former type of goal from the writings of bell hooks (1994, 2010). Critical thinking for her is open-minded dialectical exchange across opposing standpoints and from multiple perspectives, a conception similar to Paul’s “strong sense” critical thinking (Paul 1981). She abandons the structure of domination in the traditional classroom. In an introductory course on black women writers, for example, she assigns students to write an autobiographical paragraph about an early racial memory, then to read it aloud as the others listen, thus affirming the uniqueness and value of each voice and creating a communal awareness of the diversity of the group’s experiences (hooks 1994: 84). Her “engaged pedagogy” is thus similar to the “freedom under guidance” implemented in John Dewey’s Laboratory School of Chicago in the late 1890s and early 1900s. It incorporates the dialogue, anchored instruction, and mentoring that Abrami (2015) found to be most effective in improving critical thinking skills and dispositions.

What is the relationship of critical thinking to problem solving, decision-making, higher-order thinking, creative thinking, and other recognized types of thinking? One’s answer to this question obviously depends on how one defines the terms used in the question. If critical thinking is conceived broadly to cover any careful thinking about any topic for any purpose, then problem solving and decision making will be kinds of critical thinking, if they are done carefully. Historically, ‘critical thinking’ and ‘problem solving’ were two names for the same thing. If critical thinking is conceived more narrowly as consisting solely of appraisal of intellectual products, then it will be disjoint with problem solving and decision making, which are constructive.

Bloom’s taxonomy of educational objectives used the phrase “intellectual abilities and skills” for what had been labeled “critical thinking” by some, “reflective thinking” by Dewey and others, and “problem solving” by still others (Bloom et al. 1956: 38). Thus, the so-called “higher-order thinking skills” at the taxonomy’s top levels of analysis, synthesis and evaluation are just critical thinking skills, although they do not come with general criteria for their assessment (Ennis 1981b). The revised version of Bloom’s taxonomy (Anderson et al. 2001) likewise treats critical thinking as cutting across those types of cognitive process that involve more than remembering (Anderson et al. 2001: 269–270). For details, see the Supplement on History .

As to creative thinking, it overlaps with critical thinking (Bailin 1987, 1988). Thinking about the explanation of some phenomenon or event, as in Ferryboat , requires creative imagination in constructing plausible explanatory hypotheses. Likewise, thinking about a policy question, as in Candidate , requires creativity in coming up with options. Conversely, creativity in any field needs to be balanced by critical appraisal of the draft painting or novel or mathematical theory.

• Abrami, Philip C., Robert M. Bernard, Eugene Borokhovski, David I. Waddington, C. Anne Wade, and Tonje Person, 2015, “Strategies for Teaching Students to Think Critically: A Meta-analysis”, Review of Educational Research , 85(2): 275–314. doi:10.3102/0034654314551063
• Aikin, Wilford M., 1942, The Story of the Eight-year Study, with Conclusions and Recommendations , Volume I of Adventure in American Education , New York and London: Harper & Brothers. [ Aikin 1942 available online ]
• Alston, Kal, 1995, “Begging the Question: Is Critical Thinking Biased?”, Educational Theory , 45(2): 225–233. doi:10.1111/j.1741-5446.1995.00225.x
• –––, 2001, “Re/Thinking Critical Thinking: The Seductions of Everyday Life”, Studies in Philosophy and Education , 20(1): 27–40. doi:10.1023/A:1005247128053
• American Educational Research Association, 2014, Standards for Educational and Psychological Testing / American Educational Research Association, American Psychological Association, National Council on Measurement in Education , Washington, DC: American Educational Research Association.
• Anderson, Lorin W., David R. Krathwohl, Peter W. Airiasian, Kathleen A. Cruikshank, Richard E. Mayer, Paul R. Pintrich, James Raths, and Merlin C. Wittrock, 2001, A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives , New York: Longman, complete edition.
• Bailin, Sharon, 1987, “Critical and Creative Thinking”, Informal Logic , 9(1): 23–30. [ Bailin 1987 available online ]
• –––, 1988, Achieving Extraordinary Ends: An Essay on Creativity , Dordrecht: Kluwer. doi:10.1007/978-94-009-2780-3
• –––, 1995, “Is Critical Thinking Biased? Clarifications and Implications”, Educational Theory , 45(2): 191–197. doi:10.1111/j.1741-5446.1995.00191.x
• Bailin, Sharon and Mark Battersby, 2009, “Inquiry: A Dialectical Approach to Teaching Critical Thinking”, in Juho Ritola (ed.), Argument Cultures: Proceedings of OSSA 09 , CD-ROM (pp. 1–10), Windsor, ON: OSSA. [ Bailin & Battersby 2009 available online ]
• –––, 2016, “Fostering the Virtues of Inquiry”, Topoi , 35(2): 367–374. doi:10.1007/s11245-015-9307-6
• Bailin, Sharon, Roland Case, Jerrold R. Coombs, and Leroi B. Daniels, 1999a, “Common Misconceptions of Critical Thinking”, Journal of Curriculum Studies , 31(3): 269–283. doi:10.1080/002202799183124
• –––, 1999b, “Conceptualizing Critical Thinking”, Journal of Curriculum Studies , 31(3): 285–302. doi:10.1080/002202799183133
• Berman, Alan M., Seth J. Schwartz, William M. Kurtines, and Steven L. Berman, 2001, “The Process of Exploration in Identity Formation: The Role of Style and Competence”, Journal of Adolescence , 24(4): 513–528. doi:10.1006/jado.2001.0386
• Black, Beth (ed.), 2012, An A to Z of Critical Thinking , London: Continuum International Publishing Group.
• Bloom, Benjamin Samuel, Max D. Engelhart, Edward J. Furst, Walter H. Hill, and David R. Krathwohl, 1956, Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , New York: David McKay.
• Casserly, Megan, 2012, “The 10 Skills That Will Get You Hired in 2013”, Forbes , Dec. 10, 2012. Available at https://www.forbes.com/sites/meghancasserly/2012/12/10/the-10-skills-that-will-get-you-a-job-in-2013/#79e7ff4e633d ; accessed 2017 11 06.
• Center for Assessment & Improvement of Learning, 2017, Critical Thinking Assessment Test , Cookeville, TN: Tennessee Technological University.
• Cohen, Jacob, 1988, Statistical Power Analysis for the Behavioral Sciences , Hillsdale, NJ: Lawrence Erlbaum Associates, 2nd edition.
• College Board, 1983, Academic Preparation for College. What Students Need to Know and Be Able to Do , New York: College Entrance Examination Board, ERIC document ED232517.
• Commission on the Relation of School and College of the Progressive Education Association, 1943, Thirty Schools Tell Their Story , Volume V of Adventure in American Education , New York and London: Harper & Brothers.
• Council for Aid to Education, 2017, CLA+ Student Guide . Available at http://cae.org/images/uploads/pdf/CLA_Student_Guide_Institution.pdf ; accessed 2017 09 26.
• Dalgleish, Adam, Patrick Girard, and Maree Davies, 2017, “Critical Thinking, Bias and Feminist Philosophy: Building a Better Framework through Collaboration”, Informal Logic , 37(4): 351–369. [ Dalgleish et al. available online ]
• Dewey, John, 1910, How We Think , Boston: D.C. Heath. [ Dewey 1910 available online ]
• –––, 1916, Democracy and Education: An Introduction to the Philosophy of Education , New York: Macmillan.
• –––, 1933, How We Think: A Restatement of the Relation of Reflective Thinking to the Educative Process , Lexington, MA: D.C. Heath.
• –––, 1936, “The Theory of the Chicago Experiment”, Appendix II of Mayhew & Edwards 1936: 463–477.
• –––, 1938, Logic: The Theory of Inquiry , New York: Henry Holt and Company.
• Dominguez, Caroline (coord.), 2018a, A European Collection of the Critical Thinking Skills and Dispositions Needed in Different Professional Fields for the 21st Century , Vila Real, Portugal: UTAD. Available at http://bit.ly/CRITHINKEDUO1 ; accessed 2018 04 09.
• ––– (coord.), 2018b, A European Review on Critical Thinking Educational Practices in Higher Education Institutions , Vila Real: UTAD. Available at http://bit.ly/CRITHINKEDUO2 ; accessed 2018 04 14.
• Dumke, Glenn S., 1980, Chancellor’s Executive Order 338 , Long Beach, CA: California State University, Chancellor’s Office. Available at https://www.calstate.edu/eo/EO-338.pdf ; accessed 2017 11 16.
• Ennis, Robert H., 1958, “An Appraisal of the Watson-Glaser Critical Thinking Appraisal”, The Journal of Educational Research , 52(4): 155–158. doi:10.1080/00220671.1958.10882558
• –––, 1962, “A Concept of Critical Thinking: A Proposed Basis for Research on the Teaching and Evaluation of Critical Thinking Ability”, Harvard Educational Review , 32(1): 81–111.
• –––, 1981a, “A Conception of Deductive Logical Competence”, Teaching Philosophy , 4(3/4): 337–385. doi:10.5840/teachphil198143/429
• –––, 1981b, “Eight Fallacies in Bloom’s Taxonomy”, in C. J. B. Macmillan (ed.), Philosophy of Education 1980: Proceedings of the Thirty-seventh Annual Meeting of the Philosophy of Education Society , Bloomington, IL: Philosophy of Education Society, pp. 269–273.
• –––, 1984, “Problems in Testing Informal Logic, Critical Thinking, Reasoning Ability”. Informal Logic , 6(1): 3–9. [ Ennis 1984 available online ]
• –––, 1987, “A Taxonomy of Critical Thinking Dispositions and Abilities”, in Joan Boykoff Baron and Robert J. Sternberg (eds.), Teaching Thinking Skills: Theory and Practice , New York: W. H. Freeman, pp. 9–26.
• –––, 1989, “Critical Thinking and Subject Specificity: Clarification and Needed Research”, Educational Researcher , 18(3): 4–10. doi:10.3102/0013189X018003004
• –––, 1991, “Critical Thinking: A Streamlined Conception”, Teaching Philosophy , 14(1): 5–24. doi:10.5840/teachphil19911412
• –––, 1996, “Critical Thinking Dispositions: Their Nature and Assessability”, Informal Logic , 18(2–3): 165–182. [ Ennis 1996 available online ]
• –––, 1998, “Is Critical Thinking Culturally Biased?”, Teaching Philosophy , 21(1): 15–33. doi:10.5840/teachphil19982113
• –––, 2011, “Critical Thinking: Reflection and Perspective Part I”, Inquiry: Critical Thinking across the Disciplines , 26(1): 4–18. doi:10.5840/inquiryctnews20112613
• –––, 2013, “Critical Thinking across the Curriculum: The Wisdom CTAC Program”, Inquiry: Critical Thinking across the Disciplines , 28(2): 25–45. doi:10.5840/inquiryct20132828
• –––, 2016, “Definition: A Three-Dimensional Analysis with Bearing on Key Concepts”, in Patrick Bondy and Laura Benacquista (eds.), Argumentation, Objectivity, and Bias: Proceedings of the 11th International Conference of the Ontario Society for the Study of Argumentation (OSSA), 18–21 May 2016 , Windsor, ON: OSSA, pp. 1–19. Available at http://scholar.uwindsor.ca/ossaarchive/OSSA11/papersandcommentaries/105 ; accessed 2017 12 02.
• –––, 2018, “Critical Thinking Across the Curriculum: A Vision”, Topoi , 37(1): 165–184. doi:10.1007/s11245-016-9401-4
• Ennis, Robert H., and Jason Millman, 1971, Manual for Cornell Critical Thinking Test, Level X, and Cornell Critical Thinking Test, Level Z , Urbana, IL: Critical Thinking Project, University of Illinois.
• Ennis, Robert H., Jason Millman, and Thomas Norbert Tomko, 1985, Cornell Critical Thinking Tests Level X & Level Z: Manual , Pacific Grove, CA: Midwest Publication, 3rd edition.
• –––, 2005, Cornell Critical Thinking Tests Level X & Level Z: Manual , Seaside, CA: Critical Thinking Company, 5th edition.
• Ennis, Robert H. and Eric Weir, 1985, The Ennis-Weir Critical Thinking Essay Test: Test, Manual, Criteria, Scoring Sheet: An Instrument for Teaching and Testing , Pacific Grove, CA: Midwest Publications.
• Facione, Peter A., 1990a, Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction , Research Findings and Recommendations Prepared for the Committee on Pre-College Philosophy of the American Philosophical Association, ERIC Document ED315423.
• –––, 1990b, California Critical Thinking Skills Test, CCTST – Form A , Millbrae, CA: The California Academic Press.
• –––, 1990c, The California Critical Thinking Skills Test--College Level. Technical Report #3. Gender, Ethnicity, Major, CT Self-Esteem, and the CCTST , ERIC Document ED326584.
• –––, 1992, California Critical Thinking Skills Test: CCTST – Form B, Millbrae, CA: The California Academic Press.
• –––, 2000, “The Disposition Toward Critical Thinking: Its Character, Measurement, and Relationship to Critical Thinking Skill”, Informal Logic , 20(1): 61–84. [ Facione 2000 available online ]
• Facione, Peter A. and Noreen C. Facione, 1992, CCTDI: A Disposition Inventory , Millbrae, CA: The California Academic Press.
• Facione, Peter A., Noreen C. Facione, and Carol Ann F. Giancarlo, 2001, California Critical Thinking Disposition Inventory: CCTDI: Inventory Manual , Millbrae, CA: The California Academic Press.
• Facione, Peter A., Carol A. Sánchez, and Noreen C. Facione, 1994, Are College Students Disposed to Think? , Millbrae, CA: The California Academic Press. ERIC Document ED368311.
• Fisher, Alec, and Michael Scriven, 1997, Critical Thinking: Its Definition and Assessment , Norwich: Centre for Research in Critical Thinking, University of East Anglia.
• Freire, Paulo, 1968 [1970], Pedagogia do Oprimido . Translated as Pedagogy of the Oppressed , Myra Bergman Ramos (trans.), New York: Continuum, 1970.
• Glaser, Edward Maynard, 1941, An Experiment in the Development of Critical Thinking , New York: Bureau of Publications, Teachers College, Columbia University.
• Halpern, Diane F., 1998, “Teaching Critical Thinking for Transfer Across Domains: Disposition, Skills, Structure Training, and Metacognitive Monitoring”, American Psychologist , 53(4): 449–455. doi:10.1037/0003-066X.53.4.449
• –––, 2016, Manual: Halpern Critical Thinking Assessment , Mödling, Austria: Schuhfried. Available at https://drive.google.com/file/d/0BzUoP_pmwy1gdEpCR05PeW9qUzA/view ; accessed 2017 12 01.
• Hamby, Benjamin, 2014, The Virtues of Critical Thinkers , Doctoral dissertation, Philosophy, McMaster University. [ Hamby 2014 available online ]
• –––, 2015, “Willingness to Inquire: The Cardinal Critical Thinking Virtue”, in Martin Davies and Ronald Barnett (eds.), The Palgrave Handbook of Critical Thinking in Higher Education , New York: Palgrave Macmillan, pp. 77–87.
• Haynes, Ada, Elizabeth Lisic, Kevin Harris, Katie Leming, Kyle Shanks, and Barry Stein, 2015, “Using the Critical Thinking Assessment Test (CAT) as a Model for Designing Within-Course Assessments: Changing How Faculty Assess Student Learning”, Inquiry: Critical Thinking Across the Disciplines , 30(3): 38–48. doi:10.5840/inquiryct201530316
• Hitchcock, David, 2017, “Critical Thinking as an Educational Ideal”, in his On Reasoning and Argument: Essays in Informal Logic and on Critical Thinking , Dordrecht: Springer, pp. 477–497. doi:10.1007/978-3-319-53562-3_30
• hooks, bell, 1994, Teaching to Transgress: Education as the Practice of Freedom , New York and London: Routledge.
• –––, 2010, Teaching Critical Thinking: Practical Wisdom , New York and London: Routledge.
• Johnson, Ralph H., 1992, “The Problem of Defining Critical Thinking”, in Stephen P, Norris (ed.), The Generalizability of Critical Thinking , New York: Teachers College Press, pp. 38–53.
• Kahane, Howard, 1971, Logic and Contemporary Rhetoric: The Use of Reason in Everyday Life , Belmont, CA: Wadsworth.
• Kahneman, Daniel, 2011, Thinking, Fast and Slow , New York: Farrar, Straus and Giroux.
• Kenyon, Tim, and Guillaume Beaulac, 2014, “Critical Thinking Education and Debasing”, Informal Logic , 34(4): 341–363. [ Kenyon & Beaulac 2014 available online ]
• Krathwohl, David R., Benjamin S. Bloom, and Bertram B. Masia, 1964, Taxonomy of Educational Objectives, Handbook II: Affective Domain , New York: David McKay.
• Kuhn, Deanna, 1991, The Skills of Argument , New York: Cambridge University Press. doi:10.1017/CBO9780511571350
• Lipman, Matthew, 1987, “Critical Thinking–What Can It Be?”, Analytic Teaching , 8(1): 5–12. [ Lipman 1987 available online ]
• Loftus, Elizabeth F., 2017, “Eavesdropping on Memory”, Annual Review of Psychology , 68: 1–18. doi:10.1146/annurev-psych-010416-044138
• Martin, Jane Roland, 1992, “Critical Thinking for a Humane World”, in Stephen P. Norris (ed.), The Generalizability of Critical Thinking , New York: Teachers College Press, pp. 163–180.
• Mayhew, Katherine Camp, and Anna Camp Edwards, 1936, The Dewey School: The Laboratory School of the University of Chicago, 1896–1903 , New York: Appleton-Century. [ Mayhew & Edwards 1936 available online ]
• McPeck, John E., 1981, Critical Thinking and Education , New York: St. Martin’s Press.
• Nickerson, Raymond S., 1998, “Confirmation Bias: A Ubiquitous Phenomenon in Many Guises”, Review of General Psychology , 2(2): 175–220. doi:10.1037/1089-2680.2.2.175
• Nieto, Ana Maria, and Jorge Valenzuela, 2012, “A Study of the Internal Structure of Critical Thinking Dispositions”, Inquiry: Critical Thinking across the Disciplines , 27(1): 31–38. doi:10.5840/inquiryct20122713
• Norris, Stephen P., 1985, “Controlling for Background Beliefs When Developing Multiple-choice Critical Thinking Tests”, Educational Measurement: Issues and Practice , 7(3): 5–11. doi:10.1111/j.1745-3992.1988.tb00437.x
• Norris, Stephen P. and Robert H. Ennis, 1989, Evaluating Critical Thinking (The Practitioners’ Guide to Teaching Thinking Series), Pacific Grove, CA: Midwest Publications.
• Norris, Stephen P. and Ruth Elizabeth King, 1983, Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland.
• –––, 1984, The Design of a Critical Thinking Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland. ERIC Document ED260083.
• –––, 1985, Test on Appraising Observations: Manual , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland.
• –––, 1990a, Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland, 2nd edition.
• –––, 1990b, Test on Appraising Observations: Manual , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland, 2nd edition.
• Obama, Barack, 2014, State of the Union Address , January 28, 2014. [ Obama 2014 available online ]
• OCR [Oxford, Cambridge and RSA Examinations], 2011, AS/A Level GCE: Critical Thinking – H052, H452 , Cambridge: OCR. Information available at http://www.ocr.org.uk/qualifications/as-a-level-gce-critical-thinking-h052-h452/ ; accessed 2017 10 12.
• OECD [Organization for Economic Cooperation and Development] Centre for Educational Research and Innovation, 2018, Fostering and Assessing Students’ Creative and Critical Thinking Skills in Higher Education , Paris: OECD. Available at http://www.oecd.org/education/ceri/Fostering-and-assessing-students-creative-and-critical-thinking-skills-in-higher-education.pdf ; accessed 2018 04 22.
• Ontario Ministry of Education, 2013, The Ontario Curriculum Grades 9 to 12: Social Sciences and Humanities . Available at http://www.edu.gov.on.ca/eng/curriculum/secondary/ssciences9to122013.pdf ; accessed 2017 11 16.
• Passmore, John Arthur, 1980, The Philosophy of Teaching , London: Duckworth.
• Paul, Richard W., 1981, “Teaching Critical Thinking in the ‘Strong’ Sense: A Focus on Self-Deception, World Views, and a Dialectical Mode of Analysis”, Informal Logic , 4(2): 2–7. [ Paul 1981 available online ]
• –––, 1984, “Critical Thinking: Fundamental to Education for a Free Society”, Educational Leadership , 42(1): 4–14.
• –––, 1985, “McPeck’s Mistakes”, Informal Logic , 7(1): 35–43. [ Paul 1985 available online ]
• Paul, Richard W. and Linda Elder, 2006, The Miniature Guide to Critical Thinking: Concepts and Tools , Dillon Beach, CA: Foundation for Critical Thinking, 4th edition.
• Payette, Patricia, and Edna Ross, 2016, “Making a Campus-Wide Commitment to Critical Thinking: Insights and Promising Practices Utilizing the Paul-Elder Approach at the University of Louisville”, Inquiry: Critical Thinking Across the Disciplines , 31(1): 98–110. doi:10.5840/inquiryct20163118
• Possin, Kevin, 2008, “A Field Guide to Critical-Thinking Assessment”, Teaching Philosophy , 31(3): 201–228. doi:10.5840/teachphil200831324
• –––, 2013a, “Some Problems with the Halpern Critical Thinking Assessment (HCTA) Test”, Inquiry: Critical Thinking across the Disciplines , 28(3): 4–12. doi:10.5840/inquiryct201328313
• –––, 2013b, “A Serious Flaw in the Collegiate Learning Assessment (CLA) Test”, Informal Logic , 33(3): 390–405. [ Possin 2013b available online ]
• –––, 2014, “Critique of the Watson-Glaser Critical Thinking Appraisal Test: The More You Know, the Lower Your Score”, Informal Logic , 34(4): 393–416. [ Possin 2014 available online ]
• Rawls, John, 1971, A Theory of Justice , Cambridge, MA: Harvard University Press.
• Rousseau, Jean-Jacques, 1762, Émile , Amsterdam: Jean Néaulme.
• Scheffler, Israel, 1960, The Language of Education , Springfield, IL: Charles C. Thomas.
• Scriven, Michael, and Richard W. Paul, 1987, Defining Critical Thinking , Draft statement written for the National Council for Excellence in Critical Thinking Instruction. Available at http://www.criticalthinking.org/pages/defining-critical-thinking/766 ; accessed 2017 11 29.
• Sheffield, Clarence Burton Jr., 2018, “Promoting Critical Thinking in Higher Education: My Experiences as the Inaugural Eugene H. Fram Chair in Applied Critical Thinking at Rochester Institute of Technology”, Topoi , 37(1): 155–163. doi:10.1007/s11245-016-9392-1
• Siegel, Harvey, 1985, “McPeck, Informal Logic and the Nature of Critical Thinking”, in David Nyberg (ed.), Philosophy of Education 1985: Proceedings of the Forty-First Annual Meeting of the Philosophy of Education Society , Normal, IL: Philosophy of Education Society, pp. 61–72.
• –––, 1988, Educating Reason: Rationality, Critical Thinking, and Education , New York: Routledge.
• –––, 1999, “What (Good) Are Thinking Dispositions?”, Educational Theory , 49(2): 207–221. doi:10.1111/j.1741-5446.1999.00207.x
• Simpson, Elizabeth, 1966–67, “The Classification of Educational Objectives: Psychomotor Domain”, Illinois Teacher of Home Economics , 10(4): 110–144, ERIC document ED0103613. [ Simpson 1966–67 available online ]
• Skolverket, 2011, Curriculum for the Compulsory School, Preschool Class and the Recreation Centre , Stockholm: Ordförrådet AB. Available at http://malmo.se/download/18.29c3b78a132728ecb52800034181/pdf2687.pdf ; accessed 2017 11 16.
• Smith, B. Othanel, 1953, “The Improvement of Critical Thinking”, Progressive Education , 30(5): 129–134.
• Smith, Eugene Randolph, Ralph Winfred Tyler, and the Evaluation Staff, 1942, Appraising and Recording Student Progress , Volume III of Adventure in American Education , New York and London: Harper & Brothers.
• Splitter, Laurance J., 1987, “Educational Reform through Philosophy for Children”, Thinking: The Journal of Philosophy for Children , 7(2): 32–39. doi:10.5840/thinking1987729
• Stanovich Keith E., and Paula J. Stanovich, 2010, “A Framework for Critical Thinking, Rational Thinking, and Intelligence”, in David D. Preiss and Robert J. Sternberg (eds), Innovations in Educational Psychology: Perspectives on Learning, Teaching and Human Development , New York: Springer Publishing, pp 195–237.
• Stanovich Keith E., Richard F. West, and Maggie E. Toplak, 2011, “Intelligence and Rationality”, in Robert J. Sternberg and Scott Barry Kaufman (eds.), Cambridge Handbook of Intelligence , Cambridge: Cambridge University Press, 3rd edition, pp. 784–826. doi:10.1017/CBO9780511977244.040
• Tankersley, Karen, 2005, Literacy Strategies for Grades 4–12: Reinforcing the Threads of Reading , Alexandria, VA: Association for Supervision and Curriculum Development.
• Thayer-Bacon, Barbara J., 1992, “Is Modern Critical Thinking Theory Sexist?”, Inquiry: Critical Thinking Across the Disciplines , 10(1): 3–7. doi:10.5840/inquiryctnews199210123
• –––, 1993, “Caring and Its Relationship to Critical Thinking”, Educational Theory , 43(3): 323–340. doi:10.1111/j.1741-5446.1993.00323.x
• –––, 1995a, “Constructive Thinking: Personal Voice”, Journal of Thought , 30(1): 55–70.
• –––, 1995b, “Doubting and Believing: Both are Important for Critical Thinking”, Inquiry: Critical Thinking across the Disciplines , 15(2): 59–66. doi:10.5840/inquiryctnews199515226
• –––, 2000, Transforming Critical Thinking: Thinking Constructively , New York: Teachers College Press.
• Toulmin, Stephen Edelston, 1958, The Uses of Argument , Cambridge: Cambridge University Press.
• Turri, John, Mark Alfano, and John Greco, 2017, “Virtue Epistemology”, in Edward N. Zalta (ed.), The Stanford Encyclopedia of Philosophy (Winter 2017 Edition). URL = < https://plato.stanford.edu/archives/win2017/entries/epistemology-virtue/ >
• Warren, Karen J. 1988. “Critical Thinking and Feminism”, Informal Logic , 10(1): 31–44. [ Warren 1988 available online ]
• Watson, Goodwin, and Edward M. Glaser, 1980a, Watson-Glaser Critical Thinking Appraisal, Form A , San Antonio, TX: Psychological Corporation.
• –––, 1980b, Watson-Glaser Critical Thinking Appraisal: Forms A and B; Manual , San Antonio, TX: Psychological Corporation,
• –––, 1994, Watson-Glaser Critical Thinking Appraisal, Form B , San Antonio, TX: Psychological Corporation.
• Weinstein, Mark, 1990, “Towards a Research Agenda for Informal Logic and Critical Thinking”, Informal Logic , 12(3): 121–143. [ Weinstein 1990 available online ]
• –––, 2013, Logic, Truth and Inquiry , London: College Publications.
• Zagzebski, Linda Trinkaus, 1996, Virtues of the Mind: An Inquiry into the Nature of Virtue and the Ethical Foundations of Knowledge , Cambridge: Cambridge University Press. doi:10.1017/CBO9781139174763

How to cite this entry . Preview the PDF version of this entry at the Friends of the SEP Society . Look up this entry topic at the Internet Philosophy Ontology Project (InPhO). Enhanced bibliography for this entry at PhilPapers , with links to its database.

• Association for Informal Logic and Critical Thinking (AILACT)
• Center for Teaching Thinking (CTT)
• Critical Thinking Across the European Higher Education Curricula (CRITHINKEDU)
• Critical Thinking Definition, Instruction, and Assessment: A Rigorous Approach (criticalTHINKING.net)
• Critical Thinking Research (RAIL)
• Foundation for Critical Thinking
• Insight Assessment
• Partnership for 21st Century Learning (P21)
• The Critical Thinking Consortium
• The Nature of Critical Thinking: An Outline of Critical Thinking Dispositions and Abilities , by Robert H. Ennis

abilities | bias, implicit | children, philosophy for | civic education | decision-making capacity | Dewey, John | dispositions | education, philosophy of | epistemology: virtue | logic: informal

Copyright © 2018 by David Hitchcock < hitchckd @ mcmaster . ca >

Support SEP

Mirror sites.

View this site from another server:

• Info about mirror sites

The Stanford Encyclopedia of Philosophy is copyright © 2016 by The Metaphysics Research Lab , Center for the Study of Language and Information (CSLI), Stanford University

Library of Congress Catalog Data: ISSN 1095-5054

The effect of a STEM integrated curriculum on design thinking dispositions in middle school students

• Published: 13 April 2024

Cite this article

• Dina Thomason   ORCID: orcid.org/0000-0002-4275-7912 1 &
• Pei-Ling Hsu   ORCID: orcid.org/0000-0002-1870-5717 1  

STEM, the integration of science, technology, engineering, and mathematics subjects is a popular topic as schools grapple with how to best prepare students for an ever-evolving society. As societal and technological challenges emerge, design thinking has been lauded as a method to enable people to help tackle those challenges. The steps of the design thinking process, empathize, define, ideate, prototype and test align with engineering design and can be used as a problem-solving method in classrooms to help promote creativity, critical thinking, and collaboration. The purpose of this explanatory sequential mixed methods study was to better understand if a STEM integrated curriculum helps promote design thinking in middle schoolers. The study compared two middle school groups, one that uses an integrated STEM curriculum and one that does not. Quantitative data was collected using the design thinking disposition survey through pre and post testing. Qualitative data was collected through free response questions and student and teacher interviews. There was no difference found in the change of design thinking dispositions between students at the two schools, however both groups scored lowest on the design thinking disposition of prototype. Free response questions showed that students at the STEM integrated school perceived an increased ability to design solutions to problems. Student and teacher interviews highlighted benefits of using a STEM integrated curriculum including providing collaborative opportunities to solve hands-on, open-ended problems. How a STEM integrated curriculum can develop design thinking should continue to be examined.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Adams, E. L. (2021). The effect of a middle grades STEM initiative on students’ cognitive and noncognitive outcomes. Studies in Educational Evaluation , 68 . https://doi.org/10.1016/j.stueduc.2021.100983 .

Aldemir, J., & Kermani, H. (2017). Integrated STEM curriculum: Improving educational outcomes for Head Start children. Early Childhood Development and Care , 187 (11), 1694–1706. https://doi.org/10.1080.03004430.2016.1185102.

Article   Google Scholar  

Amir, N. (2020). Strengthening the science-D&T interaction through simple maker centered projects in a Singapore classroom. Physics Education , 55 (4). https://doi.org/10.1088/1361-6552/ab9212 .

Arık, M., & Topçu, M. S. (2022). Implementation of engineering design process in the K-12 science classrooms: Trends and issues. Research in Science Education , 52 , 21–43. https://doi.org/10.1007/s11165-019-09912-x .

Avcu, Y. E., & Er, K. O. (2020). Developing an instructional design for the field of ict and software for gifted and talented students. International Journal of Educational Methodology , 6 (1), 161–183. https://doi.org/10.12973/ijem.6.1.161 .

Awad, N. (2023). Exploring STEM integration: Assessing the effectiveness of an interdisciplinary informal program in fostering students’ performance and inspiration. Research in Science & Technological Education , 41 (2), 679–699. https://doi.org/10.1080/02635143.2021.1931832 .

Baran, E., Bilici, S. C., Mesutoglu, C., & Ocak, C. (2019). The impact of an out-of-school STEM education program on students’ attitudes toward STEM and STEM careers. School Science and Mathematics , 119 , 223–235. https://doi.org/10.1111.ssm.12330.

Bartholomew, S. R., & Strimel, G. J. (2018). Factors influencing student success on open-ended design problems. International Journal of Technology and Design Education , 28 , 753–770. https://doi.org/10.1007/s10798-017-9415-2 .

Bond, L. (2007). My child doesn’t test well. The Carnegie Foundation for the Advancement of Teaching. Retrieved from https://files.eric.ed.gov/fulltext/ED498967.pdf .

Boone, H. N., & Boone, D. A. (2012). Analyzing likert data. The Journal of Extension , 50 (2). https://doi.org/10.34068/joe.50.02.48 . Article 48.

Brown, T. J. (2008). June). Design thinking. Harvard Business Review , 86 , 84–92. Google Scholar | Medline | ISI.

Google Scholar  

Brown, T., & Katz, B. (2009). Change by design: How design thinking transforms organizations and inspires innovation . HarperCollins.

Chan, H., Choi, H., Hailu, M. F., Whitford, M., & Duplechain DeRouen, S. (2020). Participation in structured STEM-focused out‐of‐school time programs in secondary school: Linkage to postsecondary STEM aspiration and major. Journal of Research in Science Teaching , 57 (8), 1250–1280. https://doi.org/10.1002/tea.21629 .

Chin, C., & Chia, L. G. (2006). Problem-based learning: Using ill-structured problems in biology project work. Science Education , 90 (1), 44–67. https://doi.org/10.1002/sce.20097 .

Chiu, M. H., & Krajcik, J. (2020). Reflections on Integrated approaches to STEM Education: An International Perspective. In J. Anderson, & Y. Li (Eds.), Integrated approaches to STEM education. Advances in STEM education . Springer. https://doi-org.utep.idm https://doi.org/10.1007/978-3-030-52229-2_29 .

Christensen, K. S., Hjorth, M., Iversen, O. S., & Smith, R. C. (2019). Understanding design literacy in middle-school education: Assessing students’ stances towards inquiry. International Journal of Technology and Design Education , 29 , 633–654. https://doi.org/10.1007/s10798-018-9459-y .

Crawford, B. A., Krajcik, J. S., & Marx, R. W. (1999). Elements of a community of learners in a middle school science classroom. Science Education , 83 , 701–723. https://doi.org/10.1002/(SICI)1098-237X(199911)83:6<701::AID-SCE4>3.0.CO;2-2 .

Cresswell, J. W., & Guetterman, T. C. (2019). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (6th ed.). Pearson.

Cresswell, J., & Plano Clark, V. (2018). Designing and conducting mixed methods research. 3rd Edition. SAGE.

Dare, E. A., Keratithamkul, K., Hiwatig, B. M., & Li, F. (2021). Beyond content: The role of STEM disciplines, real-world problems, 21st century skills, and STEM careers within science teachers’ conceptions of integrated STEM education. Education Sciences , 11 , 737. https://doi.org/10.3390/educsci11110737 .

Davey, J. W., Gugiu, P. C., & Coryn, C. L. S. (2010). Quantitative methods for estimating the reliability of qualitative data. Journal of MultiDisciplinary Evaluation , 6 (13), 140–162. https://doi.org/10.56645/jmde.v6i13.266 .

Dewey, J. (2007). Experience and education . Free.

Dosi, C., Rosati, F., & Vignoli, M. (2018). Measuring design thinking mindset. International Design Conference-2018 . https://doi.org/10.21278/idc.2018.0493 .

English, L. D., & King, D. T. (2015). STEM learning through engineering design: Fourth grade students’ investigations in aerospace. International Journal in STEM Education , 2 (14). https://doi.org/10.1186/240594-015-0027-7 .

Ericson, J. D. (2021). Mapping the relationship between critical thinking and design thinking. Journal of the Knowledge Economy . https://doi.org/10.1007/s13132-021-00733-w .

Falco, L. (2020). An intervention to support mathematics self-efficacy in middle school. In L. M. Harrison, E. Hurd, & K. Brinegar (Eds.), Integrative and interdisciplinary curriculum in the middle school: Integrated approaches in teacher preparation and practice (pp. 37–67). Routledge.

Fan, S-C., Yu, K-C., & Lou, S-J. (2018). Why do students present different design objectives in engineering design projects? International Journal of Technology and Design Education , 28 (4), 1039–1060. https://doi.org/10.1007/s10798-017-9420-5 .

Forbes, A., Falloon, G., Stevenson, M., Hatzigianni, M., & Bower, M. (2021). An analysis of the nature of young students’ STEM learning in 3D technology-enhanced makerspaces. Early Education and Development , 32 (1), 172–187.

Frykholm, J., & Glasson, G. (2010). Connecting science and mathematics instruction: Pedagogical context knowledge for teachers. School Science & Mathematics , 105 (3), 127–141. https://doi.org/10.1111/j.1949-8594.2005.tb18047.x .

Furner, J. M., & Kumar, D. D. (2007). The mathematics and science integration argument: A stand for teacher education. Eurasia Journal for Mathematics Science and Technology Education , 3 (3), 185–189. https://doi.org/10.12973/ejmste/75397 .

Fusch, P. I., & Ness, L. R. (2015). Are we there yet? Data saturation in qualitative research. Walden Faculty and Staff Publications 455. https://scholarworks.waldenu.edu/facpubs/455 .

Goldman, S., & Kabayadondo, Z. (Eds.). (2017). Taking design thinking to school . Routledge.

Goldman, S., Zielezinski, M. B., Vea, T., Bachas-Daunert, S., & Kabayadondo, Z. (2017). Capturing middle school students’ understandings of design thinking. In S. Goldman & Z. Kabayadondo (Eds.) Taking Design Thinking to School (pp. 94–111). Routledge. https://doi.org/10.4324/9781317327585-14 .

Goldstein, M. H. (2018). Characterizing trade-off decisions in student designers (Order No. 10840585). Available from ProQuest Dissertations & Theses Global. (2102578313). https://utep.idm.oclc.org/login?url=https://www.proquest.com/dissertations-theses/characterizing-trade-off-decisions-student/docview/2102578313/se-2 .

Guzey, S. S., & Li, W. (2023). Engagement and science achievement in the context of integrated STEM education: A longitudinal study. Journal of Science Education and Technology , 32 (2), 168–180. https://doi.org/10.1007/s10956-022-10023-y .

Gwangwava, N. (2021). Learning design thinking through a hands-on learning model. International Journal of Innovative Teaching and Learning in Higher Education (IJITLHE) , 2 (1), 1–19. https://doi.org/10.4018/IJITLHE.20210101.oa4 .

Haimovitz, K., & Dweck, C. S. (2017). The origins of children’s growth and fixed mindsets: New Research and a new proposal. Child Development , 88 (6), 1849–1859. https://doi.org/10.1111/cdev.12955 .

Hallström, J., & Ankiewicz, P. (2023). Design as the basis for integrated STEM education: A philosophical framework. Frontiers in Education (Lausanne) , 8 . https://doi.org/10.3389/feduc.2023.1078313 .

Hayes, J. C., & Kraemer, D. J. M. (2017). Grounded understanding of abstract concepts: The case of STEM learning. Cognitive Research: Principles and Implications , 2 , 7. https://doi.org/10.1186/s41235-016-0046-z .

He, X., Li, T., Turel, O., Kuang, Y., Zhao, H., & He, Q. (2021). The impact of STEM education on mathematical development in children aged 5–6 years. International Journal of Education Research , 109 . https://doi.org/10.1016/j.ijer.2021.101795 .

Hiğde, E., & Aktamış, H. (2022). The effects of STEM activities on students’ STEM career interests, motivation, science process skills, science achievement and views. Thinking Skills and Creativity , 43. https://doi.org/10.1016/j.tsc.2022.101000 .

Holthius, N., Deutscher, R., Schultz, S. E., & Jamshidi, A. (2018). The New NGSS classroom: A curriculum framework for project-based science learning. American Educator , 42 (2), 23–27. https://link.gale.com/apps/doc/A543900497/OVIC?u=txshracd2603 &sid=bookmark-OVIC&xid=215b1271.

Hou, H. I., & Lien, W. C. (2022). Students’ critical thinking skills in an interactive EMI learning context: Combining experiential learning and reflective practices. ICFAI Journal of English Studies , 17 (2), 60–72.

Hung, W., Jonassen, D. H., & Liu, R. (2007). Problem-based learning. In J. M. Spector, M. D. Merrill, van J. Merrienboer, & M. P. Driscoll (Eds.), Handbook of Research on Educational Communications and Technology 1 (pp. 485–506). Lawrence Erlbaum Associates.

IDEO (2023). Design thinking for educators. https://designthinking.ideo.com/resources/design-thinking-for-educators .

International Technology and Engineering Educators Association (2020). Standards for technological and engineering literacy: The role of technology and engineering in STEM education. https://www.iteea.org/STEL.aspx .

Isabell, T., & Mentzer, N. (2022). Three tools for teaching design in your classroom: Monday morning ready. The Technology Teacher , 82 (1), 18–21.

Kang, H., Calabrese Barton, A., Tan, E., Simpkins, S. D., Rhee, H., & Turner, C. (2019). How do middle school girls of color develop STEM identities? Middle school girls’ participation in science activities and identification with STEM careers. Science Education , 103 , 418–439. https://doi.org/10.1002/sce.21492 .

Kelley, T. R., & Sung, E. (2017). Sketching by design: Teaching sketching to young learners. International Journal of Technology and Design Education , 27 , 363–386. https://doi.org/10.1007/s10798-016-9354-3 .

Koh, J. H. L., Chai, C. S., Wong, B., & Hong, H. Y. (2015). Design thinking and education. Design thinking for education: Conceptions and application in teaching and learning . Springer.

Kolb, D. A. (1984). Experiential learning: Experience as the source of Learning and Development . Prentice Hall.

Kress, U., & Kimmerle, J. (2018). Collective knowledge construction. In International Handbook of the Learning Sciences (1st Ed., pp. 137–146). Routledge. https://doi.org/10.4324/9781315617572-14 .

Ladachart, L., Cholsin, J., Kwanpet, S., Teerapanpong, R., Dessi, A., Phuangsuwan, L., & Phothong, W. (2022). Ninth-grade students’ perceptions on the design-thinking mindset in the context of reverse engineering. International Journal of Technology and Design Education , 32 (5), 2445–2465. https://doi.org/10.1007/s10798-021-09701-6 .

Lee, H., & Blanchard, M. R. (2019). Why teach with PBL? Motivational factors underlying middle and high school teachers’ use of problem-based learning. Interdisciplinary Journal of Problem-Based Learning , 13 (1). https://doi.org/10.7771/1541-5015.1719 .

Leech, N. L., & Onwuegbuzie, A. J. (2007). An array of qualitative data analysis tools: A call for data analysis triangulation. School Psychology Quarterly , 22 (4), 557–584. https://doi.org/10.1037/1045-3830.22.4.557 .

Lester, J. N., Cho, Y., & Lochmiller, C. R. (2020). Learning to do qualitative data analysis: A starting point. Human Resource Development Review , 19 (1), 94–106. https://doi.org/10.1177/1534484320903890 .

Li, Y., Schoenfeld, A. H., diSessa, A. A., Graesser, A. C., Benson, L. C., English, L. D., & Duschl, R. A. (2019). Design and design thinking in STEM education. Journal for STEM Education Research , 2 (2), 93–104. https://doi.org/10.1007/s41979-019-00020-z .

Liedtka, J. (2014). Innovative ways companies are using design thinking. Strategy & Leadership , 42 (2), 40–45. https://doi.org/10.1108/SL-01-2014-0004 .

Lin, L., Shadiev, R., Hwang, W. Y., & Shen, S. (2020). From knowledge and skills to digital works: An application of design thinking in the information technology course. Thinking Skills and Creativity , 36 , 100646. https://doi.org/10.1016/j.tsc.2020.100646 .

Loes, C. N., & Pascarella, E. T. (2017). Collaborative learning and critical thinking: Testing the link. The Journal of Higher Education , 88 (5), 726–753. https://doi.org/10.1080/00221546.2017.1291257 .

Lofgran, B. B., Smith, L. K., & Whiting, E. F. (2015). Science self-efficacy and school transitions. School Science and Mathematics , 115 , 366–376. https://doi.org/10.1111/ssm.12139 .

Lord, K. C. (2019). Flexible learning: The design thinking process as a K-12 educational tool. Journal of Higher Education Thinking and Practice , 19 (7), 54–61. https://doi.org/10.33423/jhetp.v19i7.2531 .

Luchs, M. G. (2015). A brief introduction to design thinking. In Design Thinking (eds M.G. Luchs, K.S. Swan and A. Griffin). https://doi.org/10.1002/9781119154273.ch1 .

Maiorca, C., Roberts, T., Jackson, C., et al. (2021). Informal learning environments and impact on interest in STEM careers. International Journal of Science and Math Education , 19 , 45–64. https://doi.org/10.1007/s10763-019-10038-9 .

Marks, J. (2017). The impact of a brief design thinking intervention on students’ design knowledge, iterative dispositions, and attitudes towards failure . ProQuest Dissertations Publishing.

Marks, J., & Chase, C. C. (2019). Impact of a prototyping intervention on middle school students’ iterative practices and reactions to failure. Journal of Engineering , Education108 (4), 547–573. https://doi.org/10.1002/jee.20294 .

Marra, R., Jonassen, D. H., Palmer, B., & Luft, S. (2014). Why problem-based learning works: Theoretical foundations. Journal on Excellence in College Teaching , 25 (3&4), 221–238.

Marsden, E., & Torgerson, C. J. (2012). Single group, pre- and post-test research designs: Some methodological concerns. Oxford Review of Education , 38 (5), 583–616. https://doi.org/10.1080/03054985.2012.731208 .

McCurdy, R. P., Nickels, M., & Bush, S. B. (2020). Problem-based design thinking tasks: Engaging student empathy in STEM. Electronic Journal for Research in Science & Mathematics Education , 24 (2), 22–55.

McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica , 22 (3), 276–282.

Mehalik, M. M., Doppelt, Y., & Schuun, C. D. (2008). Middle-School science through design-based learning versus scripted inquiry: Better overall science concept learning and equity gap reduction. Journal of Engineering Education , 97 (1), 71–85. https://doi.org/10.1002/j.2168-9830.2008.tb00955.x .

Mohr-Schroeder, M. J., Jackson, C., Miller, M., Walcott, B., Little, D. L., Speler, L., Schooler, W., & Schroeder, D. C. (2014). Developing Middle School Students’ interests in STEM via Summer Learning experiences: See Blue STEM Camp. School Science and Mathematics , 114 (6), 291–301. https://doi.org/10.1111/ssm.12079 .

Morris, T. H. (2020). Experiential learning - a systematic review and revision of Kolb’s model. Interactive Learning Environments , 28 (8), 1064–1077. https://doi.org/10.1080/10494820.2019.1570279 .

Nadelson, L. S., & Seifert, A. L. (2017). Integrated STEM defined: Contexts, challenges, and the future. The Journal of Educational Research , 110 (3), 221–223. https://doi.org/10.1080/00220671.2017.1289775 .

National Research Council, et al (2014). STEM integration in K-12 Education: Status, prospects, and an agenda for research , edited by Heidi Schweingruber, et al., National Academies Press. ProQuest Ebook Central, https://ebookcentral.proquest.com/lib/utep/detail.action?docID=3379257 .

Ng, W., & Fergusson, J. (2020). Engaging high school girls in interdisciplinary STEAM. Science Education International , 31 (3), 283–294. https://doi.org/10.33828/sei.v31.i3.7 .

NGSS Lead States. (2013). Next generation science standards: For states, by states . The National Academies.

Nokes-Malach, T. J., Richey, J. E., & Gadgil, S. (2015). When is it better to learn together? Insights from research on collaborative learning. Educational Psychology Review (27) , 645–656. https://doi.org/10.1007/s10648-015-9312-8 .

Ortiz-Revilla, J., Adúriz-Bravo, A., & Greca, I. M. (2020). A framework for epistemological discussion on integrated STEM education. Science & Education , 29 , 857–880. https://doi.org/10.1007/s11191-020-00131-9 .

Pappas, I. O., Mora, S., Jaccheri, L., & Mikalef, P. (2018, April). Empowering social innovators through collaborative and experiential learning. In 2018 IEEE Global Engineering Education Conference (EDUCON) , pp. 1080–1088. IEEE, 2018.

Pattison, N. P. (2021). Powerful partnerships: An exploration of the benefits of school and industry partnerships for STEM education. Teachers and Curriculum , 21 (2), 17–23. https://doi.org/10.15663/tandc.v21i0.367 .

Razzouk, R. (2012). What is design thinking and why is it important? Review of Educational Research , 82 (3), 330–348. https://doi.org/10.3102/003454312457429 .

Rehmat, A. P., & Hartley, K. (2020). Building engineering awareness: Problem based learning approach for STEM integration. The Interdisciplinary Journal of Problem-Based Learning , 14 (1). https://doi.org/10.14434/ijpbl.v14i1.28636 .

Reynante, B. M., Selbach-Allen, M. E., & Pimentel, D. R. (2020). Exploring the promises and perils of integrated STEM through disciplinary practices and epistemologies. Science & Education , 29 , 785–803. https://doi.org/10.1007/s11191-020-00121-x .

Roehrig, G. H., Dare, E. A., Ring-Whalen, E., et al. (2021). Understanding coherence and integration in integrated STEM curriculum. International Journal for STEM Education , 8 (2). https://doi.org/10.1186/s40594-020-00259-8 .

Saldaňa, J. (2012). The coding manual for qualitative researchers (2nd ed.). Sage.

Salzman, H., Kuehn, D., & Lowell, L. (2013). Guestworkers in the high-skill U.S. labor market: An analysis of supply, employment and wage trends (pp. 1–35). Economic Policy Institute. Briefing Paper no359 https://doi.org/10.7282/T379469D .

Santos, L. F. (2017). The role of critical thinking in science education. Journal of Education and Practice , 8 (20), 160–173.

Shanks, M. (2012). An introduction to design thinking: process guide [PDF] Hasso Plattner Institute of Design at Stanford https://web.stanford.edu/~mshanks/MichaelShanks/files/509554.pdf .

Shernoff, D. J., Sinha, S., Bressler, D. M., & Ginsburg, L. (2017). Assessing teacher education and professional development needs for the implementation of integrated approaches to STEM education. International Journal of STEM Education , 4 (1), 13–13. https://doi.org/10.1186/s40594-017-0068-1 .

Sikka, A. (1991). The effect of creativity training methods on the creative thinking of fourth, fifth, and sixth-grade minority students (Order No. 9312052). Available from ProQuest Dissertations & Theses Global. (303924270). Retrieved from https://utep.idm.oclc.org/login?url=https://www.proquest.com/dissertations-theses/effect-creativity-training-methods-on-creative/docview/303924270/se-2 .

Siverling, E. A., Suazo-Flores, E., Mathis, C. A., & Moore, T. J. (2019). Students’ use of STEM content in design justifications during engineering design‐based STEM integration. School Science and Mathematics , 119 (8), 457–474. https://doi.org/10.1111/ssm.12373 .

Solodikhina, A., & Solodikhina, M. (2022). Developing an innovator’s thinking in engineering education. Education and Information Technologies , 27 , 2569–2584. https://doi.org/10.1007/s10639-021-10709-7 .

Stanford d.school (2023). Tools for taking action. https://dschool.stanford.edu/resources .

Stohlmann, M. (2022). Growth mindset in K-8 STEM education: A review of the literature since 2007. Journal of Pedagogical Research , 6 (2), 149–162. https://doi.org/10.33902/JPR.202213029 .

Stohlmann, M., Moore, T. J., & Roehrig, G. H. (2012). Considerations for teaching integrated STEM education. Journal of Pre-College Engineering Education Research , 2 (1). https://doi.org/10.5703/1288284314653 . Article 4.

Struyf, A., De Loof, H., Boeve-de Pauw, J., & Van Petegem, P. (2019). Students’ engagement in different STEM learning environments: Integrated STEM education as promising practice? International Journal of Science Education , 41 (10), 1387–1407. https://doi.org/10.1080/09500693.2019.1607983 .

Tan, A-L., Ong, Y. S., Ng, Y. S., & Tan, J. H. J. (2023). STEM problem solving: Inquiry, concepts, and reasoning. Science & Education, 32 , 381–397. https://doi.org/10.1007/s11191-021-00310-2

Trochim, W. M., & Donnelly, J. P. (2001). Research methods knowledge base (Vol. 2). Macmillan Publishing Company, Atomic Dog Pub.

Tsai, M. J., & Wang, C. Y. (2021). Assessing young students’ design thinking disposition and its relationship with computer programming self-efficacy. Journal of Educational Computing Research , 59 (3), 410–428. https://doi.org/10.1177/0735633120967326 .

Vasquez, J., Sneider, C., & Comer, M. (2013). STEM lesson essentials, grades 3–8: Integrating science, technology, engineering, and mathematics . Heinemann.

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes . Harvard University Press.

Wan, Z. H., Jiang, Y., & Zhan, Y. (2021). STEM education in early childhood: A review of empirical studies. Early Education and Development , 32 (7), 940–962. https://doi.org/10.1080/10409289.1814986 .

Wingard, A., Kijima, R., Yang-Yoshihara, M., & Sun, K. (2022). A design thinking approach to developing girls’ creative self-efficacy in STEM. Thinking Skills and Creativity , 46. https://doi.org/10.10169/j.tsc.2022.101140 .

Zhou, N., Pereira, N. L., George, T. T., Alperovich, J., Booth, J., Chandrasegaran, S., Tew, J. D., Kulkarni, D. M., & Ramani, K. (2017). The influence of toy design activities on middle school students’ understanding of the engineering design processes. Journal of Science Education and Technology , 26 (5), 481–493. https://doi.org/10.1007/s10956-017-9693-1 .

Download references

The authors did not receive funding from any organization for the submitted work.

Author information

Authors and affiliations.

Department of Teacher Education, College of Education, University of Texas at El Paso, Room 813, Education Building, 500 W. University Avenue El Paso, El Paso, TX, 79968, USA

Dina Thomason & Pei-Ling Hsu

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Dina Thomason .

Ethics declarations

Conflict of interest.

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Thomason, D., Hsu, PL. The effect of a STEM integrated curriculum on design thinking dispositions in middle school students. Int J Technol Des Educ (2024). https://doi.org/10.1007/s10798-024-09894-6

Download citation

Accepted : 03 April 2024

Published : 13 April 2024

DOI : https://doi.org/10.1007/s10798-024-09894-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Design thinking
• STEM education
• Middle school
• Engineering design
• Find a journal
• Publish with us
• Track your research