Strong critical thinking predicts academic and professional success
Insight Assessment critical thinking test instruments are used globally to objectively identify the student applicants who have the strongest critical thinking skills and the desire to apply those skills. Many clients use this reliable and nationally benchmarked assessment data as an essential component in their admissions process.
Here are some of the frequently asked questions about the value of incorporating the assessment of critical thinking in the admissions.
Why consider candidate critical thinking as part of the admissions process?
Whatever else is being considered, admitting people who are both willing and able to think is an important element in developing and sustaining a high-quality admission process.
If candidates do not demonstrate sufficient reasoning skills strength or the positive internal motivation and drive to make a success of themselves, then they are much less likely to succeed academically. A high-quality admissions process which consistently yields a strong and successful cadre of new students is vitally important when programs are over-subscribed.
Admissions decisions are scrutinized when retention rates and graduation rates are being carefully tracked, when the consequences of admitting underprepared applicants can have a negative impact on other students, on the morale of the faculty and staff, or on the overall reputation of the program. Critical thinking admissions data can be used to document the overall success of the program as well as specific applicants. Multitask with the right admissions tools
What metrics are the most important for admissions?
Different programs will find different metrics of value, but in general, on the skills dimensions the OVERALL reasoning skills score is an excellent marker of the applicant’s strength. To score well overall, the applicant must excel in the sustained, focused and integrated application of the core thinking skills, including analysis, interpretation, inference, evaluation, explanation, induction and deduction.
The OVERALL score is the best predictor of the capacity for success in educational or workplace settings which demand reasoned decision making and thoughtful problem solving. Looking at specific skill metrics makes sense for programs that have specialized academic learning demands. For example, STEM programs and programs that demand strengths in quantitative reasoning will probably focus on the Numeracy Score along with the OVERALL score.
The mindset metrics that are most interesting for transfer student and non-traditional or returning adult admissions purposes include the Motivation to Learn, the Drive to Succeed, and Resilience as assessed on the College Success Mindset. For graduate professional schools using the CCTDI, metrics like Truth-Seeking, Foresight, and Maturity of Judgment are considered important.
What score is the most useful – the numerical score, the qualitative evaluation, or the percentile?
Insight Assessment test instruments report at least two scores for every metric: numerical and qualitative. Highly competitive programs may wish to establish a numerical cut score as a threshold for consideration for admissions. Other programs may wish to identify a qualitative level, e.g. “strong” or “positive” which all admitted students should have achieved. Clients are able to decide which score option is most relevant to their program goals.
Percentile scores are associated only with the OVERALL skills score. Percentiles are benchmark comparisons. The client organization determines which comparison group percentiles to be associated with the OVERALL score. For instance, a professional school of nursing may select the Health Sciences Reasoning Test as its admissions test. The school can decide whether it wants to use graduate student percentiles, four-year undergraduate student percentiles, or two-year associate degree level student percentiles. That decision depends on the level of the program for which applicants are being evaluated. Percentiles, Norms and Comparison Groups
See specific assessments for the metrics they measure and the comparison percentiles that are available.
Can a program use its admission data for other purposes?
Yes, absolutely. Admissions data can be thought of as pretest data. As such, those data can be used to evaluate the effectiveness of curricular innovations or to describe the entering class or cohort of students to interested stakeholders. Data is also frequently used in cross-sectional or longitudinal studies of program effectiveness or in accreditation self-study reports. Why link assessment, admissions and accreditation
Since the data can be downloaded in an Excel spreadsheet, it is relatively easy to integrate information about the critical thinking skills and learning mindset attributes of large groups of students with other institutional data or uploaded into research quality software programs such as SPSS or Minitab.
What can be included in the custom demographic questions?
The Insight Assessment online testing system enables clients to add as many as ten of their own custom demographic questions. The responses to those questions are included in the downloadable Excel spreadsheet available at any time to the program’s test administrator.
Some undergraduate student admissions clients ask about prior work experience, some inquire about the applicant’s age, or which languages the applicant speaks. At the graduate level some clients include questions about the applicant’s undergraduate major, which sub-specialty the applicant may be interested in pursuing, or whether the applicant intends to enroll full time or part time.
Our experienced staff can assist with the wording of demographic questions, but the questions themselves depend on the information that the client believes to be relevant for purposes of informing itself about its applicants individually or as a group. Two formats are available – open text or pull-down menu. The pull-down menu format is by far the most widely used because it enables easily quantifying the proportionate number who select each response.
How are the individual and the group reports used in admissions?
The individual report details an applicant’s scores on each reasoning skill or each mindset attribute assessed. Thus, the individual report gives the best overall picture of that applicant’s different strengths or areas that may need further development. Because the individual report focuses on only one applicant, it can be a useful document for individualized conversations with the applicant or advisor meetings with the newly admitted student.
The group report includes tables and charts that give useful information about the entire admissions pool, or about sub-sets of that pool. Because the data can be aggregated or disaggregated by any of the demographic factors, group reports can be generated in a matter of minutes by programs interested in comparing sub-groups of applicants. Tables of descriptive statistics and colorful bar charts give an accurate and complete picture of how a group of applicants performed on each metric. Group reports covering multiple applicant cohorts supply information that can reveal multi-year trends in the quality of the applicant pool.