CCSI Question Map | |
---|---|
Variable | Question |
q3_1 | I enjoy learning about STEM. |
q3_5 | I can apply STEM ideas to solve challenges. |
q4_4 | Others ask me for help with STEM activities. |
q5_1 | Everyone has the same opportunities to succeed. If they do not, then they just didn't work hard enough. |
q5_2 | I see concepts of STEM in my everyday life. |
q5_3 | Women are treated the same as men in STEM. |
q5_4 | STEM is a way for me to serve my community. |
q5_5 | I have conversations about STEM subjects with friends and family. |
q6_1 | I believe there are groups who experience privilege. |
q6_2 | I regularly talk about forms of discrimination and oppression with my friends. |
q7_1 | When it comes to race, I don't see differences. I just see people. |
q7_3 | When things get tough, I usually give up. |
q7_5 | I like to figure out how things work. |
q8_1 | I like to learn about people of different identities (such as race, gender, or religion). |
q8_3 | I enjoy the process of learning about subjects in a hands-on manner. |
q8_4 | It is too confusing to remember everyone's pronouns. |
q9_1 | I am a part of the STEM community at <my college>. |
q9_3 | Concepts learned in my STEM courses are applicable to other classes. |
q10_2 | Setbacks will happen, but I know I can overcome them. |
q10_3 | In the future, I see STEM as part of my job. |
q10_5 | There is a need for STEM professionals in my community. |
Socioeconomic Status, Identity, and Mindset: A Path Analysis of Community College STEM Achievement
1 Abstract
This study explores whether Pell Grant eligibility, gender, or generational college status moderate the relationships between students’ meritocratic beliefs, STEM identity, and growth mindset, and whether these beliefs help explain academic performance (GPA).
Using survey responses from over 400 STEM students at a community college, we created composite indices for each construct by averaging responses to selected Likert-scale items, reverse coding when needed. Reliability was confirmed using Cronbach’s alpha (α > .70
), and multicollinearity tests showed no inter-item correlations above |0.7|
. A structural equation model (SEM) was then fit to test whether these constructs predicted GPA, and whether these relationships differed across groups.
Chi-square difference tests showed no statistically significant moderation by Pell eligibility, gender, or generational status. Despite this, there are still a few patterns worth noting. For non-Pell students, meritocratic beliefs had a negative relationship with GPA (β = −0.14
), and for female students, growth mindset was a statistically significant positive predictor (β = 0.18
). Still, no other paths were statistically significant, and the model explained only a small portion of GPA variance (maximum R² = 0.026
), suggesting that psychosocial beliefs alone do not account for academic outcomes in this context.
While meritocratic beliefs, STEM identity, and growth mindset may matter for student success, these constructs didn’t strongly predict GPA. The only factor to operate differently across student subgroups was Growth Mindset
for Female
students. Other factors likely play a larger role in predicting academic performance.
2 Background
Community colleges enroll a large proportion of students who are historically excluded from STEM fields (Carales & Hooker, 2019). These institutions therefore serve as a critical entry point for diversifying the STEM workforce. This study seeks to answer the question: Does Pell Grant eligibility, gender, or generational college status moderate the relationships between students’ meritocratic beliefs, STEM identity, and growth mindset, and in turn, do these beliefs differentially influence academic performance (GPA)? To answer this question we use the responses from the Culturally Contextual STEM Identity (CCSI v5
) survey which were collected from a Hispanic-Serving Institution (HSI) community college in California. After cleaning we analyzed responses from 400+ participants.
We first must define what growth mindset, STEM identity, and meritocratic beliefs mean. Growth mindset was pioneered by Carol Dweck and is the belief that your abilities can be developed through effort, effective strategies, and help from others rather than being fixed traits (Dweck, 2006). A meritocratic ideology is the belief that in a given system a person’s success is determined solely by individual ability and efforts (Wiederkehr et al., 2015). Finally Arellano Jr. et al. (2024, p. 4) define STEM identity as “an individual’s sense of belonging, engagement, and identification within STEM.”
Testing whether academic performance differ by students’ economic, gender, or generational status is important as if the pathways to GPA operate differently for Pell-eligible, female, or first-generation students, one-size-fits-all interventions will fall short. Identifying where the pathways diverge can guide equity-focused programming at two-year colleges, where most traditionally excluded students begin their STEM journeys.
3 Methods
3.1 Data Collecting and Cleaning
The CCSI survey was distributed online to students enrolled in STEM courses at HSI community college located in California. We begin by loading the CCSI data, which is then filtered to only contain the relevant information. As a baseline, surveys with more than five missing responses were omitted. After cleaning, the sample included 417 responses. A question map is then created to display the questions utilized in this analysis with their respective variable label.
3.2 Measures and Reliability
Prior exploratory factor analysis was used to determine the groupings for growth mindset, STEM identity, and meritocratic beliefs. Each item was measured using a 6-point Likert scale ranging from Strongly Disagree to Strongly Agree. The following plots show the distribution of the responses for each item within the three constructs as well as the distribution of cumulative GPA.
gpa_plot
For the questions which are negatively phrased (q6_1
, q6_2
, q8_1
, q7_3
), we reverse code them so as to align with the other questions. To ensure that the grouped items reliably measure the same underlying construct, Cronbach’s alpha was used to assess the internal consistency of each construct. An alpha above .7
is considered to be acceptable (Tavakol & Dennick, 2011).
Since all Cronbach’s alpha are greater than .7
we can assume construct reliability. We next want to examine whether the key predictor variables exhibit multicollinearity.
3.3 Testing for Multicollinearity
Prior to conducting path analysis, we must test for multicollinearity. If an index does exhibit multicollinearity, the validity of our structural estimates could be compromised.
To evaluate multicollinearity, we examine the pairwise correlations between items within each construct. The correlation matrices were then visualized using heatmaps which can be seen below. As a general rule of thumb, no items should have correlation greater than |0.7|
(Dormann et al., 2013). Since all correlations fell well below |0.7|
, we are confident that we can proceed.
3.4 Descriptive Statistics by Group
Before running our path models, we first looked at how each of the key constructs varied across Pell eligibility, gender, and generational status. Each construct was represented as a composite index, created by taking the mean of the relevant survey items after reverse coding when necessary. The table below shows the mean, median, and standard deviation for each construct by group.
Descriptive Statistics by Group | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Grouping | Group | N |
GPA
|
Meritocratic Beliefs
|
STEM Identity
|
Growth Mindset
|
||||||||
Mean | Median | SD | Mean | Median | SD | Mean | Median | SD | Mean | Median | SD | |||
Pell | Non-Pell | 151 | 3.01 | 3.22 | 0.94 | 3.19 | 3.29 | 0.90 | 4.59 | 4.56 | 0.74 | 5.15 | 5.2 | 0.64 |
Pell | Pell | 266 | 2.83 | 3.02 | 0.95 | 3.40 | 3.43 | 0.84 | 4.57 | 4.56 | 0.76 | 5.15 | 5.2 | 0.63 |
Generation | First Generation | 287 | 2.89 | 3.04 | 0.95 | 3.25 | 3.29 | 0.85 | 4.58 | 4.56 | 0.77 | 5.17 | 5.2 | 0.65 |
Generation | Later Generation | 92 | 2.92 | 3.16 | 1.02 | 3.40 | 3.43 | 0.92 | 4.65 | 4.67 | 0.68 | 5.17 | 5.2 | 0.54 |
Gender | Female | 201 | 2.89 | 3.04 | 0.97 | 3.03 | 3.14 | 0.84 | 4.65 | 4.67 | 0.70 | 5.16 | 5.2 | 0.62 |
Gender | Male | 213 | 2.89 | 3.09 | 0.93 | 3.62 | 3.71 | 0.80 | 4.52 | 4.56 | 0.79 | 5.15 | 5.2 | 0.64 |
While these summaries aren’t meant to explain the relationships between variables, they offer helpful insight into where patterns may begin to emerge. For example we see that GPA tends to be higher among respondents who were not eligible for the Pell grant as well as for continuing generation students.
3.5 Path Model Overview and Model Fit
For each group, we estimated a structural equation model (SEM) using the lavaan
package in R. The model included GPA as the outcome, with meritocratic beliefs, STEM identity, and growth mindset as predictors.
<- 'cumulative_gpa ~ meritocratic_index + stem_id_index + growth_mindset_index' model
Each model was run using a multi-group approach, allowing us to estimate and compare paths across groups. We also tested for moderation by comparing a freely estimated model (where paths were allowed to differ) with a constrained model (where all regression paths were held equal across groups). A significant chi-square difference test would suggest moderation by group. Standardized path coefficients were extracted for each group, and R2 values were computed to examine how much variance in GPA was explained by the predictors.
The next section breaks down the results for each grouping variable and report whether any path significantly differed across groups.
4 Results
4.1 Moderation Tests
To test whether the structural paths varied by Pell eligibility, gender, or generational status, we compared freely estimated models (where paths could differ between groups) with constrained models (where all regression paths were held equal). The chi-square difference tests are shown below:
Δχ² Difference Tests for Moderation | ||||
---|---|---|---|---|
Grouping | delta_chisq | delta_df | p_value | Sig |
Pell | 6.046 | 3 | 0.109 | No |
Generation | 0.051 | 3 | 0.997 | No |
Gender | 4.574 | 3 | 0.206 | No |
None of the p-values were below the threshold of .05, meaning there was no statistically significant evidence that any of the grouping variables moderated the structural paths. While Pell eligibility showed the largest difference in chi-square (Δχ² = 6.05), the result was still not significant (p = .109
). As a result, we proceed by examining path estimates within each group descriptively, rather than interpreting them as significantly different.
4.2 Path Coefficients by Group
Even though our chi-square difference tests did not support significant moderation, we still examined the standardized path coefficients within each group to better understand how meritocratic beliefs, STEM identity, and growth mindset relate to academic performance (GPA) across different student populations.
The table below summarizes the standardized regression coefficients (β), standard errors (SE), z-values, p-values, and significance for each path in each group:
Standardized Path Coefficients by Group | |||||||
---|---|---|---|---|---|---|---|
Grouping Variable | Group | Predictor | β | SE | z | p-value | Significant (p < .05) |
Pell eligibility | Pell | Meritocratic Beliefs | 0.077 | 0.061 | 1.260 | 0.208 | No |
Pell eligibility | Pell | STEM Identity | −0.073 | 0.077 | −0.949 | 0.343 | No |
Pell eligibility | Pell | Growth Mindset | 0.115 | 0.077 | 1.495 | 0.135 | No |
Pell eligibility | Non-Pell | Meritocratic Beliefs | −0.137 | 0.082 | −1.667 | 0.095 | No |
Pell eligibility | Non-Pell | STEM Identity | 0.044 | 0.104 | 0.422 | 0.673 | No |
Pell eligibility | Non-Pell | Growth Mindset | 0.023 | 0.101 | 0.225 | 0.822 | No |
Generation status | First-Gen | Meritocratic Beliefs | −0.031 | 0.059 | −0.519 | 0.604 | No |
Generation status | First-Gen | STEM Identity | −0.025 | 0.077 | −0.324 | 0.746 | No |
Generation status | First-Gen | Growth Mindset | 0.086 | 0.076 | 1.124 | 0.261 | No |
Generation status | Later-Gen | Meritocratic Beliefs | −0.012 | 0.107 | −0.112 | 0.911 | No |
Generation status | Later-Gen | STEM Identity | −0.005 | 0.123 | −0.038 | 0.969 | No |
Generation status | Later-Gen | Growth Mindset | 0.042 | 0.121 | 0.345 | 0.730 | No |
Gender | Female | Meritocratic Beliefs | 0.007 | 0.071 | 0.099 | 0.921 | No |
Gender | Female | STEM Identity | −0.142 | 0.089 | −1.589 | 0.112 | No |
Gender | Female | Growth Mindset | 0.184 | 0.087 | 2.115 | 0.034 | Yes |
Gender | Male | Meritocratic Beliefs | −0.041 | 0.068 | −0.599 | 0.549 | No |
Gender | Male | STEM Identity | 0.092 | 0.085 | 1.076 | 0.282 | No |
Gender | Male | Growth Mindset | −0.016 | 0.085 | −0.185 | 0.853 | No |
Overall we see that besides Growth Mindset
for the Female
group, no other predictors were statistically significant. However, some patterns are still worth noting. Among non-Pell students, meritocratic beliefs had a negative relationship with GPA (β = −0.137
, p = .095
), just shy of significance. For Pell-eligible students, none of the predictors were statistically significant, though growth mindset had a positive trend (β = 0.115
, p = .135
) higher than that of noneligible students (β = 0.023
, p = .101
).
The following plot visualizes the standardized path coefficients by Pell eligibility group. Although none of the paths were statistically different across groups, this figure helps illustrate how the relationships vary in strength and direction between Pell-eligible and non-Pell students.
While these results do not support strong group-specific effects, the descriptive differences suggest that the strength and direction of the relationships between beliefs and GPA may still vary depending on students’ background.
4.3 Explained Variance(R2) by Group
To assess how well the model explained students’ academic performance, we calculated the R² values for cumulative GPA within each group. These values represent the proportion of variance in GPA accounted for by the predictors.
R² Values for GPA by Group | ||
---|---|---|
Grouping Variable | Group | R² |
Pell | Pell | 0.015 |
Pell | Non-Pell | 0.026 |
Generation | First Generation | 0.006 |
Generation | Later Generation | 0.002 |
Gender | Female | 0.022 |
Gender | Male | 0.009 |
The R2 values were generally low across all groups, with the highest R2 being observed among non-Pell students (R² = 0.026
), followed by female students (R² = 0.022
). This suggests that while these beliefs may play some role in GPA, they do not explain much of the variance on their own. Although growth mindset, STEM identity, and meritocratic beliefs may be part of the story, there are likely other academic or other factors contributing more strongly to students’ GPA.
5 Discussion
5.1 Summary of findings
We tested whether Pell eligibility, gender, or generational status changed the strength of the paths from meritocratic beliefs, STEM identity, and growth mindset to GPA. Chi‑square difference tests indicated no significant differences for Pell eligibility, gender, or generational status, however, the Pell grouping had a p-value of p = 0.109
which may warrant further testing with larger samples. Other subgroup patterns also emerged:
Within female students, growth mindset was the only statistically significant (p = 0.034
) predictor of GPA (β = 0.184
). For non-Pell students, although not quite statistically significant (p = 0.095
), higher meritocratic beliefs predicted lower GPA (β = -0.137
). All other predictors had a p-value greater than 0.1, and thus were not significant
5.2 Limitations
Several factors should be considered when interpreting these findings. Firstly, the survey was conducted at a single Hispanic-Serving Institution, which limits generalizability. Also, since all the data was self-reported it may not be entirely accurate. Important key factors such as employment status or course load were not included which could have a significant effect on GPA. Finally, the cross-sectional design prevents causal claims; it is unclear whether beliefs influence GPA, or whether prior academic performance shapes beliefs.
5.3 Implications
The results suggest that interventions aimed solely at shifting students’ beliefs may not lead to immediate improvements in GPA without complementary academic and structural supports. Efforts to strengthen growth mindset or STEM identity could be paired with concrete resources (tutoring, mentoring, structured study environments, etc.) to translate beliefs into sustained academic gains. Given the positive association between growth mindset and GPA among female students, gender-specific strategies might be worth exploring, though the small effect sizes caution against overgeneralization.
5.4 Future Research
Future work could track students longitudinally to see whether these constructs predict retention, course completion, or GPA over multiple terms. Including additional predictors, such as academic preparedness, faculty support, and campus engagement, may yield a fuller picture of what drives STEM achievement in community college settings. Replicating the analysis across multiple two-year institutions would also help assess whether the observed patterns are consistent in other contexts.
6 Conclusion
The central question asked whether background characteristics moderate the GPA relationships. Statistically, they did not. Descriptively, non‑Pell students with stronger meritocratic beliefs tended to have slightly lower GPA, and female students with stronger growth mindset tended to have slightly higher GPA. While female students with higher growth mindset scores showed slightly better GPAs, overall the models explained little of the variance in academic performance. These results highlight the complexity of predicting GPA from psychosocial measures alone and suggest that structural, academic, and behavioral factors likely play a larger role.