Archived Assessment Report
| Program | SOCI Social Behavioral Gen Ed |
| Assessment Reporter | [email protected] |
| Theme | Practicing Community |
| Review Year | 2024-2025 - Final Report |
| Learning Outcome (or Gen Ed Essential Skill) | Focus Area |
|---|---|
| 3a. Personal and Social Responsibility: Intercultural reasoning and intercultural competence | Are 65% of our Gen Ed students able to demonstrate intercultural reasoning and intercultural competence? |
| 3b. Personal and Social Responsibility: Sustainability and the natural and human worlds | N/A |
| 3c. Personal and Social Responsibility: Ethical Reasoning | N/A |
| 3d. Personal and Social Responsibility: Collaboration skills, teamwork and value systems | N/A |
| 3e. Personal and Social Responsibility: Civic discourse, civic knowledge and engagement – local and global | Are 65% of our Gen Ed students able to demonstrate civic discourse, civic knowledge and engagement - local and global. |
| Learning Outcome (or Gen Ed Essential Skill) | Description of Assessment Tool | Population or Courses Assessed | Hypothetical Analysis/Target |
|---|---|---|---|
| 3a. Personal and Social Responsibility: Intercultural reasoning and intercultural competence | Scenarios that allow students to write a response to the scenario, demonstrating their intercultural reasoning and intercultural competence | SOCI1110 | This is still being sorted out |
| 3b. Personal and Social Responsibility: Sustainability and the natural and human worlds | N/A | N/A | N/A |
| 3c. Personal and Social Responsibility: Ethical Reasoning | N/A | N/A | N/A |
| 3d. Personal and Social Responsibility: Collaboration skills, teamwork and value systems | N/A | N/A | N/A |
| 3e. Personal and Social Responsibility: Civic discourse, civic knowledge and engagement – local and global | Scenarios asking students to respond to the scenario to demonstrate their competency in civic discourse, civic knowledge and engagement | SOCI1110 | Still sorting this out |
| Learning Outcome (or Gen Ed Essential Skill) | Summary of Results | Reflection on Focus Area | Intepretation of Results |
|---|---|---|---|
| 3a. Personal and Social Responsibility: Intercultural reasoning and intercultural competence | Using a likert scale between 1-4, we considered (3) developing) and (4) proficient. 50% of our students | No, we did not hit 65%, but we are close | We have some improvements to make to increase our proficient and developing students |
| 3b. Personal and Social Responsibility: Sustainability and the natural and human worlds | NA | NA | NA |
| 3c. Personal and Social Responsibility: Ethical Reasoning | NA | NA | NA |
| 3d. Personal and Social Responsibility: Collaboration skills, teamwork and value systems | NA | NA | NA |
| 3e. Personal and Social Responsibility: Civic discourse, civic knowledge and engagement – local and global | NA | NA | NA |
| 3a. Personal and Social Responsibility: Intercultural reasoning and intercultural competence | |
|---|---|
| Describe the change that was implemented. | We are changing the wording in our instructions to better align assignment outcomes with the goal. |
| Type of Change |
|
| Change in Assessment Approach or Tools? | The tools. We are clarifying the instructions, rubric, and expectations. |
| What data motivated the change? | We did not meet our desired 65% proficiency |
| Hypothesis about the effect the change will have? | Students will have a more clear understanding of expectations. |
| 3b. Personal and Social Responsibility: Sustainability and the natural and human worlds | |
|---|---|
| Describe the change that was implemented. | NA |
| Type of Change |
|
| Change in Assessment Approach or Tools? | NA |
| What data motivated the change? | NA |
| Hypothesis about the effect the change will have? | NA |
| 3c. Personal and Social Responsibility: Ethical Reasoning | |
|---|---|
| Describe the change that was implemented. | NA |
| Type of Change |
|
| Change in Assessment Approach or Tools? | NA |
| What data motivated the change? | NA |
| Hypothesis about the effect the change will have? | NA |
| 3d. Personal and Social Responsibility: Collaboration skills, teamwork and value systems | |
|---|---|
| Describe the change that was implemented. | NA |
| Type of Change |
|
| Change in Assessment Approach or Tools? | NA |
| What data motivated the change? | NA |
| Hypothesis about the effect the change will have? | NA |
| 3e. Personal and Social Responsibility: Civic discourse, civic knowledge and engagement – local and global | |
|---|---|
| Describe the change that was implemented. | NA |
| Type of Change |
|
| Change in Assessment Approach or Tools? | NA |
| What data motivated the change? | NA |
| Hypothesis about the effect the change will have? | NA |
| Learning Outcome (or Gen Ed Essential Skill) | Description of Assessment Tool | Population of Courses Assessed |
|---|---|---|
| 3a. Personal and Social Responsibility: Intercultural reasoning and intercultural competence | Same tool but with clarified directions | SOCI1110 |
| 3b. Personal and Social Responsibility: Sustainability and the natural and human worlds | NA | NA |
| 3c. Personal and Social Responsibility: Ethical Reasoning | NA | NA |
| 3d. Personal and Social Responsibility: Collaboration skills, teamwork and value systems | NA | NA |
| 3e. Personal and Social Responsibility: Civic discourse, civic knowledge and engagement – local and global | NA | NA |
| Learning Outcome (or Gen Ed Essential Skill) | Summary of Second Round Results | Intepretation of Results, Pre- and Post-Change | Follow up questions, possible next steps |
|---|---|---|---|
| 3a. Personal and Social Responsibility: Intercultural reasoning and intercultural competence | 75% of our students met the goal of a 3 or 4 in intercultural reasoning. N=153 | Many of the faculty didn't actually like or use the rubric. The language in the rubric was jargony and hard to understand. Although we were able to meet our goal, questions remain as to the efficacy of the rubric. | |
| 3b. Personal and Social Responsibility: Sustainability and the natural and human worlds | NA | NA | |
| 3c. Personal and Social Responsibility: Ethical Reasoning | NA | NA | |
| 3d. Personal and Social Responsibility: Collaboration skills, teamwork and value systems | NA | NA | |
| 3e. Personal and Social Responsibility: Civic discourse, civic knowledge and engagement – local and global | 73% of our students were proficient in demonstrating civic discourse. N=153 | Again, we're not entirely sold on the idea that providing the rubric enhances student scores. We will consult our tool for the next round, which measures "professional skills" |
Describe any change in student achievement observed as part of this assessment process, and what led to those changes.
Not really. And this came up in our most recent department meeting about assessment. Once again, we failed to articulate the development of these skills explicitly to students, and we think we should intertwine the universal theme more broadly into content throughout the semester. This way we can connect our teaching methods to the outcome and reduces speculation. That said, we did meet our goal and them some. We hoped that 65% of our Gen Ed students would be proficient at demonstrating their skill of practicing community. 75% in this last round meet that threshold. However, we have a new faculty working on the assessment data and the faculty member who previously had this task worked independently and the rest of us are not sure how she analyzed the data, dealt with missing data, etc. So the jump in percentage from the last time we assessed could possibly be an artifact of the data. Changes to methodology can often cause changes I the outcome beyond substantive factors.
Describe long-term changes in the program(s) that the assessment process led to, and what motivated those changes?
One change is that we will be in better communication about how to measure the universal themes. We found out in this last round that we had differing ideas and our language for the rubric was vague and jargon filled. Moving forward, we have a plan better organization. Another change made is transparency in the assessment process. This includes more communication with PT instructors on the assessment process, how to conduct the assessment, and why it's important. This way we can ensure a more uniform data outcome.
What did you learn about the teaching and learning of "Practicing Community" in your programs?
We learned two main things: First, regarding the assessment tool, we learned that we need to be very specific in how we evaluate the assessments. We all had a vague sense of how our students would demonstrate proficient "practicing community" skills, but when we went to define the exact examples of "proficient" it was hard to articulate. In this next round, we will have clear definitions of we mean when we say "professional skills." And how to incorporate the sociology of it all in the assignment. Second, we learned that we need to ALSO articulate exactly what we mean by "practicing community" to the students. As faculty, we were not all on board with how we described assignments and assessments being connected to the universal theme. We decided we'd like to be more explicit in how the assessment is a way for them to demonstrate a transferable skill, such as practicing community and professional skills. This will also able them to be specific about their developed transferable skills when talking with employers and other educators.
Describe any external factors affecting the program or affecting assessment of the program.
All in all we think our assessment process has gone smoothly. One external issue that impacted our assessment was the change over in faculty. Our data faculty, who was responsible for the SAC report for the last decade retired after the first round of assessment and there was a period of learning that slowed us down as a group. We felt that we spent most of our time trying to reorganize and learn the process to make sure we were on time. And thus we spent too little time discussing the tool itself and how to best measure our outcomes. But now we're on track to have a much more thorough tool and instructions.