ASSESSMENT REPORT
FOR
Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program
Spring 2004__
Assessment Period Covered
June 30, 2004
Date Submitted
Expanded Statement of Institutional Purpose Linkage:
Institutional Mission Reference:
Texas A&M International University, a Member of The Texas A&M
University System, is committed to the preparation of students for leadership
roles in their chosen profession and in an increasingly complex, culturally
diverse state, national, and global society … Through instruction, faculty
and student research, and public service, Texas A&M International
University is a strategic point of delivery for well-defined programs
and services that improve the quality of life for citizens of the border
region, the State of Texas, and national and international communities.
College/University Goal(s) Supported:
Whether through scientific or mathematical investigation; artistic
performance; or social, political, or cultural inquiry, the faculty
of the College of Arts and Sciences remain committed to preparing students
for entrance into a variety of professions, as well as to encouraging
their general appreciation for the breadth of arts and sciences in all
human endeavors. To accomplish these objectives, the College of Arts
and Sciences stresses the development of written and spoken communication,
critical thinking skills, a broad knowledge base of a specialized discipline,
a familiarity with the technological advancements and professional practices
of a rapidly changing global environment, and a desire to contribute
their skills to appropriate community-based activities.
Intended Educational (Student) Outcomes:
1. Demonstrated ability of students to critically evaluate
and integrate a relevant body of psychological literature.
2. Demonstrated knowledge of theories of counseling and psychotherapy
including their strengths and weaknesses and areas of application.
3.Demonstration of basic counseling and professional competencies
in direct service to clients.
ASSESSMENT REPORT
FOR
Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program
Spring 2004__
Assessment Period Covered
June 30, 2004
Date Submitted
Intended Educational (Student) Outcome:
__1__ Demonstrated ability of students to critically evaluate and
integrate a relevant body of psychological literature.
First Means of Assessment for Outcome Identified Above:
__1__a. Means of Program Assessment & Criteria for Success:
A faculty team evaluates student literature reviews of 6-8 pages,
peer reviewed academic journal articles for the required course, PSYC
5320, using a six category rubric. The rubric is called the APA Style
Evaluation Form: Graduate. Categories are:
Importance of topic/Effective Introduction; APA format; Currency &
relevance of literature cited; Effectiveness of conclusion; Technical
and scientific writing style; and
Grammatical and spelling accuracy. Ratings in all categories will average
80% and the average rating on none of the areas will be less than 70%.
__1__a. Summary of Assessment Data Collected:
N=2. Average ratings ranged from a high of 86.5%, (3 of 6 categories),
to a low of 81.25%. Average rating across all categories = 84.71%,
and none were below 70%.
Importance of topic/effective introduction=86.5%; APA format=81.25%;
Currency & relevance= 86.5%; Effectiveness of conclusion=85%; Technical
and scientific writing=82.5%; Grammatical and spelling accuracy=86.5%.
__1__a. Use of Results to Improve Instructional Program:
Small sample size limits generalizing from these results. Continued
data collection over the next two semesters to occur at a minimum. Rubric
will be used in graduate course PSYC 5320 as a teaching devise in preparation
of papers. This course change is effective fall 2004.
ASSESSMENT REPORT
FOR
Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program
Spring 2004__
Assessment Period Covered
June 30, 2004
Date Submitted
Intended Educational (Student) Outcome:
__2__Students will demonstrate their knowledge of theories of counseling
and psychotherapy, including strengths and weaknesses and areas of application.
First Means of Assessment for Outcome Identified Above:
__2__a.Means of Program Assessment & Criteria
for Success:
An objective, multiple-choice measure of counseling and psychotherapy
theories is administered to all MACP students as part of the Comprehensive
exam. The test is called the Counseling & Psychotherapy: Theories
& Applications Objective Test. 80% of the students will score at
or above the 80% level and no student will score below 70%.
__2__a. Summary of Assessment Data Collected:
N=5. % scores are 96, 90, 88, 84, and 78. Thus, 4 of 5 scored at
80% or higher, while no one scored below 70%. An analysis of item responses
indicated that most students incorrectly responded to questions concerning
marriage and family and Freudian theories.
__2__a. Use of Results to Improve Instructional Program:
In PSYC 5303, Theories of Counseling and Psychotherapy more class
time will be given the two theories in which students responded less
correctly. This emphasis will begin Fall 2004.
ASSESSMENT REPORT
FOR
Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program
Spring 2004__
Assessment Period Covered
June 30, 2004
Date Submitted
Intended Educational (Student) Outcome:
__3__Demonstration of basic counseling and professional competencies
in direct services to clients.
First Means of Assessment for Outcome Identified Above:
__3__a. Means of Program Assessment & Criteria for Success:
During the internship, students will submit video or audio taped
interviews for evaluation by a team of MACP faculty. Faculty will use
the Working Alliance Inventory, external raters form. Ratings will
average at least 80% on the Goals, Tasks and Bond subscales.
__3__a. Summary of Assessment Data Collected:
N=3. Ratings on Goals subscale: .77, .79 .79 . Average =%78.3
Ratings on Tasks subscale: .79, .83 and .76 Average =%79.3
Bond Ratings: 87.5%, 94%, and 87% Average =%89.5
__3__a. Use of Results to Improve Instructional Program:
Small sample size makes generalizing from the results difficult.
Continued use of the WAI over the next year is scheduled. Collection
of self-ratings of students on the WAI will be collected and compared
as well.
Second Means of Assessment for Outcome Identified Above:
__3__b. Means of Program Assessment & Criteria for Success:
During the internship all students complete the Multicultural Counseling
Awareness Scale (MCKAs, Ponterotto et.al. 1991).
Student responses will be comparable to those of the norms for the instrument
in both the knowledge and awareness scales. (Typical score in literature
is 5 for counseling interns).
__3__b. Summary of Assessment Data Collected:
N=4. Mean Awareness Score=5.8 Mean Knowledge Score =5.87. Typical
score reported in literature is 5.
__3__b. Use of Results to Improve Instructional Program:
Small N makes generalization of results difficult. Instrument to
be administered at least two more times and data summarized. In fall
of 2004 MCKAs will be administered pre-post in Multicultural Course
to assess any positive changes and to raise awareness of multicultural
competencies of the MACP students in the course.
__3_ c. Means of assessment and criteria for success:
Site Supervisors Rating Form, a locally developed measure, completed
by site supervisors on our MACP students on internship and practicum
placement. Measure evaluates professional and counseling competencies.
For interns the supervisors’ ratings will average 80% in all competencies
and none of the individual competencies will be less than 70%.
__3__c. Summary of Assessment Data Collected:
N=3. 13 competencies/professional behaviors rated 100%.
__3__c. Use of Results:
Small sample size limits generalization of results. These findings
combined with data collected in fall, 2003 =N of 5. Results suggest
that students are highly competent and professional from the site supervisors’
perspectives. Survey requesting feedback concerning the Site Supervisors
Rating From was mailed in December of 2003 and 5 were returned. No
revisions in the form were consistently recommended by the 5 respondents.
Data using the Site Supervisors Rating Form will continue to be collected
for at least two more semesters.
SUPPORT DOCUMENTATION
Enter any document referenced above in this summary table. There are
two examples listed below. If no documents are cited, please remove
the two examples from the table.
SOURCE |
LOCATION/Special Instructions |
APA Style Evaluation Form:
Graduate |
|
Counseling & Psychotherapy:
Theories & Applications Object Test |
|
Working Alliance Inventory |
|
Multicultural Counseling
Awareness Scale
_____________________
Site Supervisor’s Rating Form |
_______________________________ |