ASSESSMENT REPORT

FOR

 

 

Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program

Spring 2004__
Assessment Period Covered

June 30, 2004
Date Submitted

Expanded Statement of Institutional Purpose Linkage:
Institutional Mission Reference:
Texas A&M International University, a Member of The Texas A&M University System, is committed to the preparation of students for leadership roles in their chosen profession and in an increasingly complex, culturally diverse state, national, and global society … Through instruction, faculty and student research, and public service, Texas A&M International University is a strategic point of delivery for well-defined programs and services that improve the quality of life for citizens of the border region, the State of Texas, and national and international communities.

College/University Goal(s) Supported:
Whether through scientific or mathematical investigation; artistic performance; or social, political, or cultural inquiry, the faculty of the College of Arts and Sciences remain committed to preparing students for entrance into a variety of professions, as well as to encouraging their general appreciation for the breadth of arts and sciences in all human endeavors. To accomplish these objectives, the College of Arts and Sciences stresses the development of written and spoken communication, critical thinking skills, a broad knowledge base of a specialized discipline, a familiarity with the technological advancements and professional practices of a rapidly changing global environment, and a desire to contribute their skills to appropriate community-based activities.

Intended Educational (Student) Outcomes:
1. Demonstrated ability of students to critically evaluate and integrate a relevant body of psychological literature.

2.  Demonstrated knowledge of theories of counseling and psychotherapy including their strengths and weaknesses and areas of application.

3.Demonstration of basic counseling and professional competencies in direct service to clients. 

 


 ASSESSMENT REPORT

FOR

 

 

Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program

Spring 2004__
Assessment Period Covered

June 30, 2004
Date Submitted

Intended Educational (Student) Outcome:
__1__ Demonstrated ability of students to critically evaluate and integrate a relevant body of psychological literature.

First Means of Assessment for Outcome Identified Above:
__1__a. Means of Program Assessment & Criteria for Success:
A faculty team evaluates student literature reviews of 6-8 pages, peer reviewed academic journal articles for the required course, PSYC 5320, using a six category rubric. The rubric is called the APA Style Evaluation Form: Graduate. Categories are:
Importance of topic/Effective Introduction; APA format; Currency & relevance of literature cited; Effectiveness of conclusion; Technical and scientific writing style; and
Grammatical and spelling accuracy.  Ratings in all categories will average 80% and the average rating on none of the areas will be less than 70%.

__1__a. Summary of Assessment Data Collected:
 N=2.  Average ratings ranged from a high of 86.5%, (3 of 6 categories), to a low of 81.25%.  Average rating across all categories = 84.71%, and none were below 70%.
Importance of topic/effective introduction=86.5%; APA format=81.25%; Currency & relevance= 86.5%; Effectiveness of conclusion=85%; Technical and scientific writing=82.5%; Grammatical and spelling accuracy=86.5%.

__1__a. Use of Results to Improve Instructional Program:
Small sample size limits generalizing from these results.  Continued data collection over the next two semesters to occur at a minimum. Rubric will be used in graduate course PSYC 5320 as a teaching devise in preparation of papers. This course change is effective fall 2004.

 

ASSESSMENT REPORT

FOR

 

 

Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program

Spring 2004__
Assessment Period Covered

June 30, 2004
Date Submitted

Intended Educational (Student) Outcome:

__2__Students will demonstrate their knowledge of theories of counseling and psychotherapy, including strengths and weaknesses and areas of application.

First Means of Assessment for Outcome Identified Above:
__2__a.Means of Program Assessment & Criteria for Success:
An objective, multiple-choice measure of counseling and psychotherapy theories is administered to all MACP students as part of the Comprehensive exam. The test is called the Counseling & Psychotherapy: Theories & Applications Objective Test. 80% of the students will score at or above the 80% level and no student will score below 70%.

__2__a. Summary of Assessment Data Collected:
N=5.  % scores are 96, 90, 88, 84, and 78. Thus, 4 of 5 scored at 80% or higher, while no one scored below 70%.  An analysis of item responses indicated that most students incorrectly responded to questions concerning marriage and family and Freudian theories.

__2__a. Use of Results to Improve Instructional Program:
In PSYC 5303, Theories of Counseling and Psychotherapy more class time will be given the two theories in which students responded less correctly.  This emphasis will begin Fall 2004.


 ASSESSMENT REPORT

FOR

 

 

Master of Arts in Counseling Psychology (MACP) (Thesis and Non-Thesis)
Instructional Degree Program

Spring 2004__
Assessment Period Covered

June 30, 2004
Date Submitted

Intended Educational (Student) Outcome:

__3__Demonstration of basic counseling and professional competencies in direct services to clients. 

First Means of Assessment for Outcome Identified Above:
__
3__a. Means of Program Assessment & Criteria for Success:
During the internship, students will submit video or audio taped interviews for evaluation by a team of MACP faculty.  Faculty will use the Working Alliance Inventory, external raters form.  Ratings will average at least 80% on the Goals, Tasks and Bond subscales. 

__3__a. Summary of Assessment Data Collected:
N=3.  Ratings on Goals subscale: .77, .79 .79 .  Average =%78.3  Ratings on Tasks subscale: .79, .83 and .76 Average =%79.3
Bond Ratings: 87.5%, 94%, and 87%  Average =%89.5

__3__a. Use of Results to Improve Instructional Program:
Small sample size makes generalizing from the results difficult.  Continued use of the WAI over the next year is scheduled.  Collection of self-ratings of students on the WAI will be collected and compared as well.

Second Means of Assessment for Outcome Identified Above:
__3__b. Means of Program Assessment & Criteria for Success:
During the internship all students complete the Multicultural Counseling Awareness Scale (MCKAs, Ponterotto et.al. 1991).
Student responses will be comparable to those of the norms for the instrument in both the knowledge and awareness scales.  (Typical score in literature is 5 for counseling interns).

__3__b. Summary of Assessment Data Collected:
N=4.  Mean Awareness Score=5.8  Mean Knowledge Score =5.87. Typical score reported in literature is 5.

__3__b. Use of Results to Improve Instructional Program:
Small N makes generalization of results difficult.  Instrument to be administered at least two more times and data summarized. In fall of 2004 MCKAs will be administered pre-post in Multicultural Course to assess any positive changes and to raise awareness of multicultural competencies of the MACP students in the course.

__3_ c. Means of assessment and criteria for success:
Site Supervisors Rating Form, a locally developed measure, completed by site supervisors on our MACP students on internship and practicum placement.  Measure evaluates professional and counseling competencies.  For interns the supervisors’ ratings will average 80% in all competencies and none of the individual competencies will be less than 70%.

__3__c. Summary of Assessment Data Collected: 
N=3.  13 competencies/professional behaviors rated 100%. 

__3__c. Use of Results:
Small sample size limits generalization of results.  These findings combined with data collected in fall, 2003 =N of 5.  Results suggest that students are highly competent and professional from the site supervisors’ perspectives.  Survey requesting feedback concerning the Site Supervisors Rating From was mailed in December of 2003 and 5 were returned.  No revisions in the form were consistently recommended by the 5 respondents.  Data using the Site Supervisors Rating Form will continue to be collected for at least two more semesters.


SUPPORT DOCUMENTATION

Enter any document referenced above in this summary table.  There are two examples listed below. If no documents are cited, please remove the two examples from the table. 

SOURCE

LOCATION/Special Instructions

APA Style Evaluation Form: Graduate

 

Counseling & Psychotherapy: Theories & Applications Object Test

 

Working Alliance Inventory

 

Multicultural Counseling Awareness Scale

_____________________

 

Site Supervisor’s Rating Form

 

 

_______________________________