Compliance Certification
Home Core Requirements Comprehensive Standards3.1.1 Mission3.2.1 CEO Selection/Eval 3.2.2 Governing Board Control3.2.3 Conflict of Interest 3.2.4 External Influence3.2.5 Board Dismissal3.2.6 Board/Administration3.2.7 Organizational Structure3.2.8 Qualified Administrators3.2.9 Appointments 3.2.10 Administrator Evals 3.2.11 Athletics3.2.12 Fund-Raising3.2.13 Foundations3.2.14 Intellectual Property3.3.1 IE 3.4.1 Program Approval3.4.2 Continuing Education3.4.3 Admission Policies3.4.4 Acceptance of Credit3.4.5 Academic Policies3.4.6 Awarding Credit 3.4.7 Contractual Agreements3.4.8 Noncredit to Credit3.4.9 Academic Support3.4.10 Program Responsibility3.4.11 Program Coordination3.4.12 Technology Use3.5.1 College Competencies3.5.2 Institutional Credits3.5.3 Undergraduate Program3.5.4 Terminal Degrees3.7.1 Faculty Competence3.7.2 Faculty Evaluation3.7.3 Faculty Development3.7.4 Academic Freedom3.7.5 Faculty Governance3.8.1 Learning Resources3.8.2 Library Instruction3.8.3 Qualified Staff3.9.1 Student Rights3.9.2 Student Records3.9.3 Qualified Staff3.10.1 Financial Stability3.10.2 Financial Statements3.10.3 Financial Aid3.10.4 Financial Control3.10.5 External Funds3.11.1 Resource Control3.11.2 Environment 3.11.3 Physical Facilities3.12.1 Substantive Change3.14.1 AccreditationFederal Requirements   
Compliance DocumentComprehensive Standards3.3.1 Institutional Effectiveness 
 

The institution identifies expected outcomes for its educational programs and its administrative and educational support services; assesses whether it achieves these outcomes; and provides evidence of improvement based on analysis of those results.

 

   X   Compliance                    ___Partial Compliance                       ___Non-Compliance
 

Narrative

 

St. Petersburg College (SPC) is in compliance with Comprehensive Standard 3.3.1 because it identifies the expected outcomes for its educational programs and its administrative and educational support services, and uses these outcomes to facilitate performance improvement.  The following narrative will describe how the College identifies and uses assessment to verify whether it has achieved these expected outcomes.

 

Background

 

At SPC, Institutional Effectiveness is the integrated, systematic, explicit, and documented process of measuring performance against the SPC mission for the purposes of continuous improvement of academic programs, administrative services, and educational support services offered by the College. Each of SPC's units is required to participate in the institutional effectiveness and planning process.

 

The bottom-line from SPC’s institutional effectiveness and planning process is improvements to the College. Systematic institutional improvement requires a retrospective examination of the various statements of intent that the College leadership articulated at the inception of the planning cycle. At SPC, these intentions take on the form of the “Mission and Goal Statement”, “Institutional Direction and Objective Statement”, and unit/departmental purpose and objectives statements.  For a complete description of all the SPC Institutional Effectiveness Processes as well as the most recent aggregated results, please see the 2006-2007 Institutional Effectiveness Plan document.

 

Once SPC has identified clearly identified its objectives, it acts through the process of teaching, researching, and managing to accomplish its desired outcomes.  The level of success is then evaluated.  A straightforward assessment process requires a realistic consideration of the intended outcomes that the institution has set and a frank evaluation of the evidence that the institution is achieving that intent.  There is no single right or best way to measure success, improvement, or quality.  Nevertheless, objectives must be established, data related to those objectives must be collected and analyzed, and the results of those findings must be used to improve the institution in the future.

 

Expected Outcomes for Educational Programs, Administrative Services, and Educational Support Services

 

The College has clearly defined expected outcomes for both academic programs as well as administrative and educational support services.  These outcomes are the foundation of the quality improvement process at the College.  Only through established outcomes can performance be assessed and evaluated.

 

Academic outcomes are separated into two categories; general education outcomes and program-specific major learning outcomes (MLOs)

 

General Education Outcomes:  The College defines general education requirements for the Associate in Arts degree and the Associate in Science degree in Board of Trustees (BOT) rule 6Hx23-4.32.  The general education outcomes are defined in the St. Petersburg College Mission and Goal Statement as follows:

1.      Communicate effectively by demonstrating the ability to speak, listen, read and write in an organized and analytical manner.  (Communication)

2.      Demonstrate effective mathematical skills emphasizing practical problem solving and data interpretation.  (Mathematical Skills)

3.      Utilize the scientific method as it applies to understanding scientific and social phenomena.  (Scientific Method)

4.      Recognize basic scientific principles underlying human influence upon the earth and its inhabitants.  (Human Influence)

5.      Implement appropriate forms of existing and evolving technology for personal, educational, and professional purposes.  (Technology)

6.      Demonstrate the ability to work effectively with others in a variety of settings.  (Teamwork)

7.      Demonstrate an understanding and appreciation of the humanities and fine arts including participating in cultural activities featuring art, music, literature, dance and/or theater.  (Humanities/Art Appreciation)

8.      Participate as informed and responsible citizens in solving social, economic, and political problems in a multicultural and global society. (Informed Citizen)

9.      Recognize ethical issues and dilemmas in the per­sonal, business and social areas of their lives and apply ethical principles and logical problem-solving skills when making ethical decisions.  (Ethics)

10.  Think logically, critically, and creatively to solve prob­lems and make decisions.  (Critical Thinking)

11.  Recognize the importance of lifelong learning process in the pursuit of personal, intellectual and career development.  (Life-long Learning)

Program-Specific Major Learning Outcomes:  Each program is required to establish specific, measurable, student major learning outcomes to assist in providing program focus and a means for evaluating the performance of the program.  Major learning outcomes are used to develop a program’s course sequence map and ensure that each student has been exposed to an adequate amount of the curriculum in order to achieve the program’s major learning objectives (MLOs).  To provide an example of a program’s major learning objective’s, the eight major learning outcomes for the lower division paralegal program are listed below:

 

  1. The student will demonstrate the ability to analyze a problem; identify and evaluate alternative solutions; formulate logical solutions to problems; construct logical arguments in support of specific positions; evaluate solutions and arguments; and determine which areas of law are relevant to a particular situation.  (Critical Thinking)
  2. The student will demonstrate the ability to organize and manage information effectively and the ability to manage time efficiently.  (Organizational)
  3. The student will demonstrate the ability to interact effectively, in person, by telephone and in written correspondence with lawyers, clients, witnesses, court personnel, co-workers, and other business professionals.  (Communication)
  4. The student will demonstrate the ability to competently use the tools of research available in a standard law library, "cite check" the legal sources, run a computer assisted legal research program, and incorporate the results of the research into a proper memorandum format.  (Legal Research)
  5. The student will demonstrate the ability to write various types of documents, correspondence, pleadings, memoranda, and briefs.  (Legal Writing)
  6. The student will demonstrate the ability to deal with a basic word processing program, a spreadsheet program, and a database as well as presentation software; the student will apply these to solving organizational and management issues in the office setting.  (Computer and Law Office Management)
  7. The student will demonstrate basic interview and investigating skills including identifying and locating witnesses, potential parties to a suit and experts; preparing for and conducting effective interviews, locating information and obtaining records and using the Internet to obtain relevant and reliable information pertaining to a given situation.  (Interview and Investigation)
  8. The student will demonstrate knowledge of the types of work paralegals/legal assistants perform, the nature of supervision that must be present , the manner in which their conduct is directed by the ethical guidelines of the American Bar Association, the Florida Bar, and the ethical guidelines for paralegal/legal assistants.  (Professionalism and Ethics)

 

Administrative and Educational Support Services:  The administrative and educational support services are separated into three distinct areas; educational support services, student services, and administrative services.  The educational support services area is specific to the effectiveness of library services, information commons, and tutoring services, the student services area is primarily related to the effectiveness of student services, and the administrative services area is focused on the effectiveness of administrative services and the effectiveness of using technology at the College.

 

Educational Support Services Outcomes:  With a focus on the effectiveness of library services, information commons, and tutoring services, the educational support services outcomes are all related to the support of student learning.  The educational support services outcomes for 2006-2007 are listed below:

 

Outcome 1.  Students should have access to current print and audiovisual collections.

 

     Objective 1-1:  Improve collection currency

 

     Action Items for Objective 1-1:

1.      Continue inventory and purging of all print and audio visual resources and update collection database as measured by a withdraw 3% of collection and an increase of collections by 5%.

2.      Update campus collection development plans and add collection development guidelines for additional baccalaureate programs.

3.      Budget for library materials and equipment, and additional funding for the baccalaureate programs allowing the library to fulfill commitment to develop resources for the four-year programs and to improve general library collections and equipment.

4.      Increase the student survey rating of the currency of collections to a level of 80%.

5.      Continue to improve data collection within the libraries and from the Library Online on specific use of databases, and how the collections are used to aid in collection development.

 

Objective 1-2:  Increase numbers and types of electronic resources determined by changes in the College curriculum.

 

Action Items for Objective 1-2:

1.      Order additional NetLibrary titles, electronic journals, and Jstor periodicals

2.      Provide continuing funding support for Library Online

3.      Provide audio book collections

 

Outcome 2.  Students and Faculty should have the skills to successfully use electronic and traditional library resources

Objective 2-1:  To improve student Satisfaction Rating of the library as reported on the Enrolled Student Survey and the Library Survey.

Action Items for Objective 2-1:

1.      Engage students and Faculty in instructional experiences targeting Library Online, databases, and electronic reserves.

2.      Evaluate electronic reserves  (Docutek vs Angel)

3.      Offer courses online to improve student information literacy skills.

4.      Continue to create online library tutorials for Learning Management System  (Angel)

5.      Increase number of class-based instructional sessions.

6.      Improve student rating of reference service to 80% ‘very satisfied’ from 75%‘very satisfied’

7.      Increase student use of libraries from 86% to 90%. Evaluate factors that led to a decline in usage of 3% in 2005/06.

8.      Document library use of students in special populations:  Title III, Honors, Collegiate High School, Office of Services for Students with Disabilities (OSSD), and Baccalaureate programs.

 

Outcome 3.  Students and residents of Pinellas County should have access to library resources. 

 

Objective 3-1:  To improve access to library resources of the Downtown Center students and Faculty, the Midtown Center students and Faculty and the University Partnership Center students and Faculty, and joint use library users.

 

Action Items for Objective 3-1:

1.      Continue to improve library resources and services to Downtown and Midtown Centers

2.      Continue to improve library resources and services to University Partnership Center (UPC)

3.      Continue to provide library resources and services for users of joint use libraries

 

Outcome 4.  Staff should have adequate competency and be provided adequate levels of service

 

Objective 4-1:  To continue staff training in the use of the new library management system, and to provide opportunities for professional development.

 

Action Items for Objective 4-1:

1.      Continue training in Aleph systems.

2.      Provide opportunities for staff to attend workshops, conferences, and courses

3.      Provide training in use of technology

4.      Require all librarians and adjunct librarians to participate in Angel training

 

Outcome 5.  All students should have access to library services and programs

 

Objective 5-1:  To provide specialized library services and programs for targeted student groups

 

Action Items for Objective 5-1:

1.      Continue to develop and implement plan for student engagement for Title III

2.      Continue to develop and implement plan for student engagement for Honors   Program

3.      Continue to develop and implement plan for student engagement for Collegiate High School

4.      Continue to develop and implement plan for student engagement for students with disabilities

 

Student Services OutcomesThe student services area is primarily related to the effectiveness of student services.  Previous year survey results are used to establish specific areas for improvement.  The focus for the 2006-2007 outcomes was in the area of student with disabilities.  The identified outcomes for the 2006-2007 report are shown below.

 

Outcome 1.  Students should have a general level of satisfaction with the services for students with disabilities

 

Objective 1-1: To maintain an overall satisfaction rate at a minimum score of 4.29 and to improve each area of the evaluation by .2 points.

 

Action items for Objective 1-1:

1.      A Learning Specialists’ meeting will be held to review lowest sub scores at each campus before March, 2006.

2.      The Office of Services for Students with Disabilities (OSSD) committee will determine areas on which to focus and will outline strategies to improve lowest scores Collegewide.

3.      Each Learning Specialist will work with campus personnel and resources to improve lowest scores on his/her campus.

4.      Student Survey will be administered August 2006, and the results will be the documentation of this objective.  This survey will be redesigned to correspond with the methodology of the Collegewide student survey, reflecting both the importance of each area of evaluation to the student and the students’ satisfaction with the particular area.

5.      With the increase of students with specific disabilities that require more assistance, such as psychological, visual and deaf and hard of hearing disabilities, recommendations for changes in staffing and the most effective use of professional Learning Specialists will continue to be explored, using the State disability services staffing formula.

 

Outcome 2.  Students with disabilities should have an adequate opportunity to receive a college education.

 

Objective 2-1:  To maintain at minimum the same graduation rate as achieved in 2005.

 

Action items for Objective 2-1:

1.      Academic advising - academic advisors and counselors will be offered individual or small group disability awareness training.  Outlines and dates of contacts will be recorded.

2.      Progress monitoring - Learning Specialists will see that 85% of the students currently registered this year are contacted by phone or office visit.  Calls/contacts will be documented in each student's folder or in a central log, depending on campus procedure.

3.      Professional tutors will attend at least 2 trainings about teaching learning strategies, rather than content, in an effort to make students more independent learners and more academically successful.  Outlines of workshops will be collected with attendance sheets.

4.      Hours for a current part-time Learning Specialist position will be increased to provide a higher level of service for students.

 

Outcome 3.  Guidelines used by the Office of Services for Students with Disabilities (OSSD) should be as current as possible with state and Federal regulations.

 

Objective 3-1:  Review College wide rules and procedures and update notebooks and complete updated notebook by May 2006.

 

Action items for Objective 3-1:

1.      Departmental guidelines review will become a standing agenda item for OSSD committee meetings.  As revisions/additions are made, rules and procedures will be added to notebooks.

2.      Updated notebooks will be compiled for reference by Learning Specialists and one copy of this will serve as the artifact for this objective.

 

Outcome 4.  Faculty will be exposed to workshops on how to support student with disabilities and special needs.

 

Objective 3-1:  Increase offerings of training for staff, including information on Assistive Technology.

 

Action items for Objective 3-1:

1.      Each Learning Specialist will offer at least one training based on the needs of his/her particular campus Faculty.  These needs will be assessed through meetings with the Associate Provosts, academic program directors and other relevant personnel.

2.      Include at least one workshop session during the annual Narrowing the Gulf for Disadvantaged Students conference that deals with disability issues. 

3.      Submit the outline of the training and any pertinent artifacts to go into a Collegewide documentation folder for Southern Association of Colleges and Schools (SACS).

4.      With funds received by a three year demonstration grant from the Department of Education, Faculty awareness will be increased through online workshops that will be made available in October 2006.  These workshops will be located on an online Disability Awareness Resource Center that will include Frequently Asked Questions, links to other resources, information about the Americans with Disabilities Act and how it applies to higher education, and campus contacts.  SPC will also be identifying two - three Faculty from each campus to serve as ‘champions’ on their campuses.  These champions will receive extensive training in disability issues and in effective ways to market and/or advocate for a cause with their colleagues.  They will work with the Project in encouraging their colleagues to access the Website and participate in the workshops.

 

Administrative Services Outcomes: The administrative services area is primarily focused on the effectiveness of administrative services and the effectiveness of using technology at the College. In general, students should have a general level of satisfaction with thirty-two listed services/offices. Previous year survey results are used to establish specific areas for improvement. The identified outcomes for the 2006-2007 report are shown below.

 

Outcome 1.  Students should have a general level of satisfaction with College’s parking services.

 

Objective 1-1:  Improve the performance gap for student parking on the Enrolled Student Survey.

 

Action items for Objective 1-1:

1.      Scattered Parking: St. Pete/Gibbs.  The vacation of 69th Street is now complete.  Parking lot construction is continuing on the west side of campus.  The next phase of the SPG parking lot renovation will be the western most lot, scheduled to begin during 2006-2007.  These lots will provide additional parking for the entire west side of campus.  Scattered parking has been in place on the north side of the administration building and has been successful.

2.      Scattered Parking:  Health Education Center (HEC). SPC has acquired 2½ acres of contiguous space which is now available for parking.

3.      Scattered Parking: Clearwater.  The new “scattered parking” system is in place for late afternoon and evening hours at the Clearwater campus.  There are often many vacant faculty and staff spaces during the late afternoon and evening hours.  Previously these spaces have been off limits to students.  Now the spaces are available for students during these hours.

 

Outcome 2.  Students should have a general level of satisfaction with College’s bookstore services.

 

Objective 2-1:  Improve the performance gap on the Enrolled Student Survey for bookstore services.

 

Action items for Objective 2-1:

Several Faculty members have agreed, in science and math, to use the same books for multiple years, thus saving students money by making more used books available and extending the life of the existing editions.

1.      The Seminole bookstore will be enlarged and will have its own manager to better serve the eCampus as well as traditional students.  The textbook needs of both campuses will be better served, especially the eCampus whose textbooks are now available only at the home campus bookstores.

2.      The “Books Now” capability in Peoplesoft will allow students to buy books for classes online, immediately upon registration.  A link to the appropriate text at Follett will appear on the Peoplesoft screen at the time of registration.

3.      Implement e-adoptions, encouraging Faculty and bookstore managers to work together to have book lists of required texts earlier so that books will be ordered sooner and will be in stock when students need them.

4.      The book “line of credit”, enables financial aid recipients to get textbooks in person or online before their financial aid is released.

5.      Bookstore summit meetings are continuing to discover additional ways to reduce the increasingly high cost of textbooks for students.  These meetings are focusing on standardizing texts for general education classes, using textbooks longer and unbundling the textbook packages (where CDs and the textbook are both required to be purchased by the student).  Participants include senior administration, students, bookstore representatives, program directors and Faculty.

6.      Build the new bookstore on the Tarpon Springs campus in the Olympia building to be available by Spring 2006.

7.      Continue the bookstore sponsored customer service training for their front line representatives.  This will improve the assistance they give students who are looking for particular texts.  This will also aid in the technical aspects of dealing with independent agencies such as the VA and Vocational Rehab regarding vouchers and payments.

8.      Continue improving the bookstore Web site to reduce the number of screens a student must navigate to locate a text and purchase it.

9.      Continue periodic meetings of the bookstore focus group consisting of students, Faculty, administration, and bookstore representatives.  This group, at an operations level, identifies and takes corrective action on bookstore issues that come up over the academic year and adversely affect student satisfaction.

 

Outcome 3.  Students should have a general level of satisfaction with College’s food services.

 

Objective 3-1:  Improve the student’s opinion of the SPC food services as recorded by the enrolled student survey.

 

Action items for Objective 3-1:

1.      Collegewide – With the advent of the EpiCenter, a new distinctly attractive café opened this year with a new food service.  The food service provider services both EPI and the services building on site.  In addition to SPC students, this café will serve the corporate training clients and others jointly occupying the facility.  Hours are extended to meet student’s needs in the evening as well as breakfast.  The new food service also provides food services and catering by campus.

2.      SP/Gibbs – The new cafeteria opened this year adjacent to the instructional facilities.  This centrally located cafeteria serves both the joint use library as well as the entire SPG campus.  Outdoor seating is available.  A new foodservice vendor is in place and providing greater selection and better quality.

3.      Tarpon Springs Center – Proceeding with construction of a new cafeteria in the Olympia building similar to the Hard Drive Café in Clearwater; except larger, with expanded seating and food options to be available by spring, 2006.  In the mean time vending has been expanded to include more hot food and a wider selection of cold food and snacks.

4.      Seminole – The student services director will continue to offer new menu items based upon ongoing review at the Gigabyte Café.

5.      Clearwater – Offerings will continue to be expanded at the Hard Drive Café.

6.      HEC – Negotiations for a new contractual food service provider are underway and will be concluded this spring.

 

Assessment Activities for Educational, Administrative, and Educational Support Units

 

Assessment at the College is on-going and intended to support quality improvement efforts.  The Institutional Effectiveness Processes at the College focus assessment in four distinct areas; academic, educational support, student support, and administrative services.

 

Educational Assessment:  Educational programs use a variety of assessment methods to improve their effectiveness. Assessment and evaluation measures are used at various levels throughout the institution to provide Provosts, Deans, Program Managers and Faculty vital information on the success of recent efforts.  While the focus of a particular educational assessment area may change, the assessment strategies remain consistent and are integrated to the fullest extent possible.

 

The focus for the Associate of Arts degrees is targeted on students continuing on to four-year degree programs as opposed to the Associate of Applied Science and Associate of Science and Baccalaureate programs which target students seeking employable skills. The General Education-based assessments focus on the general learning outcomes from all degree programs, while the Program Review process looks at the viability of the specific programs.  The College has developed an Educational Assessment Website to serve as repository for all SPC’s educational outcomes reports and to systematically manage the College’s assessment efforts.

 

While the College uses a multi-measure approach when assessing its programs, specific direct measures have been created for each academic area. These specific direct measures include the General Education outcome assessments designed to measure each individual General Education Outcome as listed earlier in the document, the academic program assessment report (APAR) designed to assess the specific major learning outcomes, and the comprehensive academic program reviews (CAPRs) which are designed to evaluate the over picture of a program’s quality and viability. The contents of these reports and reviews are listed in the table below. The academic program viability review (APVR) indicated in the table below is a recent enhancement to the evaluation/assessment process – having replaced a previous ad hoc assessment known as the First-cut, Second-cut, Third-cut Productivity Report.

 

A Comparison of the Major Academic Outcomes Assessment Reports

 

Academic Program

Viability Review (APVR)

Academic Program Assessment Review (3) (APAR)

Comprehensive Academic Program Review (3)

(CAPR)

Oversight Group

Report

1)       Program Description (1)

2)       Number of Graduates – by year

3)       Actual Enrollments – by last six semesters

4)       SSH Productivity – by last six semesters

5)       Program Profitability – RPI Index by year

1)       Introduction w/ use of past results (1,2)

2)       Major Learning Outcomes – program specific (1, 2, 3)

3)       Assessment Methodology (3)

4)       Criteria for success (3)

5)       Summary of assessment findings

6)       Discussion & analysis

7)       Action plan & time table

8)       Budgetary & planning implications

9)       Follow-up report

1)       Key APAR findings

2)       Key APVR findings

3)       Environmental scan of stakeholders – program specific (1)

4)       Enrollment / Graduation trends

5)       Employment / wages trends (1)

6)       Discussion & analysis

7)       Action plan & time table

8)       Annual follow-up report

9)       Cabinet Review & Approval

1)       Outcomes Assessment
Sources (1)

2)       Previous Year’s Plans & Results (1,2)

3)       Current Year Assessment
Results (1,2)

4)       Key Areas Requiring Improvements (not meeting criteria / expectations)

5)       Recommended Action Plans

6)       Cabinet Review & Approval

 

Notes:

1) SACS Compliance Requirement

2) Florida DOE Recommendation

3) BOT Rule 6Hx23-3.04 Requirement

 

General education assessments (see section 3.5.1) and academic program assessments have been conducted according to a three-year cycle.  Comprehensive academic program reviews were traditional conducted according to a five-year cycle and have just recently been changed to a three-year cycle to better integrate with the program assessments.  A diagram of the integrated three-year cycle for the Academic Program Assessment Report (APAR) and the Comprehensive Academic Program Review (CAPR) is provided below.

 

                   Three-Year Academic Program Assessment Cycle

 

 

In addition to the internal measures, nationally normed assessments, such as the Educational Testing Service’s (ETS) test for General Education (e.g., Measure of Academic Proficiency and Progress [MAPP]), state licensure exams, and Community College Survey of Student Engagement (CCSSE) are used as outside benchmarks for measuring student learning.  The College has developed an Educational Assessment Web site to serve as repository for all SPC’s educational outcomes reports and to systematically manage the College’s assessment efforts.

 

Educational Support Services Assessments:  Educational support services assessment is conducted on a yearly cycle.  Educational support services assessment uses student surveys, which are an essential part of the evaluation process.  Many of the survey instruments (with updated questions) have been used by the College for years.  Students are surveyed at different points in their educational career to determine changes or improvements that could be implemented to enhance the institutional and learning experience.  The specific survey related to the educational support services are listed below:

 

§         Annual Library Survey

§         Enrolled Student Survey

§         Commons/Learning Support Center Survey

§         Florida Community College Assessment Report

 

Administrative Services Assessment: Administrative Services are also conducted on a yearly cycle.  Surveys are used to judge the performance of administrative services as it relates to students, college staff, and administration.  The Administrative Services Oversight Group reviews the survey reports annually and determines whether intervention based on survey findings is required.

 

§         Entering Student Survey

§         Institutional Research Evaluation Questionnaire

§         Enrolled Student Survey

§         Technology Resources Allocation Process Satisfaction Survey

§         Graduating Student Survey

§         Annual Budget Planning Evaluation

§         Recent Alumni Survey

 

 

Student Services Assessment: Student surveys are also an essential part of the student services evaluation process. Students are surveyed at different points in their educational career to determine their perceptions in order to implement changes and improvements that will enhance the institutional and learning experience. The Students Support Services Oversight Group reviews survey reports annually and determine whether intervention based on survey findings is required. These assessments include the following surveys:

 

§         Entering Student Survey

§         Graduating Student Survey

§         Enrolled Student Survey

§         Recent Alumni Survey

§         OSSD Student Satisfaction Survey

 

 

Broad-based Participation in Assessment Activities

 

There is broad-based participation of Faculty, Program Directors, and Deans in all educational assessment activities.  Academic assessments are Faculty driven and are conducted in conjunction with Program Directors and College assessment staff. Each Program Director or dean works closely with the Institutional Effectiveness staff and the program’s full-time Faculty to develop assessments that provide meaningful data on student learning.

 

Other departments, such as the Library, Counseling Services, Technology, Budget, and Institutional Effectiveness, have developed internal surveys that provide more detailed information on satisfaction with the services provided to students, Faculty, and staff than can be gained from the more general Enrolled Student Survey, which measures student satisfaction with all student services.  Other data elements include:

 

§         Entering Student Survey

§         Graduating Student Survey

§         Recent Alumni Survey

§         State Accountability Measures

§         Institutional Core Effectiveness Indicators Report

§         FACTBOOK

§         Research Briefs

§         Educational Outcomes Assessment Reports

§         State Reports

§         Other Departmental Specific Surveys

 

Data are gathered continuously (or annually) and are analyzed and presented by the Institutional Effectiveness staff in series of workshops to key College personnel.  This includes members of the College’s Four Oversight Groups during the strategic planning process.  This distribution of assessment data is intended to familiarize key decision-makers about the availability and interpretation of performance data.  The four oversight groups review the data from their area based on prior year’s goals and objectives.

 

Below is a short description of the four oversight groups.

 

·         The Educational Oversight Group members are appointed by the College President. Their focus area is to review key educational outcomes information including, but not limited to, “Educational Outcome Assessment Reports”, “State Accountability Measures Reports” and Student Survey Reports.  The group leader/chairperson is appointed by the President.

 

·         The Educational Support Services Oversight Group is an ad hoc working group.  Its focus area is to review key information concerning the effectiveness of library services, information commons, and tutoring services.  The group leader/chairperson is the Director of Library Services.

 

·         The Student Services Oversight Group is an ad hoc working group. Its focus area is to review key information concerning the effectiveness of student services.  The group leader/chairperson is the Vice President of Educational and Student Services.

 

·         The Administrative Services Oversight Group is an ad hoc working group.  Its focus area is to review key information concerning the effectiveness of administrative services and the effectiveness of using technology at the College.  The group leader/chairperson is the Vice President of Business Services.

 

The purpose of these meetings is multi-dimensional.  First, the groups evaluate whether the institution successfully achieved its desired outcomes from the previous institutional effectiveness and planning cycle.  A wide variety of information is reviewed to ensure that the mission, goals and institutional objectives of the College have been accomplished.  Secondly; the group looks at very specific information to judge the success of quality enhancement initiatives from the previous year’s cycle.

 

Next, the most current environmental information is used to formulate quality improvement initiatives for the next institutional effectiveness and planning cycle.  The collaboration between the various units/departments in this oversight group format allows for broad base participation and creates a strong buy-in to SPC’s assessment and continuous improvement efforts.

 

Use of Programmatic Outcomes for Improvement

 

A number of programmatic outcomes are used to drive SPC’s performance improvement process.  Many of these take the form of statewide accountability measures.  Statewide Accountability information is used for evaluating system performance (assessment of improvement, quality, and efficiency), performance funding, and in the annual evaluation of the College President.  While the State of Florida has established statewide benchmarks for evaluation of performance, the College has established its own more rigorous benchmarks to support College level performance improvement.  The statewide accountability measures (SAM) and their associated bench marks are listed below:

 

1. Prior High School Graduates Enrollment (Measure 1 – Part 1)

The number and percent of prior year Florida public high school graduates from the community college service area by ethnic category that were enrolled at the College in the same service area.  The information is displayed by degree-seeking and non-degree seeking students and includes a distribution by college (28) and a system-wide total.

 

Statewide Benchmark:  Increase the percent of first-time-in-college (FTIC) minority student enrollments until they are equal to the previous year’s high school graduates.

 

SPC Target:  Increase black enrollment as a percent of pervious year’s high school graduates to 35%.

 

2. Retention and Success Rate Report (Measure 1 – Part 2)

The status after four years of FTIC, Associate of Arts (AA), Associate of Science (AS), and Associate of Applied Science (AAS), degree-seeking students who earned at least 18 college-level credits.  For Post-Secondary Vocational Certificate (PSVC) and Applied Technology Diploma (ATD) students, status was at the end of three years.  Also, the report shows a distribution by college (28) and system-wide total, segmented by ethnicity, full-time/part-time status, and program area (AA, AS, AAS, PSVC, ATD).  Below are some definitions of what was represented in the SAM report:

 

  • Cohort - a group of students who were FTIC, degree-seeking, and earned at least 18 college-level credits during the tracking period.
  • Graduated – Of the cohort, the number and percent who graduated.
  • Number Enrolled in Good Academic Standing - Of the cohort, excluding the number the graduated, the number of students still enrolled at the institution with a GPA at or above 2.0.
  • Number Not Enrolled in Good Academic Standing - Of the cohort, excluding the number the graduated, the number of students still enrolled at the institution with a GPA below 2.0.
  • Left in Good Standing – Of the cohort, excluding the number the graduated, the number of students not enrolled at the institution with a GPA at or above 2.0.
  • Retention Rate  - (Number Graduated + Number Enrolled in Good Standing + Number Enrolled Not in Good Standing) divided by the Total Cohort Population.
  • Success Rate  - (Number Graduated + Number Enrolled in Good Standing + Left in Good Standing) divided by the Total Cohort Population.

 

Statewide Benchmark:  Retention Rate = 70%, Success Rate = 80%

 

SPC Target:  Retention Rate = 65%, Success Rate = 90%

 

3.  AA Degree Transfer Performance in the State University System (SUS) Report (Measure 2)

Performance of AA degree completers or graduates who transferred to the state universities the following year. T he SAM report focuses solely on the performance of native students who received their complete education from one institution.  Also, the report shows a distribution by college (28), system wide total, segmented by ethnicity and former college preparatory/non-college preparatory status.

 

Statewide Benchmark:  70% of AA student who transfer to the SUS will perform at a grade point average (GPA) of 2.5 or higher.

 

SPC Target:  70% of AA student who transfer to the SUS will perform at a GPA of 2.5 or higher.

 

4. Licensure Passing Rate Report (Measure 3 – Part 1)

Shows the number of students tested, number of students passed, and the percentage of students passed for each appropriate vocational program licensure exam by college.  The SAM information for this measure has been sporadic and local information was used to supplement (2006-2007 SPC Fact Book Table 37).

 

Statewide Benchmark:  90% of all students sitting for licensure exams will pass.

 

SPC Target:  85% of all students sitting for licensure exams will pass.

 

5. Vocational Program Placement Report (Measure 3 – Part 2)

Number and percentage of completers (graduates) placed according to state-level follow up which includes college supplemental placement data.  Students are considered to be placed if they are continuing their education, in the military, and working in a field related to their education.  The SAM information for this measure has been sporadic and local information was used to supplement (2006-2007 SPC Fact Book Table 38).

 

Statewide Benchmark:  90% of all students who complete a program will be placed.

 

SPC Target:  90% of all students who complete a program will be placed.

 

6. College Preparatory Success Report (Measure 4 – Part 1)

Number and percent of FTIC degree-seeking students who took an entry-level test.  Of those students, the report shows the number and percent who failed some portion of their entrance exam, how many of those students enrolled in a college preparatory course (for area needed), with the number and percentage of those who passed the highest level college preparatory course within two years meeting the standards for admission into college level courses.  Also, the SAM report shows a distribution by college (28) and system wide total and by ethnicity.

 

Statewide Benchmark:  Students who need remediation pass the highest-level college preparatory course at the following rates:  reading – 65%, writing – 68%, math – 50%.

 

SPC Target:  Students who need remediation pass the highest-level college preparatory course at the following rates:  reading – 70%, writing – 70%, math – 50%.

 

7. College Preparatory Retention and Success Rate Report (Measure 4 – Part 2)

The status after four years of first-time-in-college (FTIC) AA, AS, and AAS degree-seeking students who earned at least 18 college-level credits.  For PSVC and ATD students, status was at the end of three years.  Also, the SAM report shows a distribution by college (28) and system-wide, segmented by ethnicity, full-time/part-time status, and program area (AA, AS, AAS, PSVC, ATD).

 

Statewide Benchmark:  Retention Rate = 70%, Success Rate = 75%

 

SPC Target:  Retention Rate = 70%, Success Rate = 80%

 

8. CLAST Performance Report (Measure 5)

College Level Academic Skills Test (CLAST) results for native students who completed 60 or more college-level credits. This includes students who attempted either the CLAST or had a CLAST alternative and the percent meeting the CLAST requirements. The SAM report shows a distribution by college (28) and System wide total, segmented by student who used CLAST alternatives, students who attempted the CLAST, and the combination of the two. Please note CLAST alternatives are institutionally determined.

 

Statewide Benchmark:  80% of all students who completed 60 credit hours pass all parts of CLAST.

 

SPC Target:  75% of all students who completed 60 credit hours pass all parts of CLAST

 

In addition to the use for statewide accountability measures, the College has enhanced its program review model to include a number of programmatic outcomes.  The comprehensive academic program review (CAPR) is conducted on a three-year cycle and includes programmatic measures such as:

 

1)      Program Performance Measures

a)      Enrollments

b)      Productivity

c)      Graduates

d)      Success (grade distributions)

e)      Full-time/Adjunct Faculty Ratio

 

2)      Program Profitability Measures

a)      Relative Profitability Index (RPI)

 

3)      Program Academic Outcomes

 

4)      Stakeholder Program Perceptions

a)      Student Survey of Instruction (SSI)

b)      Technical Education Advisory Committee Minutes Summaries

c)      Recent Graduate Survey Results

d)      Employer Survey Results

 

5)      Program’s Occupation Profile

a)      Occupation Description

b)      US, State, and Area Wage Information

c)      US, State, and Area Trend Information

d)      State Accountability Measures

 

Using Assessment Results to Improve Educational Programs, Administrative Services, and Educational Support Services

The institutional objectives are developed through the evaluation of the previous year’s assessments.  This includes educational outcomes, institutional surveys, and departmental-specific assessments. Individual assessments results are reviewed by the respective oversight group which in turn aggregates the information and presents recommendations to the President’s Cabinet.  These recommendations are evaluated and routinely summarized in the form of the Institutional Objectives (IOs).

Four examples are presented below that demonstrate the effectiveness using assessment results to improve educational programs, administrative services, and educational support services.

Educational Assessment Example:  Educational Assessment results are continually used by SPC staff to improve educational outcomes.  Educational assessment data was used to develop th