Compliance Certification
Compliance Document >   Core Requirements >   2.5 Institutional Effectiveness
 

The institution engages in ongoing, integrated, and institution-wide research-based planning and evaluation processes that incorporate a systematic review of mission and goals that (a) results continuing improvement and (b) demonstrates that the institution is effectively accomplishing its mission.

 

   X   Compliance                    ___Partial Compliance                       ___Non-Compliance

 

Narrative

 

St. Petersburg College is in compliance with this requirement because it has an ongoing, integrated, and institution-wide research-based planning and evaluation system that results in continuous improvement and effective mission accomplishment.  The following narrative will describe the research-based planning and evaluation processes at the College that support continuous improvement and demonstrate that the College effectively accomplishes its mission.

 

The SPC Institutional Effectiveness Processes

 

At St. Petersburg College (SPC), Institutional Effectiveness is defined as the integrated, systematic, explicit, and documented processes of measuring performance against the SPC mission for purposes of continuous improvement of academic programs, administrative services, and educational services offered by the College.

 

The SPC institutional effectiveness processes are systematic, ongoing, integrated, and research-based.  These processes are designed to result in continuous improvement and comprise the following: (a) the mission statement process; (b) the evaluation and assessment processes for academic programs, student services, and administrative services; (c) the Strategic Directions and Institutional Objectives process; (d) the unit / budget planning process, (e) the Collegewide operating budget development process, and (f) budget approval, implementation, and annual operating results.

 

 

 

 

The above diagram summarizes the SPC Institutional Effectiveness Processes, and how the individual processes are integrated.  Each of these processes is further described below.  In addition, a more detailed diagram depicting the integration and linkages among these processes, and how they are actually performed, is also available. For a complete description of all the SPC Institutional Effectiveness Processes as well as the most recent aggregated results, please see the 2006-2007 Institutional Effectiveness Plan document.

 

(a) The Mission Statement Process

 

The Mission is formally revised at least every five years with the latest formal revision completed in the 2004-2005 academic year by a committee representing Faculty, administrators, students, community leaders and members of the Board of Trustees and was approved by the Board of Trustees in May, 2005.  The Mission also is reviewed annually by President’s Cabinet before the new strategic planning cycle begins.  In the most recent review in January 2007, the President’s Cabinet recommended minor changes to the Board of Trustees Rule on the College’s mission and goals, including inserting the term “globally” in place of “in the State of Florida and other areas,” scheduled for consideration by the Board of Trustees on March 20, 2007.  This change is included the latest revision to Board of Trustees Rule to incorporate the changes adopted by the Board, placed on the SPC Web site upon adoption, and revised in the printed College Catalog for 2007-2008.  The prior revision in 2002 added the baccalaureate degrees, published in the 2002-2003 College Catalog.

 

St. Petersburg College’s Mission is published and distributed widely in the College Catalog; Board of Trustees’ Rules and Procedures Manual; St. Petersburg College Faculty Manual; and the Student Handbook.  It is also directly accessible on the College Web site from the Prospective Student page, Interested Visitor page, and Potential Employee page, as well as through the College Catalog and Student Handbook links on the Current Student page and the Institutional Effectiveness pages on the employees’ Staff Central.

St. Petersburg College Mission Statement

 

 

(b) The Evaluation & Assessment Processes - Academic Programs, Student Services, and Administrative Services

Evaluation and Assessment processes at SPC are centered on mission-driven outcomes in the following program and service areas: (i) 26 organizational units comprising 37 academic programs (lower division); (ii) 18 organizational units comprising 18 academic programs (upper division), and (iii) key administrative and educational support services.  Analysis of outcome results is on-going and captured in various assessment reports.  Institutional effectiveness at SPC assesses all degree programs and courses, regardless of mode of delivery.  SPC also evaluates all student services to ensure students are provided the best support possible to ensure student success.

The following are the key assessments used in the evaluation & assessment processes of SPC’s Institutional Effectiveness.

 

  •    Academic Program Assessments include internally and externally developed direct measures for General Education (e.g., Educational Testing Service’s Measure of Academic Proficiency and Progress [MAPP]), AAS/AS Program Assessments, BAS/BS Program Assessments, and Program Reviews.  Outcome results for the academic programs are documented in three (3) types of assessment reports as follows: the Academic Program Viability Report (APVR) is completed on an annual basis; the Academic Program Assessment Review (APAR) is completed on a 3-year cycle; and the Comprehensive Academic Program Review (CAPR), which is also completed on a 3-year cycle.  These reports are described in more detail in the table below.

  •    Academic/Student Services Assessments include indirect measures for Entering Students survey, Enrolled Students survey, Graduating Student survey, Recent Alumni survey, Employer survey, and the Community College Survey of Student Engagement (CCSSE). Administrative and educational support services are evaluated annually.  Results of Collegewide student surveys are further refined and augmented through additional departmental-specific assessments.

  •    Other Assessments include the President’s Annual Evaluation portion of the Year-End Report on Strategic Directions and Institutional Objectives (SD-IOs), State Accountability Measures, Core Effectiveness Indicators, environmental scan / trends analysis, and other department/function-specific assessments.

 

SPC IE Program Evaluations & Assessments - Content

Academic Program

Viability Review (APVR)

Academic Program Assessment Review (3) (APAR)

Comprehensive Academic Program Review (3)

(CAPR)

Oversight Group

Report

1)       Program Description (1)

2)       Number of Graduates – by year

3)       Actual Enrollments – by last six semesters

4)       SSH Productivity – by last six semesters

5)       Program Profitability – RPI Index by year

1)       Introduction w/ use of past results (1,2)

2)       Major Learning Outcomes – program specific (1, 2, 3)

3)       Assessment Methodology (3)

4)       Criteria for success (3)

5)       Summary of assessment findings

6)       Discussion & analysis

7)       Action plan & time table

8)       Budgetary & planning implications

9)       Follow-up report

1)       Key APAR findings

2)       Key APVR findings

3)       Environmental scan of stakeholders – program specific (1)

4)       Enrollment / Graduation trends

5)       Employment / wages trends (1)

6)       Discussion & analysis

7)       Action plan & time table

8)       Annual follow-up report

9)       Cabinet Review & Approval

1)       Outcomes Assessment
Sources (1)

2)       Previous Year’s Plans & Results (1,2)

3)       Current Year Assessment
Results (1,2)

4)       Key Areas Requiring Improvements (not meeting criteria / expectations)

5)       Recommended Action Plans

6)       Cabinet Review & Approval

Notes:

1) SACS Compliance Requirement

2) Florida DOE Recommendation

3) BOT Rule 6Hx23-3.04 Requirement

 Academic and College services outcome results, as documented in the above evaluation and assessment reports, are widely published on the College’s IE Web site.  Hardcopies are retained in a central repository by the College’s Institutional Effectiveness (IE) staff.  These various Collegewide assessment results are then aggregated and presented to one of the four domain-specific oversight groups at the start of the planning year.  They are used by the College’s IE Team, oversight groups, President’s Cabinet, and Unit / Budget Managers to design and drive the College’s Strategic Directions and Institutional Objectives (SD-IOs), individual unit plans, and College’s Annual Operating Budget

 

The College’s Institutional Effectiveness (IE) Team and the four domain-specific assessment oversight groups organize and conduct a series of meetings which occur annually prior to kick-off of the College’s Planning and Budgeting Processes (described below).  The assessment oversight groups are charged with the following key tasks: (i) evaluate whether the institution successfully achieved its desired outcomes from the previous institutional effectiveness and planning cycle, (ii) identify key areas requiring improvement that were identified in the assessment analysis, and (iii) develop strategies and recommendations for quality improvement initiatives for the next institutional effectiveness and planning cycle.

 

The four oversight groups along with their charge are listed below:

 

  • The Educational Oversight Group reviews key direct and indirect measures of educational outcomes including, but not limited to, Educational Outcome Assessment Reports, State Accountability Measures Reports, and student survey reports.

  • The Educational Support Services Oversight Group reviews measures of assessment data and other key information concerning the effectiveness of library services, information commons, and tutoring services.

  • The Student Services Oversight Group reviews measures of assessment data and other key information concerning the effectiveness of student services.

  • The Administrative Services Oversight Group reviews measures of assessment data and other key information concerning the effectiveness of administrative services and the effectiveness of using technology at the College.

 

The next table shows the linkages between the College Mission Statement components, the evaluation and assessment reports, College staff responsible for the evaluations and assessments, and the recurring cycles.

(c) The Strategic Directions and Institutional Objectives Process

 

The College’s Strategic Directions and Institutional Objectives (SD-IOs) are comprised of longer-term directional statements and shorter-term, annually measurable objectives.  The Strategic Directions, represented by the all-caps, alphabetized statements, are updated on a three-year cycle and are based on achieving the college’s mission.  The Strategic Directions are developed with improvements in learning outcomes, quality, productivity, and other environmental-scan considerations, as well as inputs from IE Team, members of the President’s Cabinet, Faculty and student representatives, the Board of Trustees, and external/community stakeholders.

Alignment of Mission Statement with the College’s Strategic Directions

Mission Statement

Strategic Directions

To provide accessible, learner-centered education for students

Deliver excellent educational programs and improve learning outcomes using a variety of learner-centered approaches.

Strengthen commitment to access, equity and diversity.

… To deliver enriched learning experiences …

… To assure a climate for student success …

Provide excellent service to students to enhance their learning experiences and help them achieve.

SPC embraces continuous institutional self-evaluation to assure a climate for student success and an enduring commitment to excellence.

Strengthen internal planning, systems and processes to improve efficiency and effectiveness, foster communication, and provide access to information for institutional management and decision-making.

… Led by an outstanding team of diverse Faculty and staff …

Provide faculty and staff development and support to improve productivity and performance.

St. Petersburg College seeks to be a creative leader and partner with students, communities, and other educational institutions to deliver enriched learning experiences and to promote economic and workforce development.

Strengthen the college's identity as a vital community resource, including an emphasis on economic development.

Secure additional resources through targeted fundraising and creative partnerships.

As a comprehensive, multi-campus postsecondary institution …

Provide quality facilities and equipment to meet student and community needs.

… To provide accessible, learner-centered education for students pursuing selected baccalaureate degrees… (other degrees follow)

Expand access to bachelor's degrees and graduate degrees in Pinellas County, particularly in critical shortage areas.

 

The College’s Institutional Objectives, represented by the numeric statements in the SD-IOs document, are reviewed and updated annually, with key on-going initiatives updated based on progress made during the prior year and carried forward, where appropriate.  Each institutional objective is designed for the purpose of achieving the corresponding longer-term strategic direction.  The 2006-2009 Strategic Directions and 2007-2008 Institutional Objectives are the most recent version, and they were approved by the Board of Trustees at their January 22, 2007 meeting.  Earlier approved versions of the SD-IOs, under which the College’s continuous improvement initiatives and operations were conducted, are available dating back prior to 1999-2000.

 

(d) The Unit / Budget Planning Processes

 

The College’s Unit / Budgeting Processes are centered on: (a) more than 150 Unit / Budget Managers, (b) development of departmental unit plans and budget requests, and (c) use of the national award winning Strategic Planning Online (SPOL) centralized computing system.

 

In developing their unit plans and budget requests, the Unit / Budget Managers are urged and encouraged to access, review, and make use of all available assessment outcome data, as published on the College’s IE Web site, and as documented in the oversight group reports described above.  In addition, budget guidelines are prepared by the Collegewide Budget Committee, which provides information about the College’s expectations for State appropriations, the Collegewide budgetary outlook, and salary package and other key strategic expectations.  The budget guidelines also provide details on how capital expenditure requests are to be entered into the SPOL central computing system.

 

The following screen shot gives an example of unit /budget requests entered into the SPOL system.

Example of St. Petersburg College Strategic Planning Online

 

The SPOL system requires the unit / budget managers to select one of the College’s Strategic Directions / Institutional Objectives for each of the unit plan objectives entered.  In addition, supporting tasks, expected outcomes, and related budget funding are also captured in the SPOL system.  After all unit /budget manager unit plans and budget requests are entered, they undergo three levels of management reviews in which refinements and adjustments may be made based on funding availability and overall College priorities.  Unit plans and budget requests that are approved by department heads, vice presidents, and other leadership positions that report directly to the College President, are then aggregated and submitted for further review and evaluation by the Collegewide Budget Committee.

 

(e) The Collegewide Operating Budget Development Process

 

Each year, the College President confirms the membership of a Collegewide Budget Committee comprised of Senior Presidents, Vice Presidents, Campus Provosts, and other key functional leaders.  Certain members of the Collegewide Budget Committee are rotated on an annual basis for cross-training purposes.  The charge of the Collegewide Budget Committee includes the following major activities: (i) develop budget guidelines, (ii) review of all budget requests approved by department heads, vice presidents, and senior vice presidents, (iii) ensure that the SD-IOs are funded according to their priorities and funding availability, and (iv) develop the College’s Operating Budget.

 

The Collegewide Budget Committee meets several times per month during the budget development process, with meeting schedules listed on the Annual Planning Event Calendar and integrated with other key College meetings (e.g. President’s Cabinet, Board of Trustees, etc.).  The first of the initial meetings occurs immediately after the College’s Strategic Directions and Institutional Objectives are approved by the Board of Trustees and, typically, well before the State of Florida’s legislative process begins in March of each year.  The Collegewide Budget Committee meetings include frequent updates with the College President, as well as several meetings with the President’s Cabinet including Faculty senate and student government association representation, review, feedback, and input. In particular, the Annual Student Activities Budget is closely reviewed by the College’s Student Government Association.

 

(f) Budget Approval, Implementation, and Annual Operating Results

 

The Operating Budget is approved by the President’s Cabinet, and recommended to the Board of Trustees in the form of a Board Agenda Item, Board Memorandum, and attachments.  Once approved by the Board, the approved budget amounts are communicated to the College and uploaded into the College’s central financial system.  College financials and operating results are monitored on a monthly basis and reported quarterly to the Board of Trustees.  Operating performance and results are centered on executing the approved Strategic Directions and Institutional Objectives (SD-IOs), the supporting unit plans and quality improvement initiatives, and the operating budget.  Operating performance and results are accomplished through the following key steps:

  • Implementing budgets and action plans.

  • Monitoring achievements and related circumstances.

  • Entering and evaluating mid-year unit plan reviews.

  • Preparing end of year unit plan review.

 

Sustained Documented History of Planning Evaluation Cycles

 

Development of the Strategic Directions and Institutional Objectives and Unit Plans are long-standing practices within the College’s Institutional Effectiveness (IE) Processes dating back prior to 1999-2000.  In particular, SPC unit planning has evolved over the past decade from a paper-and-pencil system to an email based system to a planning online system and now to a hosted version (.Net) of the Strategic Planning Online (SPOL) system, which was developed by Indian River Community College as part of a FIPSE grant.  This evolutionary journey has resulted in a more integrated and accountable process while streamlining the planning system for unit managers.

 

The Institutional Effectiveness Processes are yearly processes that consist of three distinct phases; the evaluation/assessment phase, the strategic/budget planning phase, and the implementation/operation phase.  The evaluation/assessment phase is a reflective look back at the prior year’s assessment and evaluation results.  This phase includes educational outcomes, institutional surveys, and departmental-specific assessments.  Individual assessments results are reviewed by the respective oversight group which in turn aggregates the information and presents recommendations to the President’s Cabinet.  These recommendations are evaluated and are routinely summarized in the form of the Institutional Objectives (IOs).

 

The strategic/budget planning phase is the transition from assessment/evaluation results to planning for the upcoming operational year.  This phase includes assessment-driven unit planning where unit managers state their intent for the upcoming year in measurable objectives, and ensure alignment with the institution’s mission and goals, Strategic Directions, and Institutional Objectives (SD-IOs).

 

The last phase, the implementation/operation phase, is the execution of the developed unit plans.  To ensure the fidelity and stability of these unit plans, unit managers are required to provide periodic reports of their progress.  These reports are in the form of a mid-year status report and an end-of-year final results report.  The end-of-year report includes assessment results in addition to the unit’s use of these results in improving their unit.  The following planning calendar, presented in the order of the College’s fiscal year, displays the key elements in each phase.
 

Institutional Effectiveness Calendar with Key Events per Phase

 

 

 

Institutional Research and Budgetary Support

 

SPC’s Core Institutional Effectiveness Team:  St. Petersburg College provides significant personnel support for institutional effectiveness and research.  The SPC Institutional Effectiveness department includes ten full-time staff members that are responsible for planning, assessment, research, and state reporting requirements.  There is also budgetary support for external ETS testing and the state of Florida is funding the 2007 Community College Survey of Student Engagement (CCSSE) for all 28 colleges in the system.

 

The following chart and operating budget table provide the organizational context of the SPC IE and institutional research staffing and budgetary support.

 

Organizational chart for Institutional Effectiveness

 

 

 

2006-2007 SPC Institutional Effectiveness Operating Budget

 

SPC Faculty and Staff Support of Institutional Effectiveness:  St. Petersburg College Faculty are responsible for the development and revision of all degree programs and courses as a result of analysis of data in the course and program review process.  Program Directors and Deans recommend approval of proposed course changes and forward them through the Provosts to the Curriculum and Instruction Committee, comprised of Faculty and administrators from all campuses and sites.  Faculty and Program Directors/Deans develop and implement institutional assessments of programs with the approval of the appropriate senior vice president (e.g., Senior Vice President, Baccalaureate Programs and University Partnerships and Senior Vice President, Educational and Student Services).

Oversight groups consisting of senior staff and staff responsible for implementing changes (e.g., the Administrative Oversight Group includes representatives from Facilities, Business, and campuses/sites) review Collegewide data and other information on effectiveness gathered by departments and make recommendations for the Strategic Planning process.  The President’s Cabinet approves all changes to the institutional effectiveness process.

Board of Trustees Support of Institutional Effectiveness:  The Board of Trustees (BOT) sets the policy for institutional review of processes, and approves all changes to policies and programs resulting from institutional effectiveness reviews.  In addition, the BOT is briefed on Institutional effectiveness processes.

Improvement of Programs & Services – Evidence Data

 

There is broad-based participation of Faculty, program directors, and deans in all assessment activities. Each program’s director or dean works closely with Institutional Effectiveness staff and the program’s full-time Faculty to develop assessments that provide meaningful data on student learning. In addition, nationally normed assessments, such as the ETS’s MAPP test for General Education, state licensure exams, and CCSSE are used during educational outcomes reviews as outside benchmarks for measuring student learning.

 

Other departments, such as the Library, Counseling services, Technology, Budget, and Institutional Effectiveness, have developed internal surveys that provide more detailed information on satisfaction with the services provided to students, Faculty, and staff than can be gained from the more general Enrolled Student Survey, which measures student satisfaction with student services.  These data are gathered continuously (or annually) and are analyzed and reported to the College during the Strategic Planning Process.  Data such as State Accountability Measures that include retention, graduation, and transfer rates are reviewed at the same time by the appropriate groups.

 

Educational Assessments:  Educational programs use a variety of assessment methods to improve their effectiveness.  Assessment and evaluation measures are used at various levels throughout the institution to provide Provosts, Deans, Program Managers and Faculty vital information on the success of recent efforts.  While the focus of a particular educational assessment area may change, the assessment strategies remain consistent and are integrated to the fullest extent possible.  The focus for the Associate of Arts degrees is targeted on students continuing on to four-year degree programs as opposed to the Associate of Applied Science and Associate of Science and Baccalaureate programs which target students seeking employable skills.  The General Education-based assessments focus on the general learning outcomes from all degree programs, while the Program Review process looks at the viability of the specific programs.  The College has developed an Educational Assessment Web site to serve as repository for all SPC’s educational outcomes reports and to systematically manage the College’s assessment efforts.

 

Educational outcomes should be broad based to ensure an expansive coverage of student learning. Thus in some learning areas, outcomes should not be limited to the cognitive domain, but should also address the affective domain and skill areas.

 

In 2004-2005, St. Petersburg College took a new look at its general educational outcomes assessment program and convened an ad-hoc committee of General Education program directors for this review.  The General Education committee’s goal was to identify methodologies for assessing the general education outcomes defined in the College’s “Mission and Goal Statement” as follows:

  1. Communicate effectively by demonstrating the ability to speak, listen, read and write in an organized and analytical manner.  (Communication)

  2. Demonstrate effective mathematical skills emphasizing practical problem solving and data interpretation.  (Mathematical Skills)

  3. Utilize the scientific method as it applies to understanding scientific and social phenomena.  (Scientific Method)

  4. Recognize basic scientific principles underlying human influence upon the earth and its inhabitants.  (Human Influence)

  5. Implement appropriate forms of existing and evolving technology for personal, educational, and professional purposes.  (Technology)

  6. Demonstrate the ability to work effectively with others in a variety of settings  (Teamwork)

  7. Demonstrate an understanding and appreciation of the humanities and fine arts including participating in cultural activities featuring art, music, literature, dance and/or theater.  (Humanities/Art Appreciation)

  8. Participate as informed and responsible citizens in solving social, economic and political problems in a multicultural and global society.  (Informed Citizen)

  9. Recognize ethical issues and dilemmas in the per­sonal, business and social areas of their lives and apply ethical principles and logical problem-solving skills when making ethical decisions.  (Ethics)

  10. Think logically, critically and creatively to solve prob­lems and make decisions.  (Critical Thinking)

  11. Recognize the importance of lifelong learning process in the pursuit of personal, intellectual and career development.  (Life-long Learning)

At the end of the collaboration, the General Education committee was able to identify methodologies for assessing all the aforementioned educational outcomes.  Program directors and Faculty members worked with the General Education committee to establish assessment procedures that (1) match the objective(s) of the educational outcomes and (2) yield information useful to the Faculty in changing teaching and learning strategies, improving course content, and revising curricula.  The individual reports, unique by their individual nature, are nevertheless written to address how the assessments and their associated action plans have improved learning in their program.  All reports reside at the Educational Assessment Web site.

 

Educational Assessment results are continually used by SPC staff to improve educational outcomes.  One example of this data-driven process is the development of the topic for the Quality Enhancement Plan (QEP).  Two assessments provided significant attention to the need for improving critical thinking skills at the College.  In 2003-2004, an assessment used to evaluate the critical thinking in general education competency as defined in the College Mission and Goals.  The summary of the assessment findings is as follows:

 

Excerpt from 2003-2004 General Education Outcomes Assessment Report

The average correct response score on the 30-point scale was 2.61 points (8.7% of 30).  Students in group 1 (0-24 earned credits) scored 2.32 points (7.7% correct responses).  Students in group 2 (25-48 earned credits) scored 2.74 points (9.1% correct responses).  Students in group 3 (49+ earned credits) scored 3.4 points (11.34% correct responses).  These results suggest that as students progress through the general education curriculum, they do improve their critical thinking skills—rising from 7.7% correct responses for low-credit students to 11.34% correct responses for high-credit students.  However, these results also indicate that students in all three groups have serious deficiencies in their ability to think critically.

 

The second assessment was the Academic Profile General Education Assessment from the 2005-2006 academic years.  The Academic Profile is a test of general academic knowledge and skills. It is intended for use by colleges and universities in assessing the outcomes of their general education programs in order to improve the quality of instruction and learning.  The test focuses on the academic skills developed through general education courses rather than on the knowledge acquired about the subjects taught in these courses. It does this by testing college-level reading, writing, critical thinking, and mathematics in the context of humanities, social sciences, and natural sciences.

 

The ETS Academic Profile was administered to samples of SPC students, including first time in college (FTIC) and students who had completed their general education requirements. Data was provided on criterion-referenced proficiency levels for three skill areas; Writing, Mathematics, and Reading/Critical Thinking.  Focusing on the students who have completed their general education requirements, SPC students were compared to all students at the sophomore level from two-year granting schools.  The proficiency of SPC students was comparable to that of the comparison students.  When the categories of proficient and marginal are combined, SPC students were superior to the comparison group in all categories.  For the SPC results, the critical thinking area was identified as an area of weakness.

 

 

 

The results of both of these assessments highlighted the need for improving the critical thinking skills of the students at the College.

 

Educational Support Services Assessment:  Student surveys are an essential part of the evaluation process.  Many of the survey instruments (with updated questions) have been used by the College for years.  Students are surveyed at different points in their educational career to determine changes or improvements that could be implemented to enhance the institutional and learning experience.  Unit managers review survey reports annually and determine whether intervention based on survey findings is required.  The following institutional and departmental specific surveys were used by the Educational Support Services to assess their performance:

 

§         Annual Library Survey

§         Enrolled Student Survey

§         Commons/Learning Support Center Survey

§         Florida Community College Assessment Report

 

One example of the College’s data-driven process in the area of Educational Support Services is the expenditure of funds to enhance SPC’s library collection.  This decision was based on the Educational Support Services Oversight Group Report from December of 2004.  The summary of the assessment findings from that report is as follows:

 

Excerpt from Educational Support Services Oversight Group Report, 2004

 

“The state has not conducted an updated collection assessment, however, the library collections were purged resulting in 7,174 (3% of the collections) items withdrawn from the collections.  At the same time, the collections increased by 12,387 items (5% growths).  The Collection Development Committee updated the Collection policy to include baccalaureate programs.  The library budget for baccalaureate programs was $406,000 which allowed for the addition of databases and resources to support the Dental Hygiene, Public Administration, Veterinary Technology programs, Orthotics/Prosthetics programs, and University Partnership Center (UPC) programs.”

 

Administrative Services Assessment:  Surveys are also used to judge the performance of administrative services as it relates to students, College staff, and administration.  Unit managers review survey reports annually and determine whether intervention based on survey findings is required.  The following table list the key surveys used to assess and judge the performance of administrative services rendered at SPC:

 

Entering Student Survey

Institutional Research Evaluation Questionnaire

Graduating Student Survey

Annual Budget Planning Evaluation

Recent Alumni Survey

Enrolled Student Survey

Technology Resources Allocation Process Satisfaction Survey

 

 

One example of performance improvement in the area of administrative services is demonstrated by the College’s use of results from the 2005-2006 Enrolled Student Survey. Several administrative areas, which included the bookstore services, were identified as not meeting the College’s long established criteria of performing at a 5 or above on a 7-point satisfaction scale.  Action plans were developed for the 2005-2006 Administrative Services Oversight Group Report to address these areas.  The following excerpt is from the action plan for improving the student satisfaction with the bookstore services from the 2005-2006 Administrative Services Oversight Group Report:
 

Excerpt from 2005-2006 Administrative Services Oversight Group Report

 

Beginning In August 2005, the College successfully collaborated with Follett Bookstore’s IT staff to implement the BookNow program.  This allows a student who completes their registration in our system to click one link at the bottom of the registration page and it takes the student to the Follett’s Web site where the student’s shopping cart is already filled with the required books for the schedule they have created.

 

These improvements in the bookstore process resulted in an increase in the level of student satisfaction with the bookstore services.  The following table from the 2006-2007 Administrative Services Oversight Group report displays the increases in student satisfaction in the areas of parking, bookstore, and food services.

 

Change in Student Satisfaction Levels

 

Services/Office

05/06

06/07

Difference

Parking

4.54

4.84

.30

Bookstore

4.95

5.56

.61

Food services

4.26

4.88

.62

 

Student Services Assessment:  Student surveys are also an essential part of the student services evaluation process.  Students are surveyed at different points in their educational career to determine their perceptions in order to implement changes and improvements that will enhance the institutional and learning experience.  Unit managers review survey reports annually and determine whether intervention based on survey findings is required.  These surveys include the Entering Student Survey, Enrolled Student Survey, Graduating Student Survey, and Recent Alumni Survey, as listed below.

 

Entering Student Survey

Graduating Student Survey

Enrolled Student Survey

Recent Alumni Survey

 

The College administers the Enrolled Student Survey, developed as one component of a Collegewide assessment system to ensure the delivery of quality academic and student services.  The purpose of the survey is to ascertain how students enrolled at the College perceive available academic and student services.  Students are given a list of specific services and asked about the importance to them and their level of satisfaction.  Subsequently, Faculty and administration use the data to establish quality improvement initiatives through the unit planning process.

An example of the data-driven process is in the area of student services is related to the introduction of the PeopleSoft Student Administration System in the fall of 2003.  The College confirmed from the October administration of the “Enrolled Student Survey” that there was an issue related to the student satisfaction with the registration process. Upgrades were made top the system and a supplemental spring administration of the “Enrolled Student Survey” was given to monitor the impact of these improvements.  The resulting satisfaction scores showed improvement in student satisfaction.  The following excerpt is a summary from the Enrolled Student Survey Spring Term Follow-up Report from 2003-2004:
 

Excerpt from Enrolled Student Survey Spring Term Follow-up Report from 2003-2004

 

This was a limited follow-up survey to check whether certain student services had improved after steps were taken to correct problems with the new student administration system.  Consequently, it was not possible to make statistical comparisons as the sample size and questions were different from the Fall survey.  It should also be noted that the rate of return from the four major campuses was not proportional to their student enrollments and this may bias the results.  Given those caveats, it does appear that satisfaction has noticeably improved between Fall 2003 and Spring 2004 and, while the performance gaps may still be negative, there is also a substantial improvement there.”

 

The following table shows a comparison of student’s level of satisfaction on the enrolled student survey between Fall 2003 and a special administration in Spring 2004 for a limited number of student services.  The mean score increased in all services areas with the application / admission process (0.55) reporting the highest increase in student satisfaction followed closely by academic advising (0.50).

 

 

Relationship of Institutional Effectiveness to College’s Budget

St. Petersburg College has a sound planning system and communicates annual budget preparation guidance to the College community via instructional documents on the College’s Strategic Planning Online (SPOL) system.  The College develops a budget plan based on the Board-approved Strategic Directions and Institutional Objectives (SD-IOs) for the upcoming year.  The Budget takes in to consideration the prior year’s budget as well as the any additional funds necessary to achieve the upcoming year’s approved institutional objectives.

As previous stated in this section, the institutional objectives are developed through the evaluation of the previous year’s assessments.  This includes educational outcomes, institutional surveys, and departmental-specific assessments.  Specific evaluation instruments, reports, and measures are listed below:

  • Entering Student Survey

  • Enrolled Student Survey

  • Graduating Student Survey

  • Recent Alumni Survey

  • State Accountability Measures

  • Institutional Core Effectiveness Indicators Report

  • FACTBOOK

  • Research Briefs

  • Educational Outcomes Assessment Reports

  • State Reports

  • Other Departmental Specific Surveys

These individual assessments results are reviewed by the respective oversight group which in turn aggregates the information and presents recommendations to the President’s Cabinet.  These recommendations are evaluated and are routinely summarized in the form of the Institutional Objectives (IOs).

Using these Institutional objectives as a guide, each unit within the College develops unit-level objectives for the coming year.  Funds necessary to support these objectives are estimated and requested by each budgeting unit.  Requests from all budgeting units are aggregated, reviewed, and, if approved, considered by the Collegewide Budget Committee.  The Collegewide Budget Committee estimates the coming year’s revenues and sources of new funds in order to provide the College President with data needed to make informed budgetary decisions.  The completed budget is then submitted to the Board of Trustees and the Florida State Board of Education for approval.

 

Internal and External Constituents / Stakeholders Planning and Assessment Involvement

 

In addition to the internal constituents’ involvement in planning and assessment, as discussed extensively throughout this section, involvement of external constituents is also an important component of the evaluation and assessment process.  At SPC, evaluation and assessment by external constituents are achieved through education advisory committees, and community and Florida Department of Education partners.

 

The technical education advisory committees are an example of this community input.  Advisory committees meet a minimum of twice annually with additional meetings as needed for good program coordination.  Advisory committee members are appointed by the College President (BOT Rule 6Hx23-3.08) to serve a one-year term of office and must have a demonstrated competency in the program specialty area or an understanding of the program and of the community at large.  An exception to the above may be a lay person directly involved in a related program field such as counseling, public relations, or administration of a business or industry.

 

Specific Duties of Advisory Committees are to:

 

1.         Serve as a communication channel between the college and the community.

2.         Determine specific skills and suggest related and technical information for the program.

3.         Suggest ways for improving public relations and articulation of the program with other institutions.

4.         Assist in recruiting, providing internships, and in placing qualified graduates in appropriate jobs.

5.         Keep the program personnel informed on changes in labor market, specific needs (competencies) and surpluses.

6.         Recommend curriculum revisions as necessary to comply with current trends.

7.         Assist in assessing the program needs in terms of the entire community (long-range planning).

8.         Assist program personnel in searching for sources of funding for scholarships, equipment, etc.

9.         In general, advise, recommend, and assist in assuring a quality program as determined by community needs.

 10.          Discuss proposed equipment purchases in excess of $9,999.99.

 

Florida Department of Education, Division of Community Colleges Evaluation and Assessment:  Dr. Judith Bilsky – Executive Vice Chancellor Division of Community Colleges and Workforce Education, reviewed the College’s 2006-2009 Strategic Directions and 2007-2008 Institutional Objectives (SD-IOs).  Dr. Bilsky suggested several areas to increase focus, and commended the comprehensive nature of the College’s SD-IOs; their clearly attuned alignment with both statewide and community college system mission and goals.

 

Pinellas County Economic Development Staff Evaluation and Assessment Mr. Mike Meidel Director Pinellas County Economic Development also reviewed the College’s 2006-2009 Strategic Directions and 2007-2008 Institutional Objectives.  Mr. Meidel suggested several areas for consideration.  He emphasized the importance of the College’s Corporate Training Program to the County’s success in achieving State-funded Incumbent Workers Training (IWT) and business retention goals, and expressed appreciation for the College’s efforts to include the County’s economic development perspective in our planning processes and programs.

 

Collegewide Communication and Dissemination

The College communicates the College Mission Statement, the evaluation and assessment reports, the Strategic Directions and Institutional Objectives, and other related strategic plans (e.g. Strategic Technology Plan) to College Faculty and staff through multiple means including, but not limited, to the ones presented below:

  • President’s Cabinet & Members Review Process
  • Board of Trustees (BOT) Review & Review Process
  • Cabinet & BOT Approval Process
  • Workshops on each campus
  • Web Site Postings – Including Colleges’ main Web site and the Institutional Effectiveness Web site

Institutional Effectiveness Web site

 

In summary, institutional effectiveness at SPC is defined as the integrated, systematic, explicit, and documented processes of measuring performance against the SPC mission for purposes of continuous improvement of academic programs, administrative services, and educational services offered by the College.  The cornerstones are:

·         College Mission Statement & Purpose

·         Evaluation and Assessments-Oversight Groups & Data-driven Reports

·         Strategic Directions & Institutional Objectives (SD-IOs)

·         Unit Plans – Developed at academic program and functional (Budget Supervisors) levels

·         Reviews, Approvals, and Communicates by standing committees, including the President’s Cabinet, and Board of Trustees

·         Strategic Planning Online System (SPOL) - an American Association of Community Colleges (AACC) award winning, Web-based, information management system

References
2006-2007 Institutional Effectiveness Plan.doc
IE Institutional Effectiveness Web site.jpg
Board IE Briefing with Back-up Slides.ppt
Strategic Directions and Institutional Objectives 2007.doc
Strategic Directions and Institutional Objectives 2006.pdf
SPOL Web site.jpg
2006-2007 Unit Plans.doc
2005-2006 Unit Plans.doc
Education Oversight Group Report 1-8-07 .doc
Education Oversight Committee Report 2006.pdf
Administrative Services Oversight Group Report 1-22-07.doc
Administrative Services Oversight Group Report 2006 .doc
Educational Student Support Services Oversight Group Report 2-6-07.doc
Educational Support Services Group Report 2006.pdf
Student Services Oversight Report 2006 .doc
SPC Fact Book 2006-2007.pdf
President's Year-End Report 2005-2006.doc
ETS MAPP Test.jpg
Entering Student Survey 04-05.pdf
Entering Student Survey 05-06.pdf
Enrolled Student Survey 2006-2007.pdf
Enrolled Student Survey Spring 2003-04.pdf
Graduating Student Survey 04-05.pdf
Graduating Student Survey 05-06.doc
Institutional Core Effectiveness Indicators Report Dec 2006.ppt
3-year Graduate Results March 2006.pdf
Dental Hygiene Assessment 2004-2005.pdf
5- Year Snapshot Accountability Measures 2002-2006.xls
Vol 14-2 State Accountability Measures.pdf
Vol 15-2 Survey of Employers of 2003-04 SPC Graduates Oct 05.pdf
Vol 15-3 Alumni Survey Oct 2005.pdf
Vol 15-4 Institutional Research Evaluation Questionnaire Report 2005.pdf
Vol 15-5 Student Survey of Instruction March 2006.pdf
Vol 16-2 Summary of Community College Survey of Student Engagement 2003.pdf
Vol 16-3 Community College Gen Ed Assessment 2004.pdf
Vol 16-4 Community College Gen Ed Summary 2004.pdf
Vol 16-6 ETS Academic Profile Results 2005-2006.pdf
Vol 16-7 AA Program Review Level 1.pdf
Budget guidelines 2006-2007.jpg
Outcomes Assessment Web site.jpg
Critical Thinking Educational Outcome Report 2003_2004.pdf
Comprehensive Program Review - Early Childhood Ed 2006-2007.doc
Institutional Research Evaluation Questionnaire Report Nov 2005.pdf
Annual Budget Planning Evaluation Jan 2007.doc
Technology Resources Satisfaction Survey Dec 2006.doc
Honors College 2005-2006 Annual Report.doc
6Hx23-3_08 Technical Education Advisory Committees.doc