Notes
Slide Show
Outline
1
Maximizing Your Investment in NSSE Through Data Integration
  • NASPA Assessment and Retention Conference
  • Atlanta, Georgia
  • June 3, 2005
2
Program Abstract
  • The program will describe the methodology and outcomes associated with integrating NSSE data with multiple institutional data sources in order to better understand issues associated with retention, program evaluation, and time to degree studies.  Particular attention will be paid to the data sharing and reporting processes between academic and student affairs.
3
Program Plan
  • This program will guide participants through a collaborative planning, data collection and data integration model between academic and student affairs that has been used successfully through two administrations of the NSSE instrument.  Additional attention will be paid to the processes of data analysis, reporting and sharing significant findings to the university community through a variety of forums and methods.


4
Institutional Characteristics
Univ. of North Carolina at Charlotte
  • Anticipated Fall 2005 Headcount – 20,000+


  • Public Four Year University - Doctoral Intensive Funding Status


  • Collaborative First Year Program Structures


  • Participated in NSSE 2001 and 2004


  • High Interest Level in Freshmen Retention Issues
    • Freshman Year Experience Team
    • 1997-2003 Longitudinal Research Study

5
Freshmen Research Construct
Modified Tinto Attrition Model
6
NSSE Participation – 2001
Stakeholders
  • State Funded Participation – No Cost To Us


  • Stakeholders Limited in 2001
    • New Student Orientation
    • Freshman Seminar
    • Get Connected to UNC Charlotte Program
    • SAFE Program
    • Residence Life & Housing
    • Primarily Student Affairs Interests


  • Relatively Small Sample Size (750 FR – 750 SR)


  • Limited Use of Customized Reports Due to Sample Size


  • Results Helpful but Not Widely Shared
7
NSSE Participation - 2004
Stakeholders
  • Funded Locally


  • Office of Student Success and Retention
    • Assessment Task Force – Project Catalyst
  • Director of Assessment & Faculty Governance
  • Office of Institutional Research
  • Structured First Year Programs
    • All 2001 Groups
    • Learning Communities
  • Student Affairs Research
  • The Undergraduate Experience Discussion Group
    • High level response group for low returning student retention rate issues

  • Larger Sample Size (1500 FR – 1500 SR)
  • More Stakeholders, Results Widely Shared At High Levels


8
Collaborative Planning Model
Breaking Down Data Silos
  • Identifying & Articulating Need for Multiple Types of Data


  • Crafting IRB Proposal
    • Multiple Investigators
    • Data Integration Statement Built into NSSE Survey Proposal


  • Crossing Divisional Boundaries
    • Academic Affairs
    • Student Affairs

  • Articulating Benefits of Data Sharing
    • Trading Data Sharing for Customized NSSE Results


  • Keeping Data Secure
    • Centralized Integrated Dataset
    • Centralized Reporting
9
Collaborative Planning Model
Data Types & Sources
  • Pre-Entry Attributes
    • Undergraduate Admissions (SIS)
  • Entering Student Survey
    • Office of Institutional Research (Database)
  • Structured First Year Programs (Databases & SIS)
    • Orientation – Dean of Students Office
    • Freshman Seminar – College of Arts & Sciences
    • Get Connected to UNC Charlotte – Get Connected Matrix Team
    • SAFE Program – Dean of Students & Minority Student Service (AIMS) Offices
    • Living On Campus – Residence Life & Housing
    • Learning Communities – Office of Student Success & Retention (OSSR)
  • Student Demographic Data
    • Office of the Registrar (SIS)
  • Academic Performance & Retention Data
    • Registrar & Institutional Research (SIS)
  • National Survey of Student Engagement (NSSE)
    • OSSR Assessment Task Force (NSSE dataset)
10
Integrated Freshmen Cohort Dataset
Fall 2003
11
Collaborative Planning Model
Project Timeline
  • Summer 2003
    • Obtain Administrative & Funding Support for Project
    • Craft & Submit IRB Proposal
    • Submit NSSE Application


  • Fall 2003
    • Build FR Cohort Dataset
    • Submit Participant Data to NSSE with Student Identifier
    • Develop Administration Strategy with Incentives


  • Spring 2004
    • Administer Survey (Web and Paper Over Sample)
    • Augment FR Cohort Dataset – Academic Performance Data


  • Fall 2004
    • Obtain Report Templates & Data From NSSE
    • Augment FR Cohort Dataset – Retention Data
    • Generate Customized Reports & Presentations
12
Collaborative Planning Model
Working with your NSSE Data
  • Utilizing the Standardized NSSE Report Templates
    • Institutional Summary
    • Carnegie Classification Comparison
    • National Comparison
    • Cohort Group Comparison
    • Benchmarking


  • Working with your NSSE Data
    • FR-SR Comparison
    • Place of Residence (see handout)
    • Entering Status (FR-TR) Comparison for Graduating Seniors
    • Academic Advising Satisfaction Group Characteristics


  • Using your Integrated Data
    • FR One Year Retention-Attrition Comparison (see handout)
    • SR Time to Degree Comparison (see handout)
    • Structured First Year Program Participation Analysis
    • Comparison by College
    • Demographic Analysis


13
Collaborative Planning Model
Data Analysis Tips
  • Drill Down into your Data
    • Sample Size Limitations

  • Transform Data Elements for Additional Clarity
    • Student Employment (Y-N)
    • Academic Advising Satisfaction Level Groups (High-Low)


  • Control for Variance
    • Key Demographics (Place of Residence)


  • Remember your Promises
    • Structured First Year Program Participation Analysis



14
Collaborative Planning Model
Reporting Tips
  • Utilize the NSSE Report Excel Template
    • Benefits of Report Standardization


  • Report Significant Findings Only
    • Avoid Data Overload
    • Color Code Differences


  • Distribute Globally – Print Locally
    • Post all Reports to Common Website


  • Work with Local Groups to Interpret Their Findings


  • Minimize Central Narrative Reporting
    • Encourage Local Summary Efforts





15
Collaborative Planning Model
Website Snapshot
16
Collaborative Planning Model
Presentation Tips
  • Get Key Reports & Presentations to the Highest Levels First
    • Division
    • College
    • Department


  • Report Key Findings to Faculty Governance & Other Groups
    • Faculty Executive Council
    • Faculty Council
    • Department Chairs


  • Supplement Institutional Data with NSSE Findings


  • Encourage use of NSSE Findings in Other Reporting Structures
    • End of Year Reports
    • Institutional Effectiveness Reports
    • Accreditation Reports



17
Maximizing Your Investment in NSSE Through Data Integration

  • Sharing Other Practices?



  • Questions?





  • Additional information on customized NSSE Reports and Presentations can be found at the following URL:


  • http://www.uncc.edu/stuaffairs/research.htm