UPA Home > UPA Annual Report

 

University Planning and Analysis
2006-07 Annual Report

Programs

Planning – Working with Provost and Executive Vice Chancellor Nielsen, UPA designed and facilitated the university’s compact planning process, which is a unit-based planning process culminating in plans and resource allocations for all colleges and administrative units for 2007 to 2010.  Karen Helm also coordinated a variety of planning retreats for the executive officers, deans, and vice provosts.

Assessment – Dr. Joni Spurlin led the university’s Assessment Work Group in the completion of a shared vision and Guiding Principles for Assessment as tools for coordinating assessment across undergraduate and graduate programs, as well as Student Affairs, Finance and Business, DELTA, and other areas. 

Institutional Research – As the university moves toward implementation of a new student information system (SIS), UPA is playing a critical role in ensuring that the university will be able to retrieve from that system the data required for planning, decision-making, and reporting.  Lewis Carson leads this effort for the university as chair of the SIS data reporting team.  Jeannette Atkinson will play an increasingly important role in creating data and information as SIS is implemented in the coming years. One UPA service that attracts a lot of interest from both on-campus users and other institutions is peer comparisons. In addition to the usual studies of rankings, this year Carol Smith focused more research on identifying factors that contribute to improved graduation rates.

Survey Research – UPA’s survey team (Nancy Whelchel, Melissa Godwin, and Jenn Marks), working with a university committee, administered and reported on the first Faculty Well-Being Survey.  Dr. Whelchel gave a dozen, tailor-made presentations on the results to a variety of groups around campus.  The team is now at work designing a staff survey.

Special Projects – UPA continued to provide substantial support to LITRE, the University’s quality enhancement plan focusing on improving student learning with technology.  Dr. Geetanjali Soni, LITRE’s new assessment director, joined the UPA group and is working with LITRE principal investigators across the university.  Geetanjali worked with Joni to complete the first annual report on results of LITRE projects.

UPA also took responsibility for ClassEval, a new, centralized, online system for evaluation of instruction.  UPA welcomed Kay Stewartnewman, who will develop this system.  UPA piloted the system with 7 departments in December and moved to full implementation in the spring semester

Administration – In November, Jan Henderson coordinated UPA’s move back to Peele Hall from the Flex Building.  UPA staff is happy to have returned to a larger, cleaner, better-organized office with better climate control.  In addition, UPA overhauled its extensive website to become compliant with new accessibility requirements, a complex project involving every UPA staff member.

In February 2007, UPA used focus groups of department heads, vice provosts, directors, deans, and vice chancellors to assess its services.  We found that our strengths include: website design and navigation; breadth and value of data and services; prompt and committed staff; and integration of processes with data.  Our clients said we need to: become more proactive in presenting and interpreting data; empower end users by providing manipulable data, models, tools, and training; expand capacity for ad hoc analyses; expand capacity for conducting surveys for other units; provide more data and services to department heads; report enrollment data at more points during the year; develop data and models about program costs and resources; and work with other offices to reconcile data and to reduce duplication of reporting across different units at NC State.

Staff

UPA welcomed several new staff members:  Trey Standish, Assistant Director for Enrollment Planning; Geetanjali Soni, Coordinator for LITRE Assessment; Kay StewartNewman, ClassEval analyst; and Alice Taylor, personnel data analyst.

Nancy Whelchel was nominated for the 2007 University Award for Excellence (EPA) in the Chancellor’s Division.  Her work – with the routine survey program, special surveys like the Faculty Well-Being Survey, and as a mentor for her graduate students – has been outstanding.  In addition, Nancy completed her three-year term chairing operations for the annual meeting of the American Association for Public Opinion Research (AAPOR), an association of more than 1,600 individuals from academic institutions, government agencies, non-profit groups, and commercial firms including the major U.S. pollsters. 

The professional achievements and contributions of all UPA staff are listed at the end of this report.

Diversity

As noted above, Melissa Godwin is a facilitator for NC State’s Study Circles in Race and Ethnic Relations.  In addition, UPA is working with the Vice Provost for Diversity and African American Affairs to produce a diversity fact book, which will be used to develop goals for the future.

Challenges and Opportunities

As the university continues to refine its vision and strategies for becoming a great university, UPA will provide much of the information and support.  This effort includes retreat planning, developing and facilitating processes, providing information, and linking to related planning processes in development and marketing, enrollment management, and budgeting.

The SIS upgrade presents UPA with a critical challenge in making sure that the new system provides the information that will be needed to study enrollment patterns, teaching loads, retention and graduation rates, and many other issues.  Data elements that are dropped, ill defined, or forgotten could be very costly to create in the future.  The new SIS will also require that all of UPA’s programs used to create routine reports are rewritten next year.  The new SIS also provides a welcome opportunity to move ahead with the data mart that UPA has dreamed of for many years, possibly in partnership with the new Institute for Advanced Analytics.

UPA will play a key role in the development of accountability measures and reporting.  For twenty years, NC State has been committed to program-level, formative assessment of student learning and has resisted “rolling up” results into an institutional picture in order to encourage use by faculty.  Now, however, the US Department of Education, UNC-GA, and SACS are all calling for institution-level, summative performance measures focused on student performance, including learning outcomes.  This will require a change in NC State’s approach to assessment and development of new performance measures and reports for the university.

Like most offices of our kind, UPA’s biggest challenge is keeping up with the requests for information and with new technology.  We rarely have the luxury to prepare analyses that anticipate an emerging need.  However, each of us values the opportunity to serve the university in our respective roles as information providers, planners, evaluators, and facilitators of critical decisions.  While we do not contribute directly to the university’s focal areas of energy and the environment, health and well-being, or educational innovation, UPA does contribute indirectly by facilitating the university’s planning process: 

  • Process:  UPA designs and facilitates development of the strategic plan, as well as compact planning, which is used to develop implementation strategies.
  • Connecting the dots:  UPA facilitates linkages between the strategic plan and strategic marketing, space planning, enrollment planning, and other processes used for setting priorities.
  • Metrics: UPA develops and monitors the measures used to assess progress in implementing the strategic plan.
  • Investment priorities:  UPA facilitates units’ planning for improving faculty and staff quality and diversity, developing resource base, and strengthening infrastructure.

UPA Staff Achievements

Jeannette Atkinson, Research Associate for Student Information

Conferences

  • NC State University Council on the Status of Women, Women's Professional Development Conference, Raleigh, NC, June 2007

Professional Development

  • Database Management Course, CSC 440

Lewis Carson, Associate Director for Institution Research

University Service

  • Enrollment Planning Committee, UPA Staff Advisory Member
  • ClassEval Implementation Team, Member
  • SIS Reporting Team, Functional Lead
  • SIS Project Team, Member
  • SIS Technical Team, Member
  • Campus SAS Steering Team, Member
  • Tuition Administrative Advisory Committee, Member

Professional Development

  • Cold Fusion MX Level I and Level II Classes

Melissa Godwin, Coordinator for Survey Research

Publications and Presentations

  • "The 'Don't Know' Response Option: Response Order Effects" poster presentation at the SAPOR Conference, October 2006
  • "The 'Don't Know' Response Option: Response Order Effects" poster presentation to the NC State University Assessment Group, May 2007

Professional Service

  • Southern Association for Public Opinion Research, Conference Planning Committee Member through October 2006

University Service

  • NC State Study Circles in Race and Ethnic Relations, Facilitator, October 2006
  • NC State Study Circles in Race and Ethnic Relations, Steering Team Member
  • University Diversity Advisory Committee, Member

Conferences

  • Southern Association of Public Opinion Research, Raleigh, NC, October 2006
  • Council on the Status of Women, Professional Development Conference, June 2007

Professional Development

  • "What You See is What You Get: The Nuts and Bolts of Web Surveys."  SAPOR Short Course, October 2006
  • Dreamweaver, Cascading Style Sheet Workshop, November 2006
  • Focus Group Training, Rhode Island, April 2007
  • Cold fusion MX Level I, April 2007
  • NCBI Building Bridges Workshop, April 2007
  • Cold Fusion MX Level II, May 2007

Karen Helm, Director

University Service

  • Physical Master Plan Steering Committee
  • Task Force on Allied Health Services
  • Strategic Marketing Committee (Staff)
  • ClassEval Implementation Team (Chair)
  • SIS Steering Team
  • University Council
  • Enrollment Planning Committee (Chair)

Conferences

  • SACS-COC Annual Meeting, December 2006

Jan Henderson, Assistant to the Director

University Service

  • Peele Hall Building Committee as Liaison for UPA
  • Backup Peele Hall Building Liaison
  • State Employees Combined Campaign Coordinator

Professional Development 

  • Administrative Support Banding Training, July 2006
  • Dreamweaver MX Level I, August 2006
  • EPA On-line Employment Training, August 2006
  • Career Banding Training, August 2006
  • Hiring Staff Personnel, August 2006
  • Online Budget Revision, December 2006
  • Geetanjali Soni, Coordinator of LITRE Assessment

    Presentations

    • K. Oliver & G. Soni (2007), Facilitating Faculty Connections:  The Technology Practices Directory, presentations at 2007 UNC Teaching and Learning with Technology Conference, Raleigh, NC

    University Service

    • LITRE Assessment Committee, Chair
    • LITRE Student Learning Tool Kit Task Force, Chair
    • LITRE Advisory Board, Member
    • University Assessment Work Group, Member
    • University Award for Excellence, Chancellor's Division
    • Updated LTRE website
    • Technology Practices Directory:  Design, Pilot, Implementation
    • Student Technology use Investigation Committee, Member

    Conferences

    • ELI 2007 Spring Focus Session, Immersive Learning Environments:  New Paths to Interaction and Engagement
    • 2007 Teaching and Learning with Technology Conference
    • NCSU Undergraduate Assessment Symposium; Systematic, Systemic & Sustainable Assessment:  A Process of Inquiry, April 2007
    • NASPA International Assessment & Retention Conference, St. Louis, MO, June 2007

    Professional Development 

    • SAS Course:  Querying & Reporting Using SAS Enterprise Guide
    • SAS Course:  Enterprise Guide:  ANOVA, Regression and Logistic Regression

    Joni Spurlin, University Director for Assessment and Associate Director of UPA

    Publications and Presentations

  • Spurlin, J., Rajala, S. & Lavelle, J. (2007) (eds.) Designing Better Engineering Education Through Assessment:  A Practical Resource for Faculty and Department Chairs on Using Assessment and ABET Criteria to Improve Student Learning.  Sterling, VA: Stylus Publishing.
  • Book Chapters
      • Spurlin, J., Rajala, S., & Lavelle, J. (2007) Assessing student learning: ensuring undergraduate students are learning what we want them to learn.  In J. Spurlin, S. Rajala, & J. Lavelle (eds.) Designing Better Engineering Education Through Assessment: A Practical Resource for Faculty and Department Chairs on Using Assessment and ABET Criteria to Improve Student Learning.  Sterling, VA: Stylus Publishing
      • Spurlin, J. (2007) Assessment methods used in undergraduate program assessment.  In J. Spurlin, S. Rajala, & J. Lavelle (eds.) Designing Better Engineering Education Through Assessment: A Practical Resource for Faculty and Department Chairs on Using Assessment and ABET Criteria to Improve Student Learning.  Sterling, VA: Stylus Publishing.

  • Published Articles

      • Bernold, L., Spurlin, J. E., & Anson, C. (2007) Understanding our students: A longitudinal-study of success and failure in engineering.  Accepted for publication in Journal of Engineering Education, July.
      • Spurlin, J. E. (2007).  Book Review of Ubiquitous Computing in Education: Invisible Technology, Visible Impact, Mark van't Hooft and Karen Swan (eds.) Lawrence Erlbaum Associates, Inc, 2007.  Book review published in: Educause Quarterly, vol. 30, no. 2.
      • Spurlin, J. E. (2007).  Using Needs Assessment as a Holistic Means for Improving Technology Infrastructure.  Educause Learning Initiative White paper. June.
      • Moskal, P., & Spurlin, J. (2006).  Assessment Methodologies: Technology and Student Technology and Student Learning.  Invited presentation at Educause Learning Initiative's Fall Forum on Assessment, September 2006.
      • Spurlin, J. E., Raubenheimer, D., Nault, E., & Rajala, S. (2007).  Improving Assessment Efficiency and Overcoming Barriers: Relating Programmatic Accreditation to Institutional Assessment.  The NASPA International Assessment & Retention Conference, St. Louis, MO, June 2007.

      • Raubenheimer, C. D., Spurlin, J., North Martin, S., & Mehlenbacher, B. (2007).  North Carolina State University faculty in technology-rich contexts: Connecting teaching, learning and assessment in the classroom.  UNC TLT Conference Proceedings.
    Professional Service
    • Member of national committee to plan ELI's Fall Forum on Assessment for September 2006

    Conferences

    • NC State University's Undergraduate Assessment Symposium, Raleigh, NC, April 2007
    • Educause Learning Initiative (ELI) Fall Forum on Assessment, September 2006
    • NASPA International Assessment & Retention Conference, St. Louis, MO, June 2007

    Professional Development

    • Pathways Leadership Development Program 2006-07, NCSU Training and Development in Human Resources

    Trey Standish, Assistant Director for Enrollment Planning

    University Service

    • Enrollment Planning Committee, Member

    Conferences

    • National Symposium on Student Retention, October 2006

    Professional Development

    • Completed ST730 and ST731 classes at NCSU

    Kay StewartNewman, Coordinator of ClassEval Program

    University Service

    • ClassEval Implementation Team, Member

    Professional Development

    • Coldfusion MXL Level 1

    Nancy Whelchel, Assistant Director for Survey Research

    Publications and Presentations

    • Survey Research. NC State TTM531 (P. Banks-Lee, professor)
    • Survey Research: Warnings for Practioners and Consumers, NC State COM 240.
    • NC State Surveys: Research Design and Response Rates, ST 715 (Ken Pollock, professor)

    Professional Service

    • AAPOR Conference Operations Chair (May 2005-2007)
    • AAPOR Coordinator for Sponsorships/Exhibits
    • AAPOR Policy Impact Award Committee

    University Service

    • Chair and NC State representative, UNC-Office of the President Survey Research Work Group
    • NC State Institutional Review Board (IRB), Member
    • NC State LITRE Assessment Committee, Member
    • NC State Assessment Work Group, Member
    • NC State University-wide Evaluation of Instruction (ClassEval) Planning/Oversight Committee, Member
    • NC State University Diversity Advisory Committee, Member

    Conferences

    • Southern Association of Public Opinion Research Conference, Raleigh, October 2006
    • Academic Survey Research Organizations Conference, Ann Arbor, Michigan, February 2007
    • American Association of Public Opinion Research Conference, Anaheim, California, May 2007
    • NC State University Council on the Status of Women, Women's Professional Development Conference, Raleigh, NC, June 2007