View Static Version
Loading

Course Evaluation at UNM The Art and Science of Data - January 15, 2020

Presented by Elisha Allen, James Contreras, Donna Gutierrez

What is Course Evaluation at UNM?

  • Promotion and Tenure
  • Course Improvement
  • Constructive criticism
  • TAs use it to job hunt / CV
  • Led by Academic Affairs / Departments
  • Facilitated by IT

EvaluationKit Software

  • Used for survey delivery to all enrolled students
  • Used to deliver reports to faculty
  • Through faculty permission, delivery to departments

Types of Questions

  • Determined by faculty and Academic Affairs. (Typically developed by faculty committees.)
  • Mandatory UNM questions
  • College questions(not mandatory)
  • Departmental questions are determined by each department(not mandatory)
  • Faculty questions(not mandatory)

Setup Process for Course Evaluation Team

  • Project is created in EvaluationKit. Semester, year. Spring 2020 Courses
  • Division of labor and assignment of responsibility for team
  • Each team member assigned responsibility for 25 departments

Populating Enrollments

  • Normal Enrollments (10>)
  • Low Enrollments (1-5)
  • Cross listed classes
  • Aggregation across semesters
  • Data Source - MyReports Download from MyReports classlist - all information except crosslisting, secondary instructor, cancelled courses.
  • Enrollment stabilizes after first 6 weeks of classes
  • Manual weekly downloads of data, because data is not always up-to-date.
  • Updated ad hoc / by request with the help of the Department Admins and faculty, who update us on crosslisting, secondary instructors and cancelled courses.

Verifications and Corrections by Department admins

  • Approximately four weeks into the semester, course data is sent to department admins
  • Reminders are sent to all data admins to verify data and send corrections to team representatives
  • Every two weeks, data is sent to department admins until corrections have been received
  • Team receives corrections and applies them to course evaluations

Team uploads all data into EvaluationKit

  • Team runs all CRNs through R program
  • UNM IT supports close to 6,000 courses every semester
  • Team member loads all approved data from data admins
  • If we do not hear from data admins after 6 weeks, we load data as is into EvaluationKit
  • Team members cross check each other's work

Project Deployed

  • Faculty receives email listing each course they are teaching, evaluation dates, and the number of enrollments in each course
  • Team members work with faculty to make sure everything is correct.
  1. Enrollments
  2. Dates
  3. Missing co-instructors or TAs. Please tell us if you have a TA or co-instructor! We can't add a TA or co-instructor if we do not know they exist!
  4. Custom Questions

Delivery Process

  • Dates are posted on Website.
  • http://coursefeedback.unm.edu/
  • Set up - When do evaluations run? Based on course length and part of term
  • Why do the dates run before finals?
  • Faculty custom questions - two weeks before evaluations begin
  • Duration depends on length of course
  • Greater than 4 week courses --surveys run for two weeks
  • Less than 4 week courses --surveys run for one week
  • One or two day courses -- surveys run for one week

Report Access Date

  • Reports are available to faculty two weeks after the survey or two weeks after the course ends, whichever is later.

Late Respondents

Reopen by faculty request or approval

Student Access

  • LMS (Learn.unm.edu)
  • Emails sent to students with Link
  • Directly through the UNM Course Feedback website (Coursefeedback.unm.edu)

Faculty Access(for custom questions and reports)

  • LMS (Learn.unm.edu)
  • Emails regarding custom questions
  • Directly through the UNM Course Feedback website (Coursefeedback.unm.edu)
Created By
Donna Gutierrez
Appreciate

Credits:

Created with images by Good Free Photos - "A see of college graduates at the commencement ceremony. If you use this photo, please consider crediting https://www.goodfreephotos.com , not required but always appreciated." • Tra Nguyen - "Physics teacher" • Jon Tyson - "untitled image" • SpaceX - "SpaceX Falcon Heavy Launch" • Patrick Robert Doyle - "The Rose Main Reading Room at the Stephen A. Schwarzman Building (also known as New York Public Library Main Branch) is an elegant study hall in the heart of Manhattan. You may have seen this room in the film The Day After Tomorrow." • Hans-Peter Gauster - "You’ve got your work cut out for you." • Helloquence - "Brainstorming over paper" • jose aljovin - "untitled image" • Jon Tyson - "untitled image" • Mikael Kristenson - "auditorium"

NextPrevious