Loading

Assessment Design UTSA Academic Innovation

https://provost.utsa.edu/academicinnovation/remote-teaching.html

Learning Technologies * Digital Learning * Video Production * Online Programs Teaching and Learning Services * Professional and Continuing Education

Today's Presentation Team

  • Vanessa Garza, Accessibility Specialist, Digital Learning
  • Mayra Collins, Instructional Designer, Digital Learning
  • Kevin L. Williams, Instructional Designer - Quality Assurance, Digitial Learning
  • Shelley Howell, Interim Associate Vice Provost, Teaching and Learning Services

Online Course Design Checklist

Developed using Quality Matters standards.

The Plan for Preparation

  • Week 1: Designing Your Course
  • Week 2: Orientation and Module Outline
  • Week 3: Assessments
  • Week 4: Creating Active Content
  • Week 5: Course Management and Engagement

This week: Assessments

  1. Create your assignments with the principles of Universal Design for Learning in mind.
  2. Review and incorporate the Universal Design for Learning practices.
  3. Think about accessibility. Make auditory what is visible, and visible what is auditory.
  4. Create opportunities for student engagement and student-student interaction.
  5. Create meaningful navigation for your assignments and organize the Grades section in a sequential order that reflects the course schedule.

But first, some things to keep in mind...

Assessments can be:

  • Exams
  • Quizzes
  • Projects
  • Papers
  • Presentations
  • Reports
  • Reflections
  • Small assignments
  • Large assignments
  • Assignments with several parts

Is the assessment formative or summative?

Consider whether the assessment is for a major grade or is low stakes. Formative assessments spread throughout the course help you and the student understand their progression through the course.

Best practice: Good balance of both formative and summative assessments.

Will the assessment be synchronous or asynchronous?

Consider your students' access to technology, accommodation needs, and the current crisis situation.

We HIGHLY recommend asynchronous assessments.

We need to be compassionate, empathetic, and flexible. Timed exams are stressful during normal times and we are all learning new tools.

Is an exam or paper the only way students can prove their knowledge?

  • Consider probing, reflective questions that can't be answered without personal reflection.
  • Give students a complicated problem to solve that may or may not have one right answer.
  • Use a real-world scenario and have students create a product (i.e. a web page, infographic or social media post).
  • Encourage application of a concept to something in the student's life or to the students chosen career.
  • Look for online activities that meet the same course outcomes.
  • Consider giving students choices in how they prove their learning. Some students may want an exam, others might prefer a creative project. (Use a rubric to grade.)

Quality Matters

General Standard 3 - Assessment and Measurement

“Assessments are integral to the learning process and are designed to evaluate learner progress in achieving the stated learning objectives or mastering the competencies.”

There are Five Specific Review Standards for this General Standard:

  • 3.1 – The assessments measure the achievement of the stated learning objectives or competencies (Alignment)
  • 3.2 – The course grading policy is clearly stated at the beginning of the course.
  • 3.3 – Specific and descriptive criteria are provided for the evaluation of learner’s work, and their connection to the grading policy is clearly explained.
  • 3.4 – The assessments used are sequenced, varied, and suited to the level of the course.
  • 3.5 – The course provides learners with multiple opportunities to track their learning progress with timely feedback.

Meeting each of these Specific Review Standards allows for the following:

  • Assessment is implemented in a manner that corresponds to the course learning objectives or competencies.
  • Allows the instructor a broad perspective on the learner’s mastery of content.
  • Allows leaners to track their progress.

Next...

Self-Paced Webinar: Tips and Best Practices for Online Finals (Part 1)

The first part is a self-paced interactive webinar (we used PlayPosit). The training is approximately 30-minutes, and we have shared this resources in the College Blackboard shells.

Live Webinar: Tips and Best Practices for Online Finals (Part 2)

Wednesday, May 6, 8:15 am in Zoom ( Select the title to register)

1. Create your assignments with the principles of Universal Design for Learning in mind.

"Universal Design for Learning (UDL) is a set of principles for curriculum development that give all individuals equal opportunities to learn. UDL provides a blueprint for creating instructional goals, methods, materials, and assessments that work for everyone--not a single, one-size-fits-all solution but rather flexible approaches that can be customized and adjusted for individual needs." (UDL On Campus by CAST)

The following video explains the importance of UDL in higher education.

The Principles of UDL

  1. Construct Relevance – focuses on reviewing assessments and thinking about what goals do you want the learner to meet. Then, keeping the rigor of assessments while minimizing construct-irrelevant barriers.
  2. Engagement – focuses on how to motivate learners to meet learning objectives and consume the course content.
  3. Representation – focuses on what students are learning and providing ways to improve learners' understanding of content.
  4. Action and Expression – focuses on how learners will demonstrate their knowledge and mastery of course goals.

2. Review and incorporate the Universal Design for Learning Practices.

Provide Multiple Means of Engagement

Start with thinking about what do learners really need to demonstrate to achieve the content objectives. Then, look at the potential barriers that could decrease learner motivation.

  • Think about the background knowledge a diverse group of learner bring to your course and provide more choice to peak interest in assessments.
  • Vary the types of assessments throughout the semester.
  • Provide purpose through clear examples and rubrics with wording that directly ties into the content objectives.

Provide Multiple Means of Representation

Review the information, questions, and prompts given to learners. Are the means of representation construct relevant? Can you reduce or remove these barrier by providing alternatives?

  • Think of possible technological barriers if learners need to view unfamiliar content.
  • Are images, videos, charts, etc. accessible for learners and could all learners benefit from alternatives?

Provide Multiple Means of Action and Expression

Action and expression also tie into engagement. When learners are motivated by choice, you are also providing alternative means for learners to demonstrate their knowledge. Again, think of the construct relevance when asking learners to demonstrate their understanding of the content.

  • Think of possible technological barriers if learners need to use unfamiliar digital tools.
  • Provide rubrics and examples that help establish expectations on how to demonstrate learning effectively.
  • Ask yourself if what you are asking learners to demonstrate will give you an accurate picture of their learning.

When creating assessments, always think about how you incorporate freedom of choice, and the potential barriers learners may face.

3. Think about accessibility. Make auditory what is visible, and visible what is auditory.

First Things First - 5 Basics

  1. Include a Student Disability Services statement within your course and syllabus.
  2. All content intuitively reads left to right, top to bottom.
  3. Do not rely on color, font, or other sensory characteristics to convey meaning.
  4. Chunk large bodies of text and include meaningful headings.
  5. Use consistent wording, use a sans serif font that is at least size 9, and clarify uncommon acronyms.

4. Create opportunities for student engagement and student-student interaction.

HOP 2.51 Semester Credit Hour, requirements, contact hours different online, 9 hours (examples of activities - reading, communication with instructor/others, reading announcements, time in discussion, quiz, watching video, etc.) compare to face-to-face class time and outside activities

Let your students know how they need to interact with you and with others, and how often. Requiring interaction helps students develop soft-skills for communication and collaboration.

Discussion forums or blogs are the preferred Blackboard Collaboration tools for student engagement. This ensures all students have the same access to the interaction.

The Adobe Creative Cloud suite, and Adobe Spark, can be used for portfolios and final projects and provide a space for creative, collaborative work.

5. Create meaningful navigation for your assignments and organize the Grades section in a sequential order that reflects the course schedule.

Students need to know where and how to submit assignments. Links to submission locations and instructions need to be obvious to all students in the course.

Create regular announcements that provide students with information on upcoming due dates.

Refer students frequently to the course schedule.

Check the student view of grades regularly to ensure students clearly see their progress through the course.

Online Exams

Asynchronous is best. If synchronous, be aware of time of day. Students may not be able to be online at certain times of day. Always allow an asynchronous option.

Consider allowing open book and notes.

Use deeper questions. Ask how and why.

Be aware of barriers. Not allowing backtracking or forcing completion may put some students at a disadvantage.

Grading

Balance auto graded assignments with manually graded assignments.

Best practice: Some shorter quizzes that auto grade to provide for formative assessment; plus some major assignments and/or group assignments that require manual grading for more qualitative feedback.

Consider the number of students, whether or not you will have a TA or course grader, the types of assessments needed for your content, and the amount of time you have for grading.

Time Savers

  1. Group work provides experience in collaboration and conflict management, plus can lighten the grading load.
  2. Dictate your comments and use speech-to-text to transcribe them or record your comments and share an audio file.
  3. Use auto-graded exams with one or two manually graded questions.
  4. Use a rubric.

Quality Matters

Summer Incentive

  • Offer your summer term course(s) in an asynchronous modality.
  • Commit to offering the online course for two more iterations in future terms.
  • Complete the Quality Matters Training: Applying the Quality Matter Rubric course and Self-assessment Review. (Spaces are open for July.)

Strategy for Success

1. Follow the checklist.

2. Join our webinar every Tuesday.

3. Complete the activities each week.

4. Join a Q&A session each Thursday.

https://provost.utsa.edu/academicinnovation/remote-teaching.html
Created By
Shelley Howell
Appreciate

Credits:

Created with images by Jason Coudriet - "Sketching Ideas" • STIL - "to do list" • Gayatri Malhotra - "untitled image" • JESHOOTS.COM - "untitled image" • Kelly Sikkema - "Ideas waiting to be had" • Carlos Muza - "Statistics on a laptop" • JESHOOTS.COM - "untitled image" • Christian Fregnan - "Drifter a project by Studio Drift, showed at the Stedelijk Museum in Amsterdam. From their site: Drifter “how does your perception of the world shift as you realize that what we take for granted now – a world composed of huge, immensely strong and stable structures – was once considered utopia?”" • Sven Mieke - "untitled image" • Jason Coudriet - "Sketching Ideas" • Diego PH - "The focus" • Marvin Meyer - "untitled image" • John Schnobrich - "together now" • Priscilla Du Preez - "untitled image" • Letizia Bordoni - "The Choice" • Aleks Dorohovich - "books, pencils, laptop, and iphone on a desk" • Sincerely Media - "Reading [1]" • Glenn Carstens-Peters - "untitled image" • Alissa De Leva - "I took this photo in a private school in Italy (Bologna) and I found beautiful these two girls studying together." • Isaac Smith - "Charting Goals and Progress" • Suha - "untitled image" • Ameer Basheer - "Hit your Target"