13 Evaluating OER

Quality Assessment

As you search for OER, you will likely be evaluating each item you come across. You may be able to immediately disregard materials because they have irrelevant content, are inappropriate for your audience’s knowledge/skill level, do not provide thorough enough explanation of the concept you’re targeting, etc. Some features stand out as obviously high quality, while others obviously fall short. This chapter gives some insight about specific features to evaluate to determine if the OER material is right for the purpose and audience you need to address. As you’re searching, you can keep in mind at least these criteria: clarity, accuracy, adaptability, intended audience, accessibility, and additional included materials.

Here are some other strategies to focus on quality:

Evaluation Criteria

Let’s explore our evaluation criteria in detail. You can download the Evaluating OER Checklist in Google Docs, which is a modified version of the list below.

  1. Clarity, Comprehensibility, and Readability
    1. Can students read and understand the content? Are the text, images, videos, or other media components clear?
    2. Is format consistent?
    3. Is content well-organized?
  2. Accuracy
    1. Is the information accurate, relevant, and recent?
    2. Are there any errors, typos, or broken links?
  3. Adaptability
    1. Can you chunk the content into only the parts you need?
    2. Does the resource’s license allow you to revise it?
    3. Is the format easily sharable with students?
  4.  Audience-specific
    1. Is the resource right for your students’ knowledge/skill proficiency level and their reading level?
    2. Does it align with your learning objectives?
  5. Accessibility
    1. Does the resource meet the needs of diverse learners? Consider image alt-text, captions on videos, transcripts for audio, and compatability with third-party reading apps.
  6. Additional Materials
    1. Does the material include other materials like reflective questions or learning activities?
    2. Do the ancillary materials apply to the learning objectives?

Diving Deeper into Accessibility

Accessibility is a key feature of open educational resources, and evaluating for accessibility and making accessible content is time well spent. If students can’t access a course material, it’s not serving the purpose you intend. Additionally, offering accessible resources is useful for everyone, including those who prefer to read captions instead of listen to a video or who prefer to use a screen reader on a text rather than read it. While this may be a need for some, it is also a preference for others. Delivering accessible content means more student engagement with your course materials. For a deeper dive into resources geared toward helping educators meet the needs of their diverse students, check out these helpful sites:

  • Accessibility at UCF explores how you can create more equitable experiences as an instructor, a student, a content creator, a developer, a planner, and a technology adopter. There are resources to learn more about supporting accessibility, so this is a great first place to start as it’s focused on our own UCF community.
  • OER Accessibility Toolkit, which provides key concepts and best practices for making content, links, images, tables, videos, font, color, formulas, and files accessible. It also include a great Checklist for OER Accessibility.

Considering Diverse Learners and Perspectives in OER

OER has the benefit of allowing students to see themselves in the educational content. If students feel excluded or don’t see themselves as part of the learning community, they’re less likely to engage with it. Thus, OER strives to reflect the diverse backgrounds, experiences, and perspectives of all learners.

Explore the Open Education Network’s Diversity, Equity, Inclusion in OER Rubric & Guide to determine if course materials meet the needs of diverse groups of students. You may consider the following:

  1. Does the resource represent various cultures, identities, and viewpoints?
  2. Does the resource provide equitable access? This includes limiting the financial barriers for students from underserved or marginalized communities.
  3. Is the content free from cultural, gender, racial, or other biases?
  4. Does the resource encourage critical thinking and engagement with a variety of viewpoints? Does it prepare students to be part of a diverse, interconnected community?

By considering these, and certainly other, factors, you’re positioning your students to be part of the learning community. They are more likely to engage with the materials and others when they feel a sense of belonging. The concept of openness requires all students, regardless of their backgrounds or abilities, have the opportunity to be present, to be heard, and to succeed.


References

Affordable Learning Georgia. (n.d.). Affordable Learning Georgia quality standards for open educational resources (Adapted from QM Higher Education Specific Review Standards and BCcampus Self Publishing Guide). https://www.affordablelearninggeorgia.org/oer/selection-criteria/ Licensed under CC BY 4.0.

Open Education Network. (n.d.). Diversity, equity, inclusion in OER rubric & guide (Adapted from Course materials adoption best practices by Open Oregon Educational Resources). https://docs.google.com/spreadsheets/d/1BG92jbIsOgjw08HR3c1EfQhvP1GCiM54tu5rwxhc-nk/edit?gid=0#gid=0 Licensed under CC BY 4.0 International License.

Open UBC. (2023, August 24). OER accessibility toolkit. https://open.ubc.ca/oer-accessibility-toolkit/ Licensed under CC BY-SA 4.0.

Elder, A. K. (2019). Evaluating OER. In The OER starter kit (Chapter 5). Iowa State University Digital Press. https://iastate.pressbooks.pub/oerstarterkit/chapter/evaluating-oer/ Licensed under CC BY 4.0.

License

Icon for the Creative Commons Attribution-ShareAlike 4.0 International License

UCF Open Educational Resources OER Starter Guide Copyright © by Emily Franklin; Charlotte Jones-Roberts; Dr. Denise Lowe; and Susan Spraker is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License, except where otherwise noted.

Share This Book