Assessment, evaluation, rubrics and related topics

Assessment, evaluation, rubrics and related topics

Compiled by Alice Cassidy, In View Education and Professional Development https://cassidyinview.wordpress.com/

With thanks for contributions from Sue Stanton, Janice Johnson, Isabeau Iqbal and Clarissa Green of the University of British Columbia, contributors to the POD, STLHE and EDC listserves and others named below. Some materials include notes from contributors.

Do you have something to add? Let me know and I can update the list!

Learning Objectives:

Cassidy, A., M. Nabavii and Y. Sipos. (2008). Learning Objectives and Objectives. In Road to Global Citizenship: An Educators’ Toolbook.  (Harlap, Y., Editor). Centre for Teaching and Academic Growth, in collaboration with UNICEF, University of British Columbia. http://wiki.ubc.ca/Documentation:CTLT_programs/Global_Citizenship/Road_to_Global_Citizenship

Oklahoma State University, Institute for Teaching and Learning Excellence. This website gives a primer on writing learning objectives, including a chart to match verbs from Bloom’s original taxonomy with particular kinds of assignments and assessments. http://itle.okstate.edu/fd/online_teaching/effectiveobjectives.html

Understanding Objectives: a good ‘basics’ walk-through of the steps in creating, and problems encountered with learning objectives; includes a tutorial: http://edweb.sdsu.edu/courses/edtec540/objectives/ObjectivesHome.html

Simulation and other authentic assessment:

Blog by Quinn Sutton. Includes some links.  http://edsimulation.blogspot.com/

Kerka, Sandra. (1995). Techniques for Authentic Assessment. Practice Application Brief. ERIC Clearinghouse. http://eric.ed.gov/ERICWebPortal/search/detailmini.jsp?_nfpb=true&_&ERICExtSearch_SearchValue_0=ED381688&ERICExtSearch_SearchType_0=no&accno=ED381688

Jon Mueller has a freely available online Authentic Assessment Toolbox, that has some detailed chapters related to creating rubrics, and has lots of examples:  http://jonathan.mueller.faculty.noctrl.edu/toolbox/index.htm

University at Buffalo, Behling Simulation Center, Mainly related to health, offers workshops and courses: http://ahc.buffalo.edu/simulation/courses.php

This site includes reference to Primary Trait Analysis, used in to assess learning through assessment, as well as links to rubrics. Warning:  I found that some links on this site do not work. http://jtenlen.drizzlehosting.com/workshop/workshop6.html

Self-and peer-assessment:

Alverno College has a lot of great information and links: http://depts.alverno.edu/saal/selfassess.html

Background Knowledge Probe:  This Phoenix College site has one you can download. An introductory survey, it can be used by students as a self-assessment tool, or you can collect responses and use it as a form of pre-test or needs assessment for lesson planning. This one was used in a Reading and Literacy course:  http://pc.maricopa.libguides.com/content.php?pid=118016&sid=1086326

Brown, S. Rust, C. and Gibbs, G. (1994). Strategies for Diversifying Assessment in Higher Education Oxford: Oxford Centre for Staff Development. http://www.londonmet.ac.uk/deliberations/ocsld-publications/div-ass5.cfm

Race, Phil. (1993). Quality of assessment. Chapter 4 from Never Mind the Teaching Feel the Learning. SEDA Paper 80. Starts with “10 Worries about Assessment” http://www.londonmet.ac.uk/deliberations/seda-publications/race.cfm

Rubrics and self-assessment tools:

Blumberg, Phyllis. (2008) Developing Learner-Centered Teaching: A Practical Guide for Faculty. San Francisco:  Jossey-Bass. http://www.usciences.edu/teaching/Learner-Centered/

Phyllis’ fabulous book is a one-stop place for both faculty and faculty developers interested in the implementation/adaption of learner-centered teaching. Filled with insights and examples in addition to the rubrics, it is based on Maryellen Weimer’s work and five dimensions. Using ideas from Weimer’s classic book, Learner-Centered Teaching: Five Key Changes to Practice, Phyllis has developed multiple rubrics that can be put to immediate use, as well as some useful self-assessment tools.

Weimer describes it in her preface as a “a workbook—a self-help book in the best sense of the word.” Later, she comments: “Now there is a whole book to which faculty can be referred—a well-documented book that handles the implementation of learner-centered approaches to teaching with integrity, robustness, and careful attention to detail.”

Rubrics:

Rubric for self-evaluation of syllabi; look for the pdf link on a list of topics from the University of West Florida..http://uwf.edu/cutla/frs-syllabus.cfm

This site has links to rubric makers and pre-made rubrics: http://www.teach-nology.com/web_tools/rubrics/

Stevens, Dannelle D. and Antonia Levi. (2005). Introduction to rubrics: an assessment tool to save grading time, convey effective feedback, and promote student learning. Stylus Publishing. This is the definitive book on rubrics in higher education for us.

WikiPODia’s rubric page was created by Eli Collins-Brown, Bonnie Mullinix, and Season Eckardt. It is very comprehensive and has links to and examples of practicum and portfolio assessment: https://sites.google.com/site/podnetwork/Home/topics-for-discussion/Rubrics

The fifth item in the list, an old but excellent ASCD resource, is the best introduction I know to the concept of rubrics. There are links to many additional references. http://faq.hpu.edu/tlc/faq-pro/index_hpu.php?action=article&cat_id=002&id=144&lang=

Stevens, D.D. and Levi, A.J. Introduction to Rubrics. Stylus Publishing. You can download templates and use other interactive links:  http://www.styluspub.com/resources/introductiontorubrics.aspx

Quinlan, A. (2006). A Complete Guide to Rubrics. Rowman & Littlefield: Lanham, Maryland.  This book is useful for all grade levels, including adult learners.

Understanding Rubrics. Heidi Goodrich Andrade: http://learnweb.harvard.edu/ALPS/thinking/docs/rubricar.htm

Rubric Creation: http://projects.edtech.sandi.net/staffdev/tpss99/rubrics/rubrics.html

From the Teaching, Learning and Technology Group: http://www.tltgroup.org/resources/Rubrics.htm

Multiple Choice Questions:

Educational Technologies, Virginia Tech: http://www.edtech.vt.edu/edtech/id/assess/items.html

ERIC Clearing House on Assessment and Evaluation  http://www.ericfacility.net/ericdigests/ed398238.html

Georgia Southern University, from Russell Dewey:  http://www.psychwww.com/selfquiz/aboutq.htm

Kent State University, from Albert Ingram:  http://www.albertingram.com/mctests/

University of Oregon’s Teaching Effectiveness Unit http://tep.uoregon.edu/resources/assessment/multiplechoicequestions/mc4critthink.html

Writing Multiple Choice Item Writing Dos and Don’ts http://pareonline.net/getvn.asp?v=4&n=11

Do you have something to add? Let me know and I can update the list!

General:

The American Evaluation Association http://www.eval.org/

Angelo, T.A.  and Cross, K. P. (1993).  Classroom assessment techniques: A handbook for college teachers (2nd ed.).  San Francisco:  Jossey Bass. http://www.josseybass.com/WileyCDA/WileyTitle/productCd-1555425003.html

Assessment listserv:  assess@lsv.uky.edu

The list owner is Dr. Roseann R. Hogan, Director of IR and Planning at the University of Kentucky-Lexington vaahogan@ukcc.uky.edu

Assessment of LearnerCentered Practices (ALCPhttp://www.alamo.edu/sac/murguia/aclp.htm

Biggs SOLO (Structure of the observed learning outcome) taxonomy, by John Biggs; has similarities to other taxonomies (such as Bloom and Fink) but has also organizes outcomes by level of structure:  http://www.johnbiggs.com.au/solo_graph.html

Bloom’s Taxonomy and revised taxonomy. A couple of websites to check out. The last one at Oklahoma State has some great charts, including one called ‘Matching Action Verbs with Bloom’s Taxonomy’ that also connects kinds of assignments and assessments and instructional strategies with the original taxonomy:

http://www.kurwongbss.eq.edu.au/thinking/Bloom/blooms.htm

http://www.techlearning.com/article/Blooms-Taxonomy-Blooms-Digitally/44988

http://itle.okstate.edu/fd/online_teaching/effectiveobjectives.html

Carriveau, R.S. (2010). Connecting the Dots: Developing Student Learning Outcomes and Outcome Based Assessments.  Denton, TX:   Fancy Fox Publications.

Cheser Jacobs, L., and Chase, C.I.  (1992).  Developing and using tests effectively:  A guide for faculty.  San Francisco:  Jossey-Bass.

Chickering, A.W. and Gamson, Z. F. (1987). Seven Principles for Good Practice in Undergraduate Education. The American Association for Higher Education Bulletin, March 1987. http://www2.honolulu.hawaii.edu/facdev/guidebk/teachtip/m-files/m-7princ.htm

Crisp, Geoffrey. The E-assessment Handbook. London: Continuum International Publishing Group. The related e-assessment website: http://andy.services.adelaide.edu.au/moodle/ at the University of Adelaide has a wide variety of topic links.

Daley, Barbara J. (1999). Novice to Expert: An Exploration of How Professionals Learn. Adult Education Quarterly. Summer, 1999. Volume 49(4): 133-147. http://aeq.sagepub.com/content/49/4/133.abstract

Fenwick, T.J. and Parsons, J. (2009). The Art of Evaluation: A handbook for educators and trainers. Toronto: Thompson Educational Publishing. http://thompsonbooks.com/books/higher-education/art-evaluation.html

Field-tested Learning Assessment Guide, from the University of Wisconsin-Madison. This is a very cleverly designed site with what looks like a lot of great resources. It helps to bridge gaps that may exist between objectives and assessments and has helpful links to portfolios, performance assessment and much more:  http://www.flaguide.org/

Fink, D.  (2003).  Creating Significant Learning Experiences.  San Francisco:  Jossey-Bass.

Gronlund, N. (2003). Assessment of student achievement. (7th ed.). New York, NY: Allyn and Bacon.

Huba, M. E., and Freed, J. E. (2000). Learner-Centered Assessment on College Campuses: Shifting the Focus from Teaching to Learning. Needham Heights, MA: Allyn & Bacon.

McMillan, J. H. (2001). Classroom assessment: Principles and practice for effective instruction (2nd ed.). Boston: Allyn & Bacon. ISBN 020529751X

Nitko, A. J. (2001). Educational Assessment of Students (3rd ed.) Upper Saddle River, NJ: Merrill Prentice Hall. ISBN 0-13-013708-1.

Online Learning Assessment Levels of Authenticity. From the Wisconsin Technical College System Foundation (WTCS) and WIDS. Charts and guides, that you can copy and use if credit is given. Your best bet is to google this phrase to get to the very helpful charts:  ‘Summary chart of levels of authenticity’

Perry’s Scheme of Intellectual and Ethical Development. Many web links possible through searches. Start here:  http://www.cse.buffalo.edu/~rapaport/perry.positions.html

Popham, W. J. (2002). Classroom assessment: What teachers need to know (3rd ed.). Boston: Allyn & Bacon. ISBN 0-205-33304-4

Practical Assessment, Research and Evaluation (PARE), an online journal  http://pareonline.net/

Ramsden, Paul. (2003). Fourteen rules for better assessment. In Learning to teach in higher education (2nd edition), p. 204-205. London:  Routledge Falmer. http://www.deakin.edu.au/itl/pd/tl-modules/assessment/thinking-assessment/ramsdenquote.php

Sefton-Green, J., and Sinker, R. (2000). Evaluating Creativity: Making and Learning by Young People. New York: Routledge.  ISBN -415192420

Svinicki, M.D. (1993). Four Rs of effective evaluation. The Teaching Professor, 7 (9), 3-4.

Trice, A. D. (2000). A handbook of classroom assessment. Menlo Park, CA: Addison Wesley Longman. ISBN 0321053974

Walvoord, B.E. and V. Johnson Anderson. (2009). Effective Grading: A Tool for Learning and Assessment in College, 2nd Edition. San Francisco:  Jossey-Bass. This new edition offers a hands-on guide for evaluating student work and examines the link between teaching and grading. And, it is a lot more than grading. One of the classics http://www.josseybass.com/WileyCDA/WileyTitle/productCd-0470502150.html

Do you have something to add? Let me know and I can update the list!

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s