Posts

Showing posts with the label academic

Types of Reliability

Image
You learned in the Theory of Reliability that it's not possible to calculate reliability exactly. Instead, we have to estimate reliability, and this is always an imperfect endeavor. Here, I want to introduce the major reliability estimators and talk about their strengths and weaknesses. There are four general classes of reliability estimates , each of which estimates reliability in a different way. They are: Inter-Rater or Inter-Observer Reliability Used to assess the degree to which different raters/observers give consistent estimates of the same phenomenon. Test-Retest Reliability Used to assess the consistency of a measure from one time to another. Parallel-Forms Reliability Used to assess the consistency of the results of two tests constructed in the same way from the same content domain. Internal Consistency Reliability Used to assess the consistency of results across items within a test. Let's discuss each of these in turn. Inter-Rater or Inter-Observer Reliability Whene...

Inventory of Assessment Resources

Source : Macalester College Terms and Definitions Assessment Over the years, assessment has been used to describe either a process toward improvement, or a process toward accountability, sometimes both. At Macalester, our goal for assessment is the continual improvement in the quality of the curricular and co-curricular programming offered by the College to its students. Following are a few descriptions of assessment that we've found especially useful: "Assessment is the process of gathering and discussing information from multiple and diverse sources in order to develop a deep understanding of what students know, understand, and can do with their knowledge as a result of their educational experiences; the process culminates when assessment results are used to improve subsequent learning." (Huba and Freed p. 8) "…A systemic and systematic process of examining student work against our standards of judgment, it enables us to determine the fit between what we...

Program Assessment Toolkit

Developed by Central i University (CMU) The toolkit includes: Steps for Developing a Program Assessment Plan Click here for a guide to assist with developing an assessment plan. Assessment: "A Guide" Visualize the "big picture" of outcomes-based assessment, click here. "Organize Your Thoughts": Assessment Plan Worksheet Click here for a worksheet to assist you with connecting your program mission, student learning outcomes and assessment strategies. "Organize Your Thoughts": Identifying Strategies Use this worksheet to assist you with identifying possible links between other learning opportunities and how they may be an outstanding strategy for your program assessment plan, click here. Why care about assessment of student learning? Click here to discover why assessing student learning is a good thing. What are the domains of student learning? Click here for a blueprint of the cognitive, psychomotor, and affec...