ShinyTAM

(Shiny version of Test Analysis Module)



NEWS

  • A seminar on ShinyTAM was held successfully on Nov. 8, 2024. There were 137 participants and 100% of them were satisfied with this seminar.
  • A seminar on ShinyTAM was held successfully on March 21, 2024. There were 198 participants and 98.7% of them were satisfied with this seminar.
  • A new version of ShinyTAM was released on March 3, 2024.

Welcome to ShinyTAM!

This is an interactive online platform for test paper analysis and formative assessment using Rasch models. It can provide feedback to teachers by examining the reliability and validity of test papers and the quality of test items. It also provides information regarding students’ Zone of Proximal Development (ZPD).

Up to today ( 2024-11-21 ), our shinyTAM has been visited times.

You may perform your analysis by following the below steps:

1. Import and Analyze:

Download the data template and data input manual, and then import the data. Then check your data to see if any errors occurred while inputting. After that, you may perform the analyses by clicking 'Analyze'.

2. Once the analyses are finished, you may view various outputs in:

- Wright Map: pictures comparing distributions of person ability against item difficulty.
- Item Report: summary of item difficulties and item fit, as well as raw percentage scores of each class.
- Specific Item Report: summary of Multiple Choice (MC) and non-MC items with frequency percentage, percentage score, and person-ability mean by each option (for MC items) or mark category (for non-MC items).
- Person Performance-Fit Map: classification of persons by their abilities and performance (stable vs. unstable).
- Person Report: summary of person abilities and person fit, items that person performed poorer or better than expected, and ZPD.
- Specific Person Report: presents the expected score and observed score of a specific person, the gaps between these scores would be identified and lead to individualized learning.

3. Download Outputs:

You may download the outputs and a whole report for further usage.

Note: ShinyTAM utilizes 'TAM' package in R to perform psychometric analysis based on Rasch model.

Reference:

Robitzsch, A., Kiefer, T., & Wu, M. (2020). TAM: Test analysis modules. R package version, 3, 5-19.

License:

This program is a free online application and you can use or redistribute it by using the following citation:

Kwan, K., Xu, K., & Zhu, J. (2022-2024). ShinyTAM [Online application; Beta version 1.3]. Retrieved from https://shinytam.eduhk.hk

Download the data template and data input manual


Attention: This website undertakes not to store any data uploaded by any user. For users who require a higher level of privacy protection, anonymization of data may be considered.


You may first download the data template and data input manual from the following buttons:


Download Data Template
Click here!
Download Data Input Manual
Click here!



Data file display


You may preview your data file to check if there is any problem.

Item type and full marks

Person raw response



Person-Performance Map options


You may input your intended criteria for making the person-performance map and classifying people into different performance groups.




Data analysis


You may perform data analysis by clicking the following button:







Wright Map - General difficulty


Psychometric properties of the test


EAP reliability: a reliability measure of the test by expected a posteriori method.


Difference between Mean Person Ability and Mean Item Difficulty: a measure to evaluate the discrepancy between the general population ability and the whole test difficulty.


Mean Point-Measure Correlation: the mean association between each item and the whole test.




Item difficulty - General


Wright Map - Category difficulty


Psychometric properties of the test


EAP reliability: a reliability measure of the test by expected a posteriori method.


Difference between Mean Person Ability and Mean Item Difficulty: a measure to evaluate the discrepancy between the general population ability and the whole test difficulty.


Mean Point-Measure Correlation: the mean association between each item and the whole test.




Item difficulty - Category


Wright Map by Class - General difficulty


Note: Classes with only 1 person were omitted in the plot.



Psychometric properties of the test


EAP reliability: a reliability measure of the test by expected a posteriori method.


Difference between Mean Person Ability and Mean Item Difficulty: a measure to evaluate the discrepancy between the general population ability and the whole test difficulty.


Mean Point-Measure Correlation: the mean association between each item and the whole test.




Descriptive statistics by class


Wright Map by Class - Category difficulty


Note: Classes with only 1 person were omitted in the plot.



Psychometric properties of the test


EAP reliability: a reliability measure of the test estimated by expected a posteriori method.



Mean Point-Measure Correlation: the mean association between each item and the whole test.




Descriptive statistics by class


Item Report


A summary of item statistics, including mean percentage score, item difficulty, item fit, point-measure correlation, mean percentage score of each class.


Note. For item fit, '*' represents a fit value > 2, and '#' represents a fit value <0.5.


For Mean Percentage Score, '⚠️' indicates below expectations and '⚠️⚠️'indicate far below expectations. '👍' indicates above expectations and '👍👍' indicate far above expectations.


Item Report - MC


The report of multiple choice (MC) items: Option Frequency Percentage (Mean Percentage Score / Mean Person Ablity)


Item Report - non-MC


The report of non-Multiple-Choice (non-MC) items: Category (Marks) Frequency Percentage (Mean Percentage Score / Mean Person Ablity)


Person Performance-Fit Map


A scatterplot of person percentage score against person fit. Note that a value around 1 indicates the best person fit.


Classification description


Person Report


A summary of person statistics, including percentage score, person ability, person fit, performance-fit classification, items that a person is expected to get 1 more/less mark, and ZPD.


Specific Person Report


A summary of person scores, including expected score, observed score, score gap, and item classification.


Student Information:

Download outputs


You may download the following outputs:

Table Outputs
Download Table Outputs
Item Characteristic Curve (ICC) & Expected Scores Curve
Download Item Characteristic Curve & Expected Scores Curve
The Whole Report
Download the Whole Report (IN CONSTRUCTION)