Today, we updated how standard masteries are calculated. Previously, any time a student answers a question, we update the mastery data for the standards the question is tied to. Standard masteries were inflated because
- Podsie requires students to answer a question correctly once before moving on, so the last answer is always correct
- We use a decaying average formula where the most recent response is weighted most heavily
To address this, we did the following
We updated the formula formula to weigh the most recent response a bit less.
Previously, the formula used was
old mastery * 0.35 + new assessment * 0.65 = new mastery
Now, the new formula is
old mastery * 0.5 + new assessment * 0.5 = new mastery
In the future, we plan on implementing features that allow teachers to customize how they want to calculate mastery score.
Only the student's first attempt for a question on an assignment or personal deck session will count towards their mastery store. Any subsequent requests will not count.
We've updated our FAQ (https://www.podsie.org/faq) to include an example on how we calculate mastery.