In April 2024, we began updating our mattress testing scores from scoring system 1.1 (which we’ve been using since September 2021) to scoring system 1.2.
You can find explanations for how we test, including every test and scoring methodology here.
What changes did we make?
Below is a list of the major changes and updates to our scoring system from version 1.1 to version 1.2.
General Changes
- Wider score spread – we increased the spread of our scores to more intuitively show the differences between mattresses. In our 1.1 system, our scores ranged from 8.53 to 9.95. In our 1.2 system our scores now range from 6.23 to 9.82. This change resulted in all scores dropping from scoring system 1.1 to 1.2. In addition, it is harder for mattresses to earn the highest possible scores, creating a clearer distinction between mattresses.
- Color tiers – in our 1.1 system 9-10 was green, 8-8.9 was yellow, and sub 8 was red. In our 1.2 system 8-10 is green, 6-7.9 is yellow, and sub 6 is red. We made this change to align with our score spread changes.
- 7-Tier scale labels – we updated the specific words we use to describe certain scoring tiers. 10 = outstanding, 9-9.9 = excellent, 8-8.9 = good, 7-7.9 = fair, 6-6.9 = mediocre, 5-5.9 = poor, 4-4.9 = terrible. These words were updated from our 1.1 7-tier scale labels to make them more intuitive and easy to understand.
- Score weights – the individual factor weights for our overall score was updated to more accurately reflect the priorities and needs of most sleepers. In our 1.2 system, cooling is 20% (+0%) , motion transfer 15% (+5%), response 10% (-5%), edge support 10% (-5%), sex 10% (+5%), pressure relief 20% (+0%), off-gassing 5% (+0%), and company 10% (+0%).
New & Updated Scoring Factors
- Motion Transfer – Increased the difficulty required to score highly. In our 1.1 system, for every 1.0 m/s² above 5 m/s²(s), 0.25 points are lost. In our 1.2 system for every 1.0 m/s² above 5 m/s²(s), 0.45 points are lost.
- Response Time – Increased the difficulty required to score highly. In addition, we added fully recovered response time as a scoring factor, which we feel increases the accuracy of the score. Mostly recovered response time is still the most important, with 70% of the score weight. Full recovery has 30% of the score weight. In our 1.1 system, for every second above 0.5 seconds, 1 points are lost (this only factored in mostly recovered time). In our 1.2 system, for mostly recovered, for every second above 0.2 seconds, 6.25 points are lost. And for fully recovered, for every second above 0.3 seconds, 2.94 points are lost.
- Edge Support – Increased the difficulty required to score highly. In addition, we added lying edge support as a scoring factor, which we feel increases the accuracy of the score. Sitting edge support and lying edge support are each weighted at 50%. In our 1.1 system, for every inch above 3 inches, 0.5 points are lost (this only factored in sitting edge support). In our 1.2 system, for sitting edge support, for every inch above 3 inches, 1.25 points are lost. And for lying edge support, we use our standard 7 tier scale to rate performance.
- Sex – Increased the difficulty required to score highly. Score weights were changed to award slightly more weight to bounce and less to noise. In our 1.2 system, bounce is 65% (+5%), edge support 20% (+0%), noise 5% (+0%), pressure relief 5% (+0%), and cooling 5% (+0%). In addition, changes were made to how bounce is scored. In our 1.1 system, for bounce, for every inch below 10 inches, 0.25 points are lost. In our 1.2 system, for bounce, for every inch below 12 inches, 0.63 points are lost. In addition, changes were made to how edge support is scored (note: sex edge support follows the same equation as our standard sitting edge support score). In our 1.1 system, for every inch above 3 inches, 0.5 points are lost. In our 1.2 system, for sitting edge support, for every inch above 3 inches, 1.25 points are lost. Sex edge support only considers sitting edge support.
- Off-Gassing – Increased the difficulty required to score highly. In our 1.1 system, for every day above 0 days, 0.08 points are lost. In our 1.2 system, for every day above 0 days, 0.278 points are lost.
- Company – Increased the difficulty required to score highly. Trust was added as a scoring factor. In addition, scoring weights were changed. We made these changes as we felt they more accurately reflect the priorities of most sleepers. In our 1.1 system, trial, warranty, shipping, and returns were all evenly weighted at 25%. In our 1.2 system, trial is 15%, warranty 10%, shipping 5%, returns 20%, and trust 50%. The scoring scale for both shipping and return costs was increased.
Why did we make these changes?
We are always looking for ways to improve our reviews. Our 1.2 scoring update was aimed at making our scores, ratings, colors, and descriptions more intuitive.
In addition, we added and revised several performance tests / scores to improve their depth and accuracy, which also helped to create clearer performance distinctions between mattresses.
Improving our Analysis
After testing 210+ mattresses in the last 3 years we have gathered a ton of data. This data has helped us better understand which mattresses are average, which are outstanding, and which are terrible (and everything in between).
This improved understanding allowed us to refine our scores so that it’s more clear which are the best mattresses.
Did any testing data change?
No, none of the actual testing data changed. A mattress that had 4.0″ of edge support sinkage still has 4.0″ of edge support sinkage. The only thing that changed is how we score that data.
You can always explore the data using our suite of mattress research tools here.
How do I know which scores are updated?
All review and comparison pages indicate which scoring system was used (be it 1.1 or 1.2) near the top of the page. We are currently working to update all reviews and contextual pages to scoring system 1.2.
All scores used in the following locations are already updated scoring system 1.2.
- Home page
- Mattress Reviews page
- Best Mattress page (including all 23 of the specific best mattress lists, ex. best mattress for side sleepers, back pain, cooling, sex, etc.)
- All tools pages including the table tool, mattress finder, and side-by-side comparison
If you’re wondering what the most current and accurate score is please use any of the above pages.
What about the scores in videos?
Updating the scores within our videos is more difficult, as it will require us to rewrite those scripts, re-shoot, and re-edit those videos. As a result, most of our library of videos won’t have their scores updated.
To see the updated / current score please visit our mattress reviews page.
The tests, data, and demonstrations within those videos are still valid. While the scores have changed, in almost all cases, mattresses performance and recommendations remain unchanged. In some cases, a performance score may have shifted up or down more significantly, which may impact our recommendations.
The revisions within our 1.2 scoring system have allowed us to better understand finer differences between mattresses and thereby improve our recommendations. This improved analysis resulted in shifts, additions, and revisions to the rankings on many of our best mattress lists.
Questions?
If you have questions about any of our scoring system updates please don’t hesitate to reach out.
