Below you can find information on our 1.0 scoring system. This was the scoring system we used at launch, but replaced around 4 weeks post-launch.
Scoring Factors
Our overall score is based on a weighted average of 10 scoring factors. The first 9 factors are performance testing factors, with “company” being the 10th factor.
- Cooling – 15% weight
- Sinkage – 10% weight
- Motion Transfer – 10% weight
- Response Time – 10% weight
- Bounce – 10% weight
- Edge Support – 12.5% weight
- Sex – 5% weight
- Pressure Relief – 12.5% weight
- Off-Gassing – 5% weight
- Company – 10% weight
Each factor is given a weight based on the level of importance, which we average together to determine the total score. Our individual factors are rounded up from the second decimal place. Our overall mattress scores are rounded up from the third decimal place.
Understanding Our Scores
We use a 1-10 point grading scale. The more points a mattress scores in any given criteria, the better its performance is going to be.
- 9.5-10 – this is a perfect or near perfect score, it just doesn’t get much better than this
- 9.0-9.4 – this a great score, while there is room for improvement, it’s still an excellent performer
- 8.5-8.9 – this is a good score, while it’s not perfect, it’s still likely to be good enough for many
- 8.0-8.4 – this is an okay score, depending on the factor and your desires this could be a red flag on a mattress to avoid
- 7.5-7.9 – this is a poor score, there are significant issues
- 7.0-7.4 – this is a bad score, there are significant issues
- <7.0 – this a failing score, there are significant issues
Scoring Methodology
Over time, we may find ways to improve our testing process, adjust scoring criteria, add / remove / revise scoring factors, and make other changes. These adjustments are designed to help ensure our scores create the most accurate and helpful mattress recommendations.
Our current scoring methodology is version 1.0.
If / when we update our scoring methodology we may also update any mattress reviews at that time. At the top of all mattress review pages you’ll find the current scoring methodology for which that mattress was tested under.
Cooling
Our cooling test uses a thermal camera to get precise surface level temperatures on the mattress. To complete this test we start by taking a thermal image before anyone lies on the mattress. Next, we lie on the mattress for 15 minutes, allowing it to absorb our body heat. Finally, we get up from the mattress and take thermal photos at at 6 different time markers (0, 1, 2, 3, 4, and 5 minutes).
While heat dissipation over time is a metric worth nothing, in our view, the most important measurement we take, and the one we score on, is the maximum temperature on the mattress after lying on it.
Here’s the scale we use to determine cooling scores:
- 10 – max temp ≤ 90 degrees Fahrenheit
- 9.5 – 90 degrees < max temp ≤ 92 degrees Fahrenheit
- 9.0 – 92 degrees < max temp ≤ 94 degrees Fahrenheit
- 8.5 – 94 degrees < max temp ≤ 96 degrees Fahrenheit
- 8.0 – 96 degrees < max temp ≤ 98 degrees Fahrenheit
- 7.5 – 98 degrees < max temp ≤ 100 degrees Fahrenheit
- 7.0 – 100 degrees < max temp ≤ 102 degrees Fahrenheit
Sinkage
In our view, there is an ideal level of sinkage on every mattress. Too much sinkage and you create cooling, support, and ease of movement issues. Too little sinkage and you create pressure points, comfort, and support issues.
As a result, our sinkage tests look for mattresses within the ideal sinkage range. These types of mattresses are most likely to be comfortable for most sleepers.
Our sinkage scores are based on the observed sinkage of a 12 pound medicine ball. This is reflective of what think of as pressure point sinkage. To make this measurement we place a 12 medicine ball on the mattress and take a photograph at level height. We then analyze the photograph to get the exact depth of sinkage.
Here’s the scale we use to determine sinkage scores:
- 10 – 1.75″ ≤ sinkage ≤ 2.25″
- 9.5 – 1.5″ ≤ sinkage < 1.75″ or 2.25″ < sinkage ≤ 2.5″
- 9.0 – 1.25″ ≤ sinkage < 1.5″ or 2.5″ < sinkage ≤ 2.75″
- 8.5 – 1″ ≤ sinkage < 1.25″ or 2.75″ < sinkage ≤ 3″
- 8.0 – 0.75″ ≤ sinkage < 1″ or 3″ < sinkage ≤ 3.25″
- 7.5 – 0.5″ ≤ sinkage < 0.75″ or 3.25″ < sinkage ≤ 3.5″
- 7.0 – 0.25″ ≤ sinkage < 0.5″ or 3.5″ < sinkage ≤ 3.75″
Motion Transfer
Our motion transfer tests uses accelerometer data to show motion in a quantifiable way. To complete our motion transfer tests we place our accelerometer on one side of the mattress and drop a 12 pound medicine ball on the other side.
The initial medicine ball drop and rebound creates an acceleration range, which is the primary data point we use for our scores.
Here’s the scale we use to determine motion transfer scores:
- 10 – acceleration range ≤ 5 m/s²
- 9.5 – 5 m/s² < acceleration range ≤ 7 m/s²
- 9.0 – 7 m/s² < acceleration range ≤ 9 m/s²
- 8.5 – 9 m/s² < acceleration range ≤ 11 m/s²
- 8.0 – 11 m/s² < acceleration range ≤ 13 m/s²
- 7.5 – 13 m/s² < acceleration range ≤ 15 m/s²
- 7.0 – 15 m/s² < acceleration range ≤ 17 m/s²
Response Time
Mattresses with a faster response time allow for easier movement of sleepers.
Response time is the amount of time it takes for a mattress to release its materials and respond back to its original shape. Memory foam mattresses tend to offer slower response time, which can leave some sleepers feeling stuck.
To test response time we place a 12 pound medicine ball on the mattress. Once fully at rest we quickly remove the medicine ball. We record the process using a video camera, overlay a stop watch, and then go frame-by-frame to assess exactly how long the mattress takes to recover.
On many mattresses, they will be mostly recovered fairly quickly, while a complete recovery of all foams can take longer. Mostly recovered to us means about 80%. I say “about” because this is a subjective assessment based on our analysis of the video footage. The mostly recovered stopwatch time is what we use to determine response time and score ease of movement.
Here’s the scale we use to determine response time scores:
- 10 – response time ≤ 0.5 seconds
- 9.5 – 0.5 seconds < response time ≤ 1.25 seconds
- 9.0 – 1.25 seconds < response time ≤ 2 seconds
- 8.5 – 2 seconds < response time ≤ 2.75 seconds
- 8.0 – 2.75 seconds < response time ≤ 3.5 seconds
- 7.5 – 3.5 seconds < response time ≤ 4.25 seconds
- 7.0 – 4.25 seconds < response time ≤ 5 seconds
Bounce
Bounce is a fairly preferential scoring factor. However, in our view, there is a reasonable level of bounce to which most sleepers would find comfortable.
Bounce that is substantially higher or lower than that range we view as an increasingly significant detriment to the comfort of sleepers.
Here’s the scale we use to determine bounce scores:
- 10 – 5″ ≤ bounce ≤ 7″
- 9.5 – 3″ ≤ bounce < 5″ or 7″ < bounce ≤ 9″
- 9.0 – 1″ ≤ bounce < 3″ or 9″ < bounce ≤ 11″
- 8.5 – -1″ ≤ bounce < 1″ or 11″ < bounce ≤ 13″
- 8.0 – -3″ ≤ bounce < -1″ or 13″ < bounce ≤ 15″
- 7.5 – -5″ ≤ bounce < -3″ or 15″ < bounce ≤ 17″
- 7.0 – -7″ ≤ bounce < -5″ or 17″ < bounce ≤ 19″
Edge Support
Whether you sleep next to, sit near, or have sex on, edge support in a mattress is important. To test edge support we sit directly on the edge of the mattress. Using a yard stick and high resolution photographs, we analyze photos to get a precise measurement of the level of compression on the edge.
In our mattress reviews you’ll see edge support measurements for both under the butt and under the legs. However, our scoring scale only use the leg measurement.
Here’s the scale we use to determine edge support scores:
- 10 – edge sinkage ≤ 3 inches
- 9.5 – 3 inches < edge sinkage ≤ 4 inches
- 9.0 – 4 inches < edge sinkage ≤ 5 inches
- 8.5 – 5 inches < edge sinkage ≤ 6 inches
- 8.0 – 6 inches < edge sinkage ≤ 7 inches
- 7.5 – 7 inches < edge sinkage ≤ 8 inches
- 7.0 – 8 inches < edge sinkage ≤ 9 inches
Sex
In addition to sleep, sex on the mattress is arguably the most important factor where users desire high performance. Certain mattress types may work with or against you when it comes to sex.
Our sex score is a simple equation where we look at 5 different factors. Each factor is given a different weight based on how important we think that factor is for most people.
Sex Score Equation = (Bounce * 0.5) + (Edge Support * 0.2) + (Noise * 0.2) + (Sinkage * 0.05) + (Cooling * 0.05)
Our equation inputs for edge support, bounce, sinkage, and cooling are derived from those respective category scores.
As our sex score is based on an equation we have no need for a standardized scale. However, you can still understand the final score in the same ways. 9.5-10 is excellent, 9.0-9.4 is good, 8.5-8.9 is respectable, 8.0-8.4 is okay, and less than 80 is poor.
Noise
Since we don’t specifically look at noise as a larger sub-factor, we are including a supplementary noise scale below. Our noise score becomes the 5th factor in the sex equation. Our rating for noise is a subjective assessment.
Below is our sex noise scale:
- 10 – minimal noise created by the mattress during sex
- 9.0 – moderate noise created by the mattress during sex
- 8.0 – high noise created by the mattress during sex
- 7.0 – very high noise created by the mattress during sex
Sex Bounce
While we do specifically look at bounce as a larger scoring factor, the way we rate bounce for general purpose sleeping doesn’t align well to sex performance. While tons of bounce isn’t always great for sleep, it’s almost always preferable for sex.
As a result, we use the same data from our bounce test, but use a different scale. Our sex bounce scale rewards more points for mattresses that have more bounce.
Below is our sex bounce scale:
- 10 – bounce ≥ 10 inches
- 9.5 – 10 inches > bounce ≥ 8 inches
- 9.0 – 8 inches > bounce ≥ 6 inches
- 8.5 – 6 inches > bounce ≥ 4 inches
- 8.0 – 4 inches > bounce ≥ 2 inches
- 7.5 – 2 inches > bounce ≥ 0 inches
- 7.0 – 0 inches > bounce ≥ -2 inches
Pressure Relief
When you lie on a good mattress you won’t experience any significant pressure points on your body. Mattresses that are too firm or too soft, not thick enough, lacking in comfort materials, or using poor quality materials all have the potential to create pressure points.
Pressure points are most often created while sleeping your side, as side sleeping creates the greatest pressure on the mattress, and therefore, potentially on your body. Sleepers who have heavier bodies, especially mid-sections, are more likely to experience pressure points.
Objectively measuring pressure relief is impossible, in our view. As a result, we choose to make a subjective assessment of pressure relief based on our experience testing the product, material quality, and material thickness (especially the top comfort layer).
Here’s the scale we use to determine pressure relief scores:
- 10 – excellent pressure relief
- 9.5 – great pressure relief
- 9.0 – good pressure relief
- 8.5 – okay pressure relief
- 8.0 – poor pressure relief
Off-Gassing
Off-gassing is the release of a gas that was dissolved or trapped within some type of a material. You can also think of this as the mattress smell. In many cases, foam mattresses have a strong smell when new. Depending the materials, construction, and other factors, that smell may be gone within a few hours or it may take several weeks.
Our off-gassing score is a subjective assessment based on the period of time it takes for any strong smell to fully dissipate.
Here’s the scale we use to determine off-gassing scores:
- 10 – off-gassing time ≤ 0 days
- 9.5 – 0 days < off-gassing time ≤ 5 days
- 9.0 – 5 days < off-gassing time ≤ 10 days
- 8.5 – 10 days < off-gassing time ≤ 15 days
- 8.0 – 15 days < off-gassing time ≤ 20 days
- 7.5 – 20 days < off-gassing time ≤ 25 days
- 7.0 – 25 days < off-gassing time ≤ 30 days
Company
Our company score looks at 5 factors that we think reflect the most critical elements.
Factors We Consider
- Trial Period
- Warranty
- Shipping
- Returns
- Country of Origin
These 5 factors are each worth 20% of the total company score.
Trial Period
How long is the trial period? The longer the trial period the better, as it provides sleepers with more time to make a decision on whether or not that mattress is the right choice.
- 10 – 180+ nights
- 9.0 – 100+ nights
- 8.0 – 30+ nights
- 7.0 – less than 30 nights
Warranty
A longer warranty is typically better than a shorter warranty. However, other factors like pro-rated warranty periods, foam indentation levels, and replacement options dramatically impact how valuable the warranty actually is.
- 10 – 10+ years
- 9.0 – 9 years or less
- 8.0 – 8 years or less
In some cases, mattress warranties have terms that are not in the best interest of consumers. These include pro-rate periods, aggressive indentation requirements, and less than clear warranty obligations. In the worst of cases, these factors may result in the mattress losing up to 2.0 points from their total warranty score.
In these rare cases, we will explicitly explain why we docked the points within the review page.
Shipping
In our view, the most critical factor for shipping is whether or not it’s free. Paying less for shipping is always better than paying more for shipping.
- 10 – Free shipping
- 9.0 – Minimal shipping costs (less than $100)
- 8.0 – Significant shipping costs (more than $100)
Returns
In our view, the most critical factor for returns is whether or not they are free. Not having to pay for a return / refund is always better than having to pay something.
- 10 – Returns are free
- 9.0 – There is a minimal cost to return (less than $100)
- 8.0 – There is a significant cost to return (more than $100)
Country of Origin
Where was the mattress manufactured? Mattresses built overseas can be less expensive, however, they can also be more prone to quality and material issues.
In our view, mattresses built in the USA are better than those built elsewhere.
- 10 – Made in the USA
- 8.0 – Made outside the USA
