How We Test Robot Vacuum Cleaners

We want to provide an accurate view of every robot vacuum cleaner, and that is why we have set up some guidelines for how we test and rate each individual robot vacuum cleaner in the most optimal way. We might become more knowledgeable along the way, and therefore we will continuously update our methodology. We pay for the robot vacuum cleaners ourselves (we don’t get them from manufacturers), because there is a clear tendency for bias in reviews where the product has been received for free.

Methodology 1.1 (May 2023)

We use both subjective and objective criteria in our assessment of each robot vacuum cleaner.

Home environment test

We set up the robot vacuum cleaner normally like any other person would, and notify if something doesn’t work or doesn’t make sense. Thereafter we test the robot on two floors in an ordinary home. This assessment gives us information about:

• If errors occur,
• if the robot gets stuck,
• if it navigates properly,
• if it cleans every corner,
• how intuitive the robot is to operate,
• how well the app works,
• how noisy the robot is,
• and much more.

This gives a good first impression of what kind of product we are dealing with and how it differs from other products.

Parquet floor cleaning test

We test the cleaning results of each robot vacuum cleaner on parquet floor. We do 2 different tests, and in both tests we use the robot vacuum cleaner’s “Max mode” setting. We weigh the robot’s dust container before the test and just after the test is finished.

• Sand cleanup test: We spread 50 grams of sand in a closed area and weigh how much the robot has vacuumed up when it has finished cleaning.
• Rice cleanup test: We spread 50 grams of rice in a closed area and weigh how much the robot has vacuumed up when it has finished cleaning.

Carpet cleaning test

We test the robots ability to clean up sand from the carpet. In our test we spread 50 grams of sand on a carpet and weigh how much of the sand the robot is able to pick up.

Mop cleaning test

We tested the robots ability to mop a parquet floor using three different dry stains:

• A dry stain of ketchup
• A dry stain of coffee
• A dry stain of sour cream

We monitored and noted the robot’s ability to clean up each of the stains.

Object avoidance test

We test each robot’s ability to avoid objects. We spread out 5 ordinary objects in an area, and monitor how well the robot vacuum cleaner navigates around the objects. The items are as follows:

• A fake poop
• A can
• A pet water bowl (filled with water)
• A rolled up cable
• A piece of clothing

We film the process and rate the robot’s ability to avoid the object from three categories:

• Not avoided at all (0 points)
• The object is softly touch (10 points)
• Completely avoided (20 points)

Noise emission test

We test the noise emission of each robot vacuum cleaner. The test is conducted 1.2 meters above the robot vacuum cleaner in a quiet room. The test is conducted with various cleaning settings and the highest measured noise is noted for each cleaning setting. We conduct the test with the following cleaning settings:

• Noise emission in “Max mode”
• Noise emission in “Standard mode”
• Noise emission in “Quiet mode”
• Noise emission of dirt disposal unit, when emptying dust bin (if the robot has a dirt disposal unit)

Overall score

The overall score we award each robot is based on both the subjective criteria and the objective criteria.

Reviewing methodology 1.0

Our experts are doing in-depth research on robot vacuum cleaners. They spend 4-10 hours on each robot vacuum cleaner, where reviews by users and experts are read. In addition, videos of the product are seen, and its specifications are reviewed. After thorough research, a review of the product is made.