Test Setup

Synthetic Testing

• Tests are run with a 30-second-long warm-up time (result recording starts at second 31).
• Between each test, the drive is left idle for 60 seconds to allow it to flush and reorganize its internal data.
• All write requests contain random, incompressible data.
• Disk cache is flushed between all tests.
• NVMe drives are tested with a fan blowing on them, except on the thermal testing page, where uncooled behavior is investigated.

Real-Life Testing

• After initial configuration and installation, a disk image is created; it is used to test every drive.
• Automated updates are disabled for all programs. This ensures that—for every review—each drive uses the same settings without any interference from previous testing.
• Our disk image consumes around 150 GB—partitions are resized to fill all available space on the drive.
• Partitions are properly aligned.
• Disk cache is flushed between all tests.
• In order to minimize random variation, each real-life performance test is run twelve times with reboots between tests to minimize the impact of disk cache. The top and bottom outliers are removed and the ten remaining runs get averaged for the final score.
• All application benchmarks run the actual application and do not replay any disk traces.