PCs are the bedrock of modern business computing, so it’s important that they meet certain standards of performance and quality. To that end, as well as judging elements such as build quality, additional features and aesthetic appeal, we run all the devices we review through a series of benchmark tests designed to empirically measure their suitability.
In the case of PCs, this primarily focuses on CPU, GPU and storage speeds, but with laptops, we’ll also measure the battery life and the quality of the display. When testing high-end professional workstations aimed at more demanding roles, we’ll also run more in-depth benchmarks to measure their effectiveness at tests like video editing, rendering and 3D modelling.
Laptops and PCs
Performance
We run a selection of benchmarks on all the PCs and laptops we review. To test performance, we use our own in-house benchmarks to measure photo-editing, video-encoding and multitasking speeds, which we combine into an overall score. We’ll always quote this result in the review, but we may also mention individual test results if they reveal anything particularly noteworthy.
We run these tests on Windows and macOS, but we also use the cross-platform Geekbench 5 test for comparisons between operating systems, which gives separate scores for single and multi-core operations. We may also incorporate other benchmarks where appropriate, including PCMark 10 and workstation tests such as Cinebench R23 or SPECViewPerf 2020.
We use the results of these tests to empirically compare the performance of different machines, but we’ll also assess the real-world experience of using a device, and whether the benchmarks accurately reflect that. From this, we can recommend whether or not different laptops or PCs are suitable for different workloads and job roles, such as day-to-day office tasks or more demanding content creation jobs.
Display
Some of our assessments about a laptop’s display will be subjective observations about how it looks to the naked eye, but we also test each screen using a colorimeter to measure the maximum brightness and colour reproduction. We primarily test against the sRGB colour gamut - which is the main colour space that digital displays are usually calibrated to reflect - but we also measure Adobe RGB and DCI-P3 if screens are specifically tuned to match this colour profile.
We also measure Delta E, which gives a guide as to how accurately the panel displays a colour. Anything under one is excellent and likely to be difficult for the human eye to distinguish; between one and two is still strong; above this suggests a panel that you shouldn’t trust for colour-accurate photo editing.
Get the ITPro. daily newsletter
Receive our latest news, industry updates, featured resources and more. Sign up today to receive our FREE report on AI cyber crime & security - newly updated for 2024.
Battery
To measure a laptop’s battery life, we fully charge the battery, set the screen to a specific brightness level of 170cd/m2 (in order to ensure consistently comparable results across devices) and put it into flight mode. We then play a looped video, and measure how long it takes for the laptop to reach critical battery level and go into hibernation mode.
This gives us a benchmark that we can use to compare relative performance between different devices, but which may not be representative of real-world use. To that end, we also assess how long the battery lasts when used as an everyday device, subjecting it to a variety of workloads throughout the day.
Storage
We measure the performance of solid-state storage drives with the AS SSD benchmark test, which simulates four different file transfer operations to give an overview of speeds across various aspects of PC performance. We also guage day-to-day capabilities throughout our testing.
Workstations
On top of our regular benchmark suite, workstation reviews involve tests specifically aimed at a range of higher-end tasks. To test 3D modelling in all the main content types, we use SPECviewperf 2020, which runs OpenGL viewsets (as well as one Direct3D viewset) based on popular 3D content creation, engineering and medical applications. These include Autodesk 3ds Max and Maya, PTC’s Creo, Siemens NX, plus Dassault Systèmes CATIA and SolidWorks.
To assess 3D rendering, we also run Maxon Cinebench R20, which contains a highly multithreaded test that benefits from multiple processor cores, and we test GPU-accelerated 3D rendering with the OpenCL-powered Luxmark 3.1 benchmark.
We’ll also use other testing tools from time to time, including IndigoBench 4 and a real-world test frame created in Blender for the Cosmos Laundromat animated movie, codenamed Project Gooseberry.
ITPro is a global business technology website providing the latest news, analysis, and business insight for IT decision-makers. Whether it's cyber security, cloud computing, IT infrastructure, or business strategy, we aim to equip leaders with the data they need to make informed IT investments.
For regular updates delivered to your inbox and social feeds, be sure to sign up to our daily newsletter and follow on us LinkedIn and Twitter.