Suunto 9, Polar Vantage V, Coros Apex Comparison: Prague Marathon

In this third installment of my series comparing the GPS performance of different sports watches, I ran in the Prague Marathon.

Modern sports watches develop while they are already being used. Case in point: Before the Prague Marathon, the Polar Vantage V got updated to firmware 3.2.10, which Polar says to include GPS accuracy updates…

Let’s see how it went.

The Situation

This run proved nicely diverse in conditions; close to ideal for a look at GPS tracking performance of sports watches in one of the situations people would most want to use them:

The situation, obviously, a marathon. Kilometer markings and all…

The conditions: A start (and finish) in an old town’s city center with urban canyons, some time on open ground next to and over a river, several out-and-back sections, a course that uses some parts twice, some underpasses and a longer tunnel.

GPS tracks across the tunnel; not much of an issue at all, interestingly
GPS tracks across the tunnel; not much of an issue at all, interestingly

Perfect for seeing about GPS tracks and distance.

It was rather cold, so that should have made it challenging for optical heart rate measurement. My hands got warm enough later, during the run, but there was still enough cold wind at times for some chill…

Watches Tested

Equipment-wise, I ran with the Polar Vantage V (on firmware 3.2.10) alone on my left wrist, in order to have it undisturbed by other watches in both GPS reception and optical heart rate measurement.

The Suunto 9 Baro again accompanied it held in / worn over the back of my left hand (and getting HR readings from a Polar H10 heart rate belt), running firmware 2.6.54 (the latest public version).

On my right wrist, I wore the COROS Apex (rather too low to the wrist for good oHR readings) on its latest firmware, v1.31.

Prague Marathon Tech
Prague Marathon Tech

Just above the Coros Apex on my right arm, rather too close not to get some disturbance between the two watches there, I had a Suunto test watch on firmware 2.8.

This time, I used all the watches (that allow for such a setting, i.e. all but the Vantage V) with GPS only, without GLONASS.

(If you didn’t know, I’m among Suunto’s “external testers” – that’s why/how I have those Suunto. The Coros Apex is also from its maker, for testing and reviewing; I bought the Vantage V myself from my own, largely non-existent, money.
My blogs might now be successful enough they pay for their hosting, but that’s about it. There are ways you could support me; just look in the sidebar…)

Back to the present business.

The Marathon “Pacing” Situation

To make sure everything was ready, I set all the watches to training mode soon after I had managed to get into my start block. Stuck between houses close by on two sides, the view of the sky was pretty limited there; I felt pretty cold; so problems with oHR are to be expected and GPS took a long time to get a rather tentative fix.

To avoid having to bother with four watches that need starting while already running, I also started the watches then and there, some 4 minutes and 200 meters before the start time and starting line.

Prague Marathon: GPS around the start and finish
Prague Marathon: GPS around the start and finish

Kilometer Markings and Autolaps

Given the earlier start, digressions from the ideal line, and different algorithms, some difference between the autolap at every kilometer and the official markings had to be there.

GPS tracks from the middle of the Prague Marathon, with the one time that the Coros Apex meandered more strongly. Note the typical difference between the tracks on the bridges - open view to sky! - versus even just along the river!
GPS tracks from the middle of the Prague Marathon, with the one time that the Coros Apex meandered more strongly. Note the typical difference between the tracks on the bridges – open view to sky! – versus even just along the river!

Differences

These differences felt consistent at first, but became more pronounced over time on the Suunto 9 especially, and less so on the Polar Vantage V.

The Coros Apex, which is usually described as undercounting distances compared to other watches, remained at 200 (to a maximum of 300, maybe 400) meters ahead of the race course’s markings.

At kilometer 17, for example, the Suunto 9 Baro had measured a distance of 17.7 km already, the Polar Vantage V was at 17.4 km and the Coros Apex showed 17.2 km.

At kilometer 24, it was 24.78 on the Suunto 9 Baro, 24.45 on the Polar Vantage V, and 24.26 on the Coros Apex.

Distance and cadence graph from the Prague Marathon
Distance and cadence graph from the Prague Marathon. Cadences were pretty similar (and paces, as far as available*, as well); distance increased faster on the Suunto 9 Baro than Vantage or Apex…
(*Pace or speed distance is of course visible in Polar Flow, but not exported so I could directly compare it on Quantified Self)

Distance Pacing

This increasing difference also meant that, towards the end of the marathon, the Suunto 9 annoyingly marked an autolap for km 41 right around what was actually km 40, which is not what you’d want to pace – or even just motivate – yourself with.

The Polar Vantage V was ahead of the actual distance by almost half a kilometer, which is not ideal but within the difference I would expect.

The Coros Apex, however, marked autolaps well within visible distance and what felt like mere seconds from the official marking.

Totals

Eventually, the total distances recorded were:

  • 43.35 km on the Suunto 9 Baro
  • (42.98 km from the other test Suunto ),
  • 42.83 km with the Polar Vantage V, and
  • 42.50 km according to the Coros Apex.

The Stryd footpod, by the way, recorded a distance of 42.42 km.

(I used it connected as power sensor to the Suunto 9 Baro, so that its power number would show there, but it was not in use as a speed/distance sensor – but its internal memory still records that data for the offline sync which I used to get additional data.)

This makes for differences of max. 850 meters between the GPS devices (930 meters between Stryd and Suunto 9 Baro, if we also want to look at those). Compared to the total 42.195 or the values recorded by the watches, that’s ~2% difference – or not exactly horrible, yet again.

Compared to the Vienna City Marathon

If we look back to the Vienna City Marathon mere weeks – but also an older Polar Vantage firmware – back… well, it’s difficult to conclude anything just from my data. Except perhaps that judging watch performance from snapshots like these is difficult.

At the Vienna City Marathon, all the watches showed a few more (recognizably) erroneous bits in the GPS tracks. I would like to say this is likely because Vienna does have a few more tall buildings with glass facades which might have reflected GPS signals more.

GPS issue during the Vienna City Marathon
Maybe you remember this bit, where the glass facade of the government building here was pretty likely the culprit

Then again, there were more meanderings on course segments in Vienna which were on rather open ground, too…

And yet, the differences in total distance recorded by the different watches there had been a bit closer together, with a maximum difference ~1%.

  • 42.92 km from the Polar Vantage V
  • 43.19 km from the Coros Apex and
  • 43.36 km from the Suunto 9 Baro.
  • (42.74 according to Stryd)

Interestingly, the Polar had recorded the shortest distance here, the Coros Apex was in the middle.

It is still very likely, judging by what the marathon was like, that the (overall) higher distance was appropriate.

I had expected Prague, e.g. with the crossing of the Charles Bridge, to require at least as much weaving around other people as was necessary in Vienna. That was absolutely not the case, however. In Prague, I was able to run close to the ideal line much more often than in Vienna, and I did not have to constantly wend my way around other runners.

That this still made for more difference between the watches, though, is a bit of a headscratcher…

Same Sony GPS Chip, Different Algorithms

This whole issue of differences in GPS tracks is particularly interesting as all these watches use a – if not the – GPS chipset from Sony.

Polar Vantage V

In the case of the Vantage, it could be the new algorithm/firmware for the GPS that is responsible for the (now) greater distance recorded.

Perhaps the greater accuracy this is supposed to have brought with firmware 3.2.10 made the watch count a bit more distance (relatively speaking) now.

What is quite obvious from the start (of the watches) in Prague is that the Polar Vantage still, new firmware as old, counts nearly every turn or GPS signal that could be a turn as movement, even when it is received while basically standing still.

GPS tracks at start again, to point out how much more the Vantage V track already "moved"
I mean what I’ve already shown above… Much more here-and-there in the GPS track from the Polar Vantage V, while I was just bouncing up and down in place

This was very visible on a track at the beginning of the year, in the mountains, which I have not (yet?) added to this series because it is, by now, with comparatively old firmware…

Coros Apex

The Coros Apex is a bit hard to estimate.

Since this marathon, I feel that it may not actually undercount distances as people often think, but be closer to reality.

It certainly has been producing the “cleanest” tracks, and looking at e.g. how its tracks show in curves, that is not just because it is recording fewer points (which could give the appearance of little “wobbling” just because points in between are recorded by other watches but not by the Apex).

180-degree turns in the Prague Marathon. Clean turns, no cut corners, from all the watches...
180-degree turns in the Prague Marathon. Clean turns, no cut corners, from all the watches…

Suunto 9 Baro

With the Suunto 9, unfortunately, it is quite clear that it overestimates distances because it has a tendency to “wobble.”

Tracks that are recorded while moving in a straight line tend to shift ever so slightly left and right all the time, and my assumption is that this is what adds up to the increased distance.

It is actually very strange, though, because the Suunto seems to be much better at filtering out small, quite likely not-really-existing, turns in the track (which are visible in the tracks from the Vantage V) – but then, it still ends up showing a greater distance than the Vantage.

(I guess I will really need to put up the post from the hike in the mountains which showed that very well…)

oHR Performance

Same as in the Vienna City Marathon, I want to focus on GPS here… and the reasons are both that I want to, and that oHR just doesn’t work for me except in perfectly comfortable weather, shorter runs, and when a few gods smile on me, apparently.

Just look at the chart, and know that the Suunto 9 recorded the HR as measured via the Polar H10 heart rate chest strap.

HR recorded at the Prague Marathon; Vantage V in great position for recording, Coros Apex potentially disturbed from other watch, Suunto 9 recording from chest strap
HR recorded at the Prague Marathon; Vantage V in great position for recording, Coros Apex potentially disturbed from other watch, Suunto 9 recording from chest strap

As I mentioned at the beginning, the marathon started out pretty cold, so my hands certainly didn’t get much blood flow. That got considerably better later on, but also only at times – and it clearly shows.

The only thing I find noticeable in the data from the Vienna City Marathon and now the Prague Marathon is that there is the same decline in heart rate as recorded by oHR as the marathon gets closer to the end.

This happened in both marathons, when my actual heart rate (as recorded by the chest strap) was shifting more and, at least eventually, trending upwards.

The HR strap is certainly correct with that, not just because that is a tried-and-true technology, but also because I had some (more) walking breaks and an eventual acceleration into the finish.

Question:

What else would you like me to have a look at?

I’m thinking power (between Vantage V and Stryd), when it comes to such comparisons…

9 responses

  1. Luís Pinto Avatar
    Luís Pinto

    I bet that if you use two VV or S9 at same time, same wrist you will get different plot line views and statistic reports. It’s nature of registry. I wonder which will be the impact of Galileo support in Sony chipset. Now that Garmin have new firmware for Sony chipset hat support Gal, what will be the status? Would be very interest to make tests. I like your tests. But never seen better “public” tests more complete and obsessives like Savage made before. The antenna roles a play like a queen. Chipset is a King. I have seen Amafit results in terms of line plots (with Sony chipset) with excelent results. It’s amazing that price don’t reflect quality results. I wonder what are results of MARQ? Just DC made someting, but premilinar test with previous firmware. Now there is one more recent: https://www8.garmin.com/support/download_details.jsp?id=14843

    1. Yes, absolutely. You can’t put the watches in the same position or they’ll (potentially, supposedly,…) affect each other’s readings. And the further apart they are, the more chances they’ll record GPS signals slightly differently, get a different track.

      A new system, like Galileo, can make things better or worse. Uhmmm… I think I can say that there have been issues with the Sony chip and Galileo.

      John. Savage. Fellrunner. Yeah, he’s been an inspiration. And I’d still have points of contention about his approach to the analysis. (Mainly just about distance measurement; most people discuss accuracy as meaning how close to the actual track on the ground the GPS track is…). The point I’d rather make about him: You know he’s given up work with GPS watches because, the way he wanted to do it, at least, it just was’t economically sustainable for him? Similar issue I’ve always been facing…

      1. Luís Pinto Avatar
        Luís Pinto

        I know. Savage don’t make anymore more watches tests. To much time consumption, you have to rest at same route again and again, everytime that a firmware related to gnss is release. Is boring. But i think is the best way. Different Days, different sat positions, different weather. Just One stable thing: methodology.

        1. Tommy Avatar
          Tommy

          … and then you have to do it all over again for every new firmware. It just isn’t feasible anymore.

          1. Yeah, that’s one of the *slight* issues I’m seeing, well, with all of my approach, as well. Then again, I just realized that I fear it’s not worth it to talk about how to do certain things on older watches… but that actually gets enough people my way.

            If only leaving the talk of the newest stuff to DC Rainmaker didn’t also mean leaving the money to him…

  2. Luís Pinto Avatar
    Luís Pinto

    I bet also that if you put sony chipset with current firmware for Suunto, in the same structure as Suunto Trainer you will get results very good. Better than S9.

    1. Funny you should say that… 😉

      1. Tommy Avatar
        Tommy

        Oh, that’s what it is? 🙂
        Interesting. Same chip, same firmware and be able to see how much actually the antenna design will be at play

  3. Goku travelling Avatar
    Goku travelling

    The stryd is the most accurate in terms of running, try with the suunto as a footpod and other day with the Polar to see how thins go, please.

    For me is very sad see the Suunto 9 baro, the top of Suunto no being as good it used to be. I hope the new firmware will help. Meanwhile I run with the stryd as a footpod and the distance are always perfect.

    What I am not very sure if 4 watches at the same time can affect in the test.

    About the money I suppose it has to be hard, but your work is outstanding, the how to videos, the navigation videos, the tests.. I’ve learned a lot and happy to patreon.

    Thank you very much.

    pd: the fourth watch, the suunto test… I hope a new watch from suunto but not at the level of the suunto 9, maybe spartan line upgrade?

Leave a Reply to Tommy Cancel reply

Your email address will not be published. Required fields are marked *