Login
Support Sailonline
If you haven't already  join the SAILONLINE YACHT CLUB!
Please also consider making a donation  all amounts are greatly appreciated!
Board
»
General Discussion
»
Weather  Brain Storm
Please login to post a reply.
Posted by bonknhoot 

Recent chat in the M2O 2020 about the weather that we import into SOL has prompted this new thread, hoping that concerns and ideas may gravitate towards some sort of consensus or conclusion. Whether anything can be done with such a conclusion is another matter.
Remember: SOL is a 'cooperative' and everything that happens is done by volunteers. Any change in the fetching of weather is likely to require changes to the software (the racing engine) that runs on the server. This is no sinecure, and the volunteer resources that we have that can attempt this are scarce. I'll get the ball rolling with a separate post about the status quo. Clipping along 

Posted by bonknhoot 

Currently, we have the capability to fetch three sources for weather with the following 'tags'  global_gfs, nam_awip12 and wrfems, updating every six hours.
global_gfs is what we use most often and it is roughandready. I'm not hugely familiar with meteorologist terminology but I think it is what is called 'synoptic', which I think means it is primarily based on surface pressure variation; in other words, there is no modelling of local coastal effects. The highest resolution we can fetch is 0.5 x 0.5 degrees, in other words the data  that is then interpolated by the server (or a router)  is given at nodes set 0.5 degrees of longitude and latitude apart. 0.25 degree resolution is in fact available, but we can't fetch it. With 0.25 resolution the amount of data describing the wind over space and time increases by a factor 4, and obviously routing or SOPing through this becomes commensurately trickier. I'll write a second note later. Clipping along 

Posted by Zorba777 

Thanks for setting up this brainstorm, Jan. My concern is: what happens if GFS (or other WX sources we use) start updating every 3 or 4 hours? I have the impression that even with the every 6 hour updates it is already difficult for some people to combine SOL with their professional or family life (as well as sleep). So, maybe we can discuss that in one go.
But in keeping with my first question I want to submit this article which takes a good look at where weather forecasts could be going in the coming years. Some techniques seem to pave the way for accurate forecasts that are 8 times longer than we now have: https://metro.co.uk/2019/09/18/willweatherforecastever100correct10751641/ 

Posted by bonknhoot 

That is a very interesting article, Dan, but I suppose it all depends on what NOAA consider 'accurate' or 'correct', when it is quoted to state 'a sevenday forecast is accurate around 80% of the time' or 'a fiveday forecast is correct approximately 90% of the time'. One can imagine that the assertion is correct about something like 'it will rain in The Peloponnese tomorrow', but, as we know from experience, it doesn't imply that the wind strength and direction forecast for 120 hours ahead at a specific lat/lon posn will be reforecast as exactly the same 6 hours on, now 114 hours ahead.
I would like to think that that sort of accuracy will remain impossible for very many years yet. So, that aspect of our game  forecast volatility and secondguessing the met service  is not much at risk, IMO. I do agree with you that once gribbed freeissue forecasts become available with a frequency of every 3 hours, it would reduce the attractiveness of our game if the game were to fetch these every 3 hours as well. I see little reason (though not none) for simply keeping our own fetch frequency at 6 hourly; especially if 'accuracy' has improved anyway. Indeed, I would suggest it could mean an opportunity to reduce our fetch frequency to every 9 hours, which would give everyone around the world a midnight WX every couple of days. Clipping along 

Posted by bonknhoot 

My agenda is not so much a concern with ever more and better forecasts, but a concern with the roughandready nature of global_gfs, our standard 'go to' weather. The question and the challenge I want to raise is 'Can we do better?'.
For the long distance ocean races, this question is not so important, as, out in the middle of the ocean, modulation for whatever should change little to a forecast, and because guessing what is the best thing to do given the uncertainty about what the wind will really be a week ahead will continue to be a challenge for SOLers. It is the races of say 3 to 4 days maximum that I feel/find are or have become somewhat mathematically deterministic. You have to have the tools to do the math, but once you have such tools working for you, a race becomes primarily a "do" exercise. Clipping along 

Posted by ij 

I'm sorry to spoil the party but I'd prefer to always sail on WRF weather. Obviously that's not "feasible" in the most straightforward manner for races over large areas. However, if it would be possible to limit calculating the wrf forecast only to areas where there are boats, where the boats can reach, and only calculate very shortterm wrf, like 12h15h (mostly to cover across a single wx update failure), it could bring down the amount of processing power needed for the forecasting.
So we'd be having sort of composite wx with a base layer of 0.25x0.25 gfs to visualize longer term forecast and act as a backup wx. Which parts of the base layer would be selectively replaced by wrf would be dynamically determined as the race progresses. Whether we have computation capability to do that (or would be able to get the necessary processing capacity) I have know idea but I certainly would want to know how big area would need to be calculated. Even in ocean races boats tend to keep in packs (although wrf itself might impact the dynamics that typically lead to it with gfs). The biggest problem in this approch IMHO is the long tail of boats because they'd require disproportionate amount of the all processing. If that turns out still infeasible, some additional filter could be applied which allows using wrf only under conditions where wx seems unstable (based on the corner wind components it's possible to estimate this I think) or when there's landmass. It's very complex to realize technically though, we cannot even run the 0.25x0.25 gfs part of that currently so it may remain wishful thinking.  i. 

Posted by ij 

I agree with bonk that 80% reliability is really a joke. Even 90% is not really something I'd boast about. It's worth to remember the error starts to rapidly accumulate. It's unlikely to be dropping linearly but more like larger error also leads to much larger error accumulation (and thus uncertainty).
I've never seen the definitions of that kind of % metric anyway (so if somebody has pointers to some scientific papers evaluating forecast longterm accuracy, please, I might read myself). But I wouldn't be surprised if it turns out quite bogus or irrelevant to measure what kind of accuracy we're talking here.  i. 

Posted by ij 

Comparing 0.25x0.25 wx grid with 1x1 (I forgot to make the arrow density the same so please disregard that difference):
https://postimg.cc/F19n3Yjp  i.  Last Edited by ij at 20200907 22:18:39  

Posted by ij 

Just a minor note from some ECMWF validation report now that I came across one: in 10m wind at 5 days the frequency of large errors is around 4% (+/1 due to year cycle) now so it's in ballpark with those 90/80% numbers. (And in temps slightly worse.)
GFS is likely somewhat worse than that given ECMWF is generally considered slightly better although both can be shown to be better in selected cases. What is means to routing accuracy is hard to know without looking deeper into the report (if it's told at all). The distribution of the large errors over time matters too much. But if distribution would be uniform (it very likely isn't), one would very likely hit one large deviation in almost every 2 weeks long race. And how bad the large error % gets when consider beyond 5 days, no idea.  i.  Last Edited by ij at 20200909 21:01:19  

Posted by Zorba777 

Hi Bonk and Ij,
I don't know how accurate the weather models will become. Even the experts don't agree on that question. We can probably just agree that they keep getting better and look at possible consequences for SOL simulations. I agree with Jan on the possible problem that shorter races are moving closer to "fixed solution". If there is only 1 (or even no) WX change during a race we are on a fixed weather map where good math tools can figure the winning route and then it just becomes a question of who executes that route more optimally. But some SOLers like that kind of challenge, so I wouldn't take that away. If long term weather forecasts get more accurate then even the medium term (34 day) races would become more like sprint races where execution of near optimal route is more important than anticipation of weather changes. In the long ocean races it will not be anytime soon that weather models can give us a near optimal route for more than 2 or 3 days. But if WX updates become more frequent then we would have to think about SOLers' sleep. We can decide to skip some updates and only update the maps that SOL uses every 6 or 8 hours. But even in that case some players would gain an advantage by looking at the GFS updates we skip, because they will already show in what direction the weather is changing. Perhaps it would be more useful to change to a more detailed, but less frequently changing, source of weather data as ij suggests...  Last Edited by Zorba777 at 20200910 08:47:58  
Races
Next Race: 00d 00h 00m
Current Races:
Carib Rum Run 2024
Race #1836
INFO by brainaid.de
Clipper 240 PARTICULARS
WX Updates:
0430 / 1030 / 1630 / 2230
Ranking: SYC
Race starts: Sep 09th 17:00 Registration Open!
GO TO RACE
SSANZ Triple Series 2024  Race 3
Welcome to the third and final race of this year's SSANZ Triple Series on the waters off Auckland, New Zealand. This is the Lewmar 50, about 39nm along the southern shore Waiheke Island out to Tarahiki island and back for a finish in Islington Bay, and as ever we will be sailng Young 88s, against the IRL members of the Young 88 Association!
Race #1827
INFO by brainaid.de
Young 88 PARTICULARS
WX Updates:
0430 / 1030 / 1630 / 2230
Ranking: SSANZ  SYC
RACE CLOSE: Friday,
September 13 at 2300 UTC.
Race starts: Sep 06th 21:15 Registration Open!
GO TO RACE
Flight of the Godwit  Anchorage to Wellington 2024
Welcome to the return flight of our bartailed Godwit! This race is the third and concluding leg, reflecting the bird's annual migratory route, and simultaneously the ninth leg of the 2024 Ocean Race Championship. The voyage promises to be not only a test of skill and strategy but an immersive experience in the beauty of the vast Central Pacific Ocean. Join us as we push the boundaries of seafaring prowess on this epic adventure.
Let's fly like a Godwit!
PRIZE: SMPF
Race #1832
INFOby brainaid.de
Maxi Trimaran PARTICULARS
WX Updates:
0430 / 1030 / 1630 / 2230
Ranking: GWT  OCQ3  OCCH  SUPSOL  SYC
Race starts: Sep 02nd 11:00 Registration Open!
GO TO RACE
Round Greenland 2024
Race #1780
INFOby brainaid.de
Paratii 2 PARTICULARS
WX Updates:
0430 / 1030 / 1630 / 2230
Ranking: HLAT  SYC
Race starts: Aug 29th 19:00 Registration Open!
GO TO RACE
San Francisco to Ushuaia 2024
After a superlong RTWleg3 (27 days), we have had a month to recover, and maintain our boat, in order to continue our around the world race. Leg 4, even longer than the previous, takes us from California to the world's southernmost city Ushuaia. No waypoints, even "the Ditch" is an option, but maybe a bit too much of a treat. With 6300 nm to go, the estimated duration of this race 29 days. This course is also the August edition of our ocean race championship.
PRIZE: SMPF
Race# 1717
INFO from brainaid.de
Swan 65 PARTICULARS
WX updates:
0430 / 1030 / 1630 / 2230
Ranking: OCQ3  OCCH  RTW  SUPSOL  SYC
RACE CLOSE: Thursday,
September 12 at 2300 UTC.
Race starts: Aug 05th 11:00 Registration Closed
GO TO RACE
SYC Ranking
Series
 SYC ranking
 2024 TS
 2024 TRQ4
 2024 TRQ3
 2024 TRQ2
 2024 TRQ1
 2024 TRCH
 2024 TD
 2024 SVF
 2024 SUPerSOLer
 2024 SSANZ
 2024 SPRQ4
 2024 SPRQ3
 2024 SPRQ2
 2024 SPRQ1
 2024 SPRCH
 2024 SHE
 2024 RTW
 2024 RMS
 2024 PIC
 2024 OCQ4
 2024 OCQ3
 2024 OCQ2
 2024 OCQ1
 2024 OCCH
 2024 LOOR
 2024 HILAT
 2024 GWT
 2024 DN
 2024 CRW
 2024 B2B
 2024 ARQ4
 2024 ARQ3
 2024 ARQ2
 2024 ARQ1
 2024 ARCH
 2023 TS
 2023 TRQ4
 2023 TRQ3
 2023 TRQ2
 2023 TRQ1
 2023 TRCH
 2023 TD
 2023 SVS
 2023 SUPerSOLer
 2023 SSANZ
 2023 SPRQ4
 2023 SPRQ3
 2023 SPRQ2
 2023 SPRQ1
 2023 SPRCH
 2023 SHE
 2023 RTW
 2023 RNI
 2023 RMS
 2023 PIC
 2023 OCQ4
 2023 OCQ3
 2023 OCQ2
 2023 OCQ1
 2023 OCCH
 2023 LOOR
 2023 DN
 2023 ARQ4
 2023 ARQ3
 2023 ARQ2
 2023 ARQ1
 2023 ARCH
 2022 TRQ4
 2022 TRQ3
 2022 TRQ2
 2022 TRQ1
 2022 TRCH
 2022 TD
 2022 Tall Ships
 2022 SUPerSOLer
 2022 SSANZ
 2022 SSA
 2022 SPRQ4
 2022 SPRQ3
 2022 SPRQ2
 2022 SPRQ1
 2022 SPRCH
 2022 SHE
 2022 OCQ4
 2022 OCQ3
 2022 OCQ2
 2022 OCQ1
 2022 OCCH
 2022 NTR
 2022 LOOR
 2022 CTR
 2022 ARQ4
 2022 ARQ3
 2022 ARQ2
 2022 ARQ1
 2022 ARCH
 2021 TRQ4
 2021 TRQ3
 2021 TRQ2
 2021 TRQ1
 2021 TRCH
 2021 TD
 2021 Tall Ships
 2021 SYCQ4
 2021 SYCQ3
 2021 SYCQ2
 2021 SYCQ1
 2021 SYCCH
 2021 SUPerSOLer
 2021 SSANZ
 2021 SPRQ4
 2021 SPRQ3
 2021 SPRQ2
 2021 SPRQ1
 2021 SPRCH
 2021 Shetland
 2021 PAC6
 2021 OCQ4
 2021 OCQ3
 2021 OCQ2
 2021 OCQ1
 2021 OCCH
 2021 ESRW
 2020 TSE
 2020 TSA
 2020 TRQ4
 2020 TRQ4
 2020 TRQ3
 2020 TRQ2
 2020 TRQ1
 2020 TRCH
 2020 Tasman Double
 2020 SYCQ4
 2020 SYCQ3
 2020 SYCQ2
 2020 SYCQ1
 2020 SYCCH
 2020 SUPerSOLer
 2020 SSANZ
 2020 SRQ4
 2020 SRQ3
 2020 SRQ2
 2020 SRQ1
 2020 SPRCH
 2020 Shetland
 2020 RTW
 2020 RNI
 2020 Odyssey
 2020 OCQ4
 2020 OCQ3
 2020 OCQ2
 2020 OCQ1
 2020 OCCH
 2020 A3
 2019 TRQ4
 2019 TRQ3
 2019 TRQ2
 2019 TRQ1
 2019 TRCH
 2019 Tasman Double
 2019 Tall Ships
 2019 SYCQ4
 2019 SYCQ3
 2019 SYCQ2
 2019 SYCQ1
 2019 SYCCH
 2019 SUPerSOLer
 2019 SSANZ
 2019 SRQ4
 2019 SRQ3
 2019 SRQ2
 2019 SRQ1
 2019 SPRCH
 2019 Shetland
 2019 Round New Zealand
 2019 OCQ4
 2019 OCQ3
 2019 OCQ2
 2019 OCQ1
 2019 OCCH
 2018 TRQ4
 2018 TRQ3
 2018 TRQ2
 2018 TRQ1
 2018 TRCH
 2018 Tasman Double
 2018 Tall Ships
 2018 SUPSOL
 2018 SSANZ Triple
 2018 SRQ4
 2018 SRQ3
 2018 SRQ2
 2018 SRQ1
 2018 SPRCH
 2018 Shetland
 2018 Shackleton Challenge
 2018 OCQ4
 2018 OCQ3
 2018 OCQ2
 2018 OCQ1
 2018 OCCH
 2018 40CH
 2017 TS RDV
 2017 TRQ4
 2017 TRQ3
 2017 TRQ2
 2017 TRQ1
 2017 TRCH
 2017 Tasman Double
 2017 Tall Ships
 2017 SWR
 2017 SUPSOL
 2017 SSANZ Triple
 2017 SSANZ RNI
 2017 SPRR3
 2017 SPRR2
 2017 SPRR1
 2017 SPRCH
 2017 Red Dot
 2017 OCQ4
 2017 OCQ3
 2017 OCQ2
 2017 OCQ1
 2017 OCCH
 2017 40CQ3&4
 2017 40CQ1&2
 2016 TRQ4
 2016 TRQ3
 2016 TRQ2
 2016 TRQ1
 2016 TRCH
 2016 Tasman Double
 2016 Tall Ships
 2016 SUPSOL
 2016 SSANZ Triple
 2016 SRQ4
 2016 SRQ3
 2016 SRQ2
 2016 SRQ1
 2016 SPRCH
 2016 RTWR
 2016 OCQ4
 2016 OCQ3
 2016 OCQ2
 2016 OCQ1
 2016 OCCH
 2016 Corporate Open Gold
 2016 A3
 2015 TRQ4
 2015 TRQ3
 2015 TRQ2
 2015 TRQ1
 2015 TRCH
 2015 Tasman Double
 2015 Tall Ships
 2015 SYQ4
 2015 SYQ3
 2015 SYQ2
 2015 SYQ1
 2015 SYCCH
 2015 SUPSOL
 2015 SSANZ Triple
 2015 SRQ4
 2015 SRQ3
 2015 SRQ2
 2015 SRQ1
 2015 SPRCH
 2015 OCQ4
 2015 OCQ3
 2015 OCQ2
 2015 OCQ1
 2015 OCCH
 2015 Aegean Rally
 2014 Timed Races Championship
 2014 Tasman Double
 2014 Tall Ships
 2014 SYC Championship
 2014 SSANZ Trio
 2014 SSANZ RNI
 2014 Sprints Championship
 2014 Scandinavian Tour
 2014 Round The World Race
 2014 Ocean Championship
 20142015 Sailonline World Race
 2013 Tall Ships
 2013 SYC Championship
 2013 SSANZ B&G Simrad
 2013 Capt Anderson
 2012 W Australia Regatta
 2012 Tall Ships
 2012 SSANZ B&G Simrad
 2012 RNZ Two Handed
 2012 Global Challenge
 2012 Ecker Cup
 2012 Black Sea
 2012 A3
 2011 Vancouver Island
 2011 Tasman Double
 2011 SSANZ B&G Simrad
 2011 SOL Global Challenge
 2011 SJORA Series
 2011 Scandinavian Tour
 2011 Round North Island
 2011 Asian Sprints
 20112012 SOL World Race
 2010 Tasman Double
 2010 Ouzo Rally
 2010 Iberian Tour
 2010 Auckland Regional
 2009 French SOLo
 2009 Bosphore  Bretagne
 2008 SYCC
 2008 2013 SYC Week Race Championship
 2008 2013 SYC WeekEnd Race Championship
 2008 2013 SYC Ocean Race Championship
 20082009 Sailonline Ocean Race
 2004 LOOR
Mobile Client
SYC members have the benefit of access to our mobile/lightweight web client!