Re: Norway

After a lot of work, it seems like we can finally update the polygon data for Norway. They have merged a lot of counties, also the regions will change.

The reason it has taken time is that the site used to use (https://wambachers-osm.website/boundaries/) doesn't exist anymore. An old version of his existed at GitHub as open source and our initial plan was to try to use that. But everything needed wasn't there and I realized that it was easier to just implement it from scratch than trying to provide his source with data in a correct format.

That's how https://osm-boundaries.com/ was born! It's still in development, but it has gotten far enough for us to be able to download data and import it into Project-GC.

The changes for Norway are huge though, so that's the next challenge (pun not intended). The difference was so huge that the old compare-new-vs-old-polygons tool wasn't even close to good enough, so I have patched that up a bit as well. Besides better formatting of the output it now matches more properly. I hope I didn't miss any case.

A real case is that county "Re" will be removed. That matches a lot of scripts saying "Region" for example. Now it only matches things that looks like strings, on other words, when the name is surrounded by quotes or double quotes.
print "Region" - won't match Re
regions = [ "Re", "Skodje" ] - will match Re

In the next post I will add data for everything that will change and everything that will be affected. The changes are not live yet.

My plan is this:
* Go through all potentially affected scripts. If they seem to be affected, I will disable them.
** Related Challenges will then be without a challenge checker.
** If they don't get a new one or the script is fixed, the Challenges risks getting archived.
* I will disable all potentially affected tags, without going through them.
** The idea is that we will go through them one by one. Fix them if needed, and then enable them one by one.
* After fixing the scripts and disabling tags we will add the new polygon data to Project-GC. This will then be done before fixing the tags themselves.

This is something I plan to start on at Thursday this week. If there are objections/suggestions I surely will listen to them. This leaves quite a lot of work regarding the Challenge checkers, but I can't figure a better way. If there are feedback saying we should postpone, we will postpone.

Regions only in Norway:
Akershus
Aust-Agder
Buskerud
Finnmark
Hedmark
Hordaland
Oppland
Sogn og Fjordane
Telemark
Troms
Vest-Agder
Vestfold
Østfold
Regions only in _tmp_Norway:
Agder
Innlandet
Troms og Finnmark
Vestfold og Telemark
Vestland
Viken

Counties only in Norway:
Agdenes
Askim
Audnedal
Balestrand
Ballangen
Berg
Bjugn
Bø (Telemark)
Eid
Eide
Eidsberg
Fet
Finnøy
Fjell
Flora
Forsand
Fosnes
Fræna
Fusa
Førde
Gaular
Granvin herad
Halsa
Haram
Hemne
Hobøl
Hornindal
Hurum
Jondal
Jølster
Klæbu
Kvalsund
Leikanger
Lenvik
Lindås
Mandal
Marnardal
Meland
Meldal
Midsund
Namdalseid
Naustdal
Nedre Eiker
Nes (Akershus)
Nes (Buskerud)
Nesset
Norddal
Nærøy
Odda
Oppegård
Orkdal
Os (Hedmark)
Os (Hordaland)
Porsángu
Radøy
Re
Rennesøy
Roan
Rygge
Rømskog
Røyken
Sande (Vestfold)
Sandøy
Sauherad
Selje
Skedsmo
Ski
Skodje
Skånland
Snillfjord
Songdalen
Spydeberg
Stordal
Sund
Svelvik
Søgne
Sørum
Torsken
Tranøy
Trøgstad
Tysfjord
Ullensvang herad
Verran
Vikna
Voss
Vågsøy
Våler (Hedmark)
Våler (Østfold)
Ørskog

Counties only in _tmp_Norway:
Alver
Bjørnafjorden
Fjord
Heim
Hustadvika
Indre Østfold
Kinn
Lillestrøm
Midt-Telemark
Nes (Viken)
Nesbyen
Nordre Follo
Nærøysund
Orkland
Os (Innlandet)
Porsáŋgu
Senja
Stad
Sunnfjord
Ullensvang
Voss herad
Våler (Innlandet)
Våler (Viken)

Potentially affected scripts (source code matches a region/county that has been added/removed):
scriptId:873 creator:kro8 scriptName:Alle cacher i en kommune i Hordaland matches:
[Hordaland]
scriptId:578 creator:Draupne scriptName:Generic number of finds in region matches:
[Østfold]
scriptId:1004 creator:bjoff scriptName:SognOgFjordane, using boundaries from 31.12.2019 matches:
[Balestrand]
[Eid]
[Flora]
[Førde]
[Gaular]
[Hornindal]
[Jølster]
[Leikanger]
[Naustdal]
[Selje]
[Vågsøy]
scriptId:494 creator:burncache scriptName:Roan65:815035 Chemistry Caching Challenge matches:
[Re]
scriptId:535 creator:lillfiluren scriptName:combinationschecker matches:
[Re]
scriptId:826 creator:vogelbird scriptName:GC code checker For the States ( I and L => 1) matches:
[Re]
scriptId:1463 creator:famv17 scriptName:GC 1-100 matches:
[Re]
scriptId:1495 creator:lingbeek scriptName:A periodic table matches:
[Re]
scriptId:2486 creator:arisoft scriptName:GC-code substrings matches:
[Re]
scriptId:2489 creator:vogelbird scriptName:GC code checker For the States ( I and L => 1) with Country and matches:
[Re]
scriptId:731 creator:Draupne scriptName:Generic number of finds in county matches:
[Ski]


I have been going through the list, the following two Challenges needs new Checkers (when the new data is available):
* GC5DE7Z
* GC5E54W



Edited 2 time(s). Last edit at 06/09/2020 12:59PM by magma1447. (view changes)

Script 873
https://project-gc.com/Tools/Challenges?edit&scriptId=873
Disabled
Needs a new checker that requires the Geocacher to have found all geocaches in a county within a list of counties. That list should be the counties that used to be in Hordaland.
Hordaland-counties:
* Askøy
* Austevoll
* Austrheim
* Bergen
* Bømlo
* Eidfjord
* Etne
* Fedje
* Fitjar
* Fjell
* Fusa
* Granvin herad
* Jondal
* Kvam herad
* Kvinnherad
* Lindås
* Masfjorden
* Meland
* Modalen
* Odda
* Os (Hordaland
* Osterøy
* Radøy
* Samnanger
* Stord
* Sund
* Sveio
* Tysnes
* Ullensvang herad
* Ulvik herad
* Vaksdal
* Voss
* Øygarden

Script 578
https://project-gc.com/Tools/Challenges?edit&scriptId=578
Left enabled
The script has a default setting for region which will become unusable.
The following tags rely on this default setting:
https://project-gc.com/Challenges/GC52WBF/1729
https://project-gc.com/Challenges/GC52WMN/1731
https://project-gc.com/Challenges/GC52WMZ/1732
The related challenges are archived so I will disable the checker tags.

Script 1004
https://project-gc.com/Tools/Challenges?edit&scriptId=1004
Left enabled
Using its own polygon data so won't be affected. It's likely that the related Challenge actually is against the Guidelines though. It would fall with user-defined polygons.

Script 494
https://project-gc.com/Tools/Challenges?edit&scriptId=494
Left enabled
Not using county "Re", it's chemistry elements.

Script 535
https://project-gc.com/Tools/Challenges?edit&scriptId=494
Left enabled
Not using county "Re", it's chemistry elements.

Scripts 826, 1463, 1495, 2486, 2489
Left enabled
Not using county "Re", it's chemistry elements.

Scripts 731
Left enabled
Defaults to county = 'Ski'
Affected tags:
https://project-gc.com/Challenges/GC6JZGH/21077
https://project-gc.com/Challenges/GC5E54W/5917
The first is unused, the second is used by an active challenge.
I will disable the second challenge and leave a comment.

Potentially affected tags (config matches a region/county that has been added/removed):
tagId:5140 creator:Target. gccode:GC51QTB matches:
[Akershus]
tagId:16983 creator:vogelbird gccode:GC5FD2Q matches:
[Akershus]
tagId:16984 creator:vogelbird gccode:GC5FYZD matches:
[Akershus]
tagId:17002 creator:vogelbird gccode:GC568Q7 matches:
[Akershus]
[Aust-Agder]
[Buskerud]
[Finnmark]
[Hedmark]
[Hordaland]
[Oppland]
[Sogn og Fjordane]
[Telemark]
[Troms]
[Vest-Agder]
[Vestfold]
[Østfold]
tagId:21167 creator:famv17 gccode:? matches:
[Akershus]
[Buskerud]
[Hedmark]
[Vestfold]
tagId:22932 creator:famv17 gccode:? matches:
[Akershus]
tagId:25119 creator:vogelbird gccode:GC719Z9 matches:
[Akershus]
tagId:25120 creator:vogelbird gccode:GC719Y9 matches:
[Akershus]
tagId:31256 creator:famv17 gccode:? matches:
[Akershus]
tagId:31257 creator:famv17 gccode:? matches:
[Akershus]
[Buskerud]
tagId:34429 creator:famv17 gccode:GC7H0H3 matches:
[Akershus]
[Buskerud]
tagId:41916 creator:GreyHams gccode:GC861NC matches:
[Akershus]
tagId:42089 creator:GreyHams gccode:GC868AA matches:
[Akershus]
tagId:43425 creator:tevjen gccode:GC5A26Q matches:
[Akershus]
[Aust-Agder]
[Buskerud]
[Finnmark]
[Hedmark]
[Hordaland]
[Oppland]
[Sogn og Fjordane]
[Telemark]
[Troms]
[Vest-Agder]
[Vestfold]
[Østfold]
tagId:46211 creator:vogelbird gccode:GC8FN5B matches:
[Akershus]
[Hedmark]
[Østfold]
tagId:2162 creator:Target. gccode:GC52NDR matches:
[Aust-Agder]
tagId:2324 creator:Target. gccode:GC52NDD matches:
[Aust-Agder]
tagId:13478 creator:LFCIKS gccode:GC51DE1 matches:
[Aust-Agder]
tagId:34754 creator:Magnus51 gccode:GC37ZR3 matches:
[Aust-Agder]
tagId:45819 creator:vogelbird gccode:GC8F1NQ matches:
[Aust-Agder]
tagId:45822 creator:vogelbird gccode:GC8F1P3 matches:
[Aust-Agder]
[Vest-Agder]
[Audnedal]
[Mandal]
[Marnardal]
[Songdalen]
[Søgne]
tagId:2165 creator:Target. gccode:GC4Q6CN matches:
[Buskerud]
tagId:2321 creator:Target. gccode:GC4Q6BQ matches:
[Buskerud]
tagId:5926 creator:Draupne gccode:GC5E615 matches:
[Buskerud]
tagId:11297 creator:TrulsHE gccode:GC59RBQ matches:
[Buskerud]
tagId:11305 creator:TrulsHE gccode:GC364W7 matches:
[Buskerud]
tagId:17005 creator:vogelbird gccode:GC4QC76 matches:
[Buskerud]
tagId:21873 creator:vogelbird gccode:GC6N632 matches:
[Finnmark]
[Troms]
[Ballangen]
[Tysfjord]
tagId:21907 creator:vogelbird gccode:GC6NEFV matches:
[Finnmark]
[Troms]
[Ballangen]
[Tysfjord]
tagId:24222 creator:vogelbird gccode:GC6Z3XY matches:
[Finnmark]
[Troms]
tagId:45126 creator:pieterix gccode:GC8DQPM matches:
[Finnmark]
[Troms]
tagId:45821 creator:vogelbird gccode:GC8F1MT matches:
[Finnmark]
[Kvalsund]
[Porsángu]
tagId:45827 creator:vogelbird gccode:GC8F1N0 matches:
[Finnmark]
[Troms]
[Berg]
[Kvalsund]
[Lenvik]
[Porsángu]
[Skånland]
[Torsken]
[Tranøy]
tagId:45918 creator:vogelbird gccode:GC8F70Y matches:
[Finnmark]
[Kvalsund]
[Porsángu]
tagId:45944 creator:vogelbird gccode:GC8F7YW matches:
[Finnmark]
tagId:46513 creator:vogelbird gccode:GC8G1WN matches:
[Finnmark]
[Kvalsund]
[Porsángu]
tagId:11164 creator:TrulsHE gccode:GC39B42 matches:
[Hedmark]
tagId:11310 creator:TrulsHE gccode:GC53XZT matches:
[Hedmark]
tagId:18397 creator:vogelbird gccode:GC3A7BC matches:
[Hedmark]
[Oppland]
tagId:18398 creator:vogelbird gccode:GC3A7MG matches:
[Hedmark]
[Oppland]
tagId:18399 creator:vogelbird gccode:GC3A7MN matches:
[Hedmark]
[Oppland]
tagId:24373 creator:TrulsHE gccode:GC39B42 matches:
[Hedmark]
tagId:44438 creator:pieterix gccode:GC8BTHQ matches:
[Hedmark]
tagId:11454 creator:TrulsHE gccode:GC3ADVY matches:
[Hordaland]
tagId:12001 creator:kro8 gccode:GC5DE7Z matches:
[Hordaland]
tagId:15972 creator:kro8 gccode:GCYY48 matches:
[Hordaland]
tagId:22826 creator:vogelbird gccode:GC3ADVY matches:
[Hordaland]
tagId:5141 creator:Target. gccode:GC51QTP matches:
[Oppland]
tagId:11171 creator:TrulsHE gccode:GC54FCK matches:
[Oppland]
tagId:24371 creator:TrulsHE gccode:GC54FCK matches:
[Oppland]
tagId:2164 creator:Target. gccode:GC5275K matches:
[Telemark]
tagId:2322 creator:Target. gccode:GC52755 matches:
[Telemark]
tagId:9452 creator:vogelbird gccode:GC2XGC7 matches:
[Telemark]
tagId:38958 creator:pieterix gccode:GC81FBW matches:
[Telemark]
tagId:38982 creator:pieterix gccode:GC81G8F matches:
[Telemark]
tagId:39012 creator:pieterix gccode:GC81HT0 matches:
[Telemark]
[Vestfold]
tagId:46520 creator:vogelbird gccode:GC8G1Y6 matches:
[Telemark]
[Vestfold]
[Bø (Telemark)]
[Re]
[Sande (Vestfold)]
[Sauherad]
[Svelvik]
tagId:2159 creator:Target. gccode:GC542Y8 matches:
[Troms]
tagId:2160 creator:Target. gccode:GC542ZV matches:
[Troms]
tagId:2830 creator:Target. gccode:GC57EJM matches:
[Troms]
tagId:9447 creator:vogelbird gccode:GC4RM05 matches:
[Troms]
tagId:16608 creator:vogelbird gccode:GC4CJPJ matches:
[Troms]
tagId:22294 creator:vogelbird gccode:GC6QGXF matches:
[Troms]
tagId:23115 creator:vogelbird gccode:GC6VTWM matches:
[Troms]
tagId:23151 creator:vogelbird gccode:GC6VVW9 matches:
[Troms]
tagId:36758 creator:pieterix gccode:GC7WBE1 matches:
[Troms]
tagId:37405 creator:arisoft gccode:GC7Y361 matches:
[Troms]
tagId:45815 creator:vogelbird gccode:GC8F1KR matches:
[Troms]
[Berg]
[Lenvik]
[Skånland]
[Torsken]
[Tranøy]
tagId:8399 creator:Solkongen gccode:? matches:
[Vest-Agder]
tagId:9421 creator:vogelbird gccode:GC4REET matches:
[Vest-Agder]
tagId:9422 creator:vogelbird gccode:GC4REEV matches:
[Vest-Agder]
tagId:34755 creator:Magnus51 gccode:GC3FFEZ matches:
[Vest-Agder]
tagId:45818 creator:vogelbird gccode:GC8F1NX matches:
[Vest-Agder]
[Audnedal]
[Mandal]
[Marnardal]
[Songdalen]
[Søgne]
tagId:2163 creator:Target. gccode:GC52HGM matches:
[Vestfold]
tagId:2323 creator:Target. gccode:GC52HGJ matches:
[Vestfold]
tagId:5921 creator:Draupne gccode:GC3X9DD matches:
[Vestfold]
tagId:9389 creator:vogelbird gccode:GC37NA2 matches:
[Vestfold]
tagId:11273 creator:okbangas gccode:GC5ND9Z matches:
[Vestfold]
tagId:21941 creator:Draupne gccode:GC6N7BQ matches:
[Vestfold]
tagId:21942 creator:Draupne gccode:GC6NJAA matches:
[Vestfold]
tagId:21943 creator:Draupne gccode:GC6NJAK matches:
[Vestfold]
tagId:29101 creator:pieterix gccode:GC7D4QH matches:
[Vestfold]
tagId:29102 creator:pieterix gccode:GC7D4QT matches:
[Vestfold]
tagId:29103 creator:pieterix gccode:GC7D4R1 matches:
[Vestfold]
tagId:17045 creator:vogelbird gccode:GC4H6XF matches:
[Østfold]
tagId:21198 creator:famv17 gccode:GC6HVF6 matches:
[Østfold]
tagId:21201 creator:famv17 gccode:? matches:
[Østfold]
tagId:5117 creator:Target. gccode:GC3KDG5 matches:
[Askim]
[Eidsberg]
[Hobøl]
[Rygge]
[Rømskog]
[Spydeberg]
[Trøgstad]
tagId:16870 creator:vogelbird gccode:GC34KE6 matches:
[Berg]
tagId:46974 creator:vogelbird gccode:GC8GJQQ matches:
[Berg]
tagId:51975 creator:vogelbird gccode:GC8TK6Q matches:
[Berg]
tagId:5133 creator:Target. gccode:GC4RN8P matches:
[Fet]
[Oppegård]
[Skedsmo]
[Ski]
[Sørum]
tagId:39686 creator:TerraViators gccode:GC4HX9P matches:
[Flora]
tagId:15640 creator:thomfre gccode:GC5GBQX matches:
[Haram]
[Norddal]
[Skodje]
[Stordal]
[Ørskog]
tagId:15641 creator:A_Hesselberg gccode:GC5GBQX matches:
[Haram]
[Norddal]
[Skodje]
[Stordal]
[Ørskog]
tagId:42486 creator:pieterix gccode:GC86G16 matches:
[Haram]
[Norddal]
[Stordal]
tagId:21169 creator:famv17 gccode:? matches:
[Hobøl]
[Rygge]
tagId:21170 creator:famv17 gccode:? matches:
[Hobøl]
[Rygge]
tagId:38895 creator:vogelbird gccode:GC8163Q matches:
[Klæbu]
tagId:29486 creator:vogelbird gccode:GC7DTPC matches:
[Nedre Eiker]
tagId:51177 creator:famv17 gccode:? matches:
[Nes (Akershus)]
[Skedsmo]
tagId:51195 creator:famv17 gccode:GC8QQ42 matches:
[Nes (Akershus)]
[Skedsmo]
tagId:47310 creator:vogelbird gccode:GC8GY1Z matches:
[Norddal]
tagId:4962 creator:vogelbird gccode:GC5AVAM matches:
[Re]
tagId:9544 creator:vogelbird gccode:GC2Q97A matches:
[Re]
tagId:11780 creator:bat62 gccode:GC4PM41 matches:
[Re]
tagId:15112 creator:vogelbird gccode:GC4DD32 matches:
[Re]
tagId:15114 creator:vogelbird gccode:GC4E9J6 matches:
[Re]
tagId:18354 creator:vogelbird gccode:GC4ZWG7 matches:
[Re]
tagId:33891 creator:arisoft gccode:? matches:
[Re]
tagId:40826 creator:MaaBo gccode:GC7YVXG matches:
[Re]
tagId:27130 creator:famv17 gccode:GC6VV37 matches:
[Rygge]
tagId:27131 creator:famv17 gccode:? matches:
[Rygge]
tagId:13018 creator:TravelingGeek gccode:GC4FXAY matches:
[Ski]
tagId:13021 creator:TravelingGeek gccode:GC4FXAY matches:
[Ski]
tagId:22456 creator:Summer Sky Dawg gccode:GC6QYW7 matches:
[Ski]
tagId:42710 creator:TerraViators gccode:GC44VRV matches:
[Ski]
tagId:40528 creator:vogelbird gccode:GC7Z1Q1 matches:
[Stordal]
tagId:36471 creator:pieterix gccode:GC7RR1D matches:
[Sund]
tagId:39484 creator:vogelbird gccode:GC80RBP matches:
[Sund]
tagId:4608 creator:vpdj gccode:GC3W3JQ matches:
[Fjord]
tagId:18246 creator:TrulsHE gccode:GC4K0EB matches:
[Kinn]
tagId:18247 creator:TrulsHE gccode:GC4K0EB matches:
[Kinn]

I have asked HQ regarding Challenges that uses the old definitions. As I see it we have two options:
1) Force-archive Challenges using counties that doesn't exist anymore.
2) Create new Challenge checker using user-defined polygons.

User-defined polygons aren't allowed for new Challenges. But as I see it, this is a different case. The Challenges already exists.

We'll see how fast HQ answers. Regardless I think we should work on at least disabling Checkers that won't work. Meanwhile those affected Challenges will be without challenge checkers, and we will then see what their destiny will become.

Script 1004 looks like the same situation - it was placed in 2017 and uses the geographical data from that time. And could currently be done using county/region data, but once the data is updated it would break. I think the CO organised the new checker on the assumption that PGC would update region/county data quicker than this.

That's actually quite good in my opinion. That's how I expect most of these Challenges will be solved. I haven't heard from HQ yet though. I expect that to take at least a week. Therefore I think that script developer had a smart approach on things. The question is if it should have been allowed by the reviewer though, but that's a bit off topic here, not really our concern.

Project-GC would have updated much sooner, at least already in February, if the site we used didn't stop updating its data back in January.

I have an update from HQ.

Challenges affected by this are considered "old" and were allowed when they got published. Therefore they have decided that they are allowed to keep using the old polygon data, just as their cache descriptions says.

So, for those where it's possible, we can convert the checkers into using a polygon script, if we have the polygon data. I still have Project-GC's source files for the polygons, I don't know how compatible they are yet though. I will look into that.

I know there was a challenge/script that already used its own custom polygons. If I recall correctly that was for regions, and that data should be usable for more then.