KataGo Distributed Training

About This Run

KataGo is a strong open-source self-play-trained Go engine, with many improvements to accelerate learning (arXiv paper and further techniques since). It can predict score and territory, play handicap games reasonably, and handle many board sizes and rules all with the same neural net.

This site hosts KataGo's first public-distributed training run! With the help of volunteers, we are attempting to resume training from the end of KataGo's previous official run ("g170") that ended in June 2020, and see how much further we can go. If would like to contribute, see below!

Updates

  • 2025-06-04 - Version v1.16.2 is released! Compared to v1.16.0, this version has better numeric scaling that should reduce the chance for KataGo's nets to produce nonfinite values during contribute and produce biased data, or crash with large boards or extreme komis. If you are contributing with v1.16.0, please upgrade to v1.16.2 if you can!
  • 2025-05-16 - Disabled support for contributing using versions prior to v1.16.0, so that we can be uniformly updated to the newest data format. Get the new version here!

  • 2025-05-09 - Over the last few weeks, a number of additional fun and interesting networks have been added to the extra networks page from various developers/contributors, including a strong large-board network ideal for use with the "+bs50" executables in KataGo's v1.16.0 release supporting board sizes up to 50x50. Enjoy!

  • 2025-04-22 - Added a new page to the site with some special extra networks not part of the main run!

  • 2025-04-10 - KataGo v1.16.0 is released! Among other things, this version records new training data that could be used for training experimental action-value heads, enabling cool future research and potential search improvements. If no major bugs or other issues are discovered with this release in the next few days, then we will want to have all contributors upgrade so that the official run can begin accumulating this data over the next months for research.

  • 2024-05-02 - First "b28" neural net uploaded! This new larger neural net runs more slowly, similar to the old 60-block nets, but should be much stronger. From tests on discord, under normal usage this series of nets should be stronger than the b18 nets given equal total time, despite the slower speed, and be by far the strongest nets so far on a per-visit basis. We've also upgraded contributing to require KataGo v1.14.0 or later to support this net.

  • 2023-12-28 - KataGo v1.14.0 is released! This version adds support for a new larger and hopefully stronger "b28" neural net that will likely be ready within the next months. It also has a large number of more minor bugfixes and changes.

  • 2023-06-13 - We are upgraded now - kata1-b18c384nbt-s6582M is the first 18-nested-block neural net with the new improved output heads! You will need to be on version v1.13.0 or later to use the nets from here onward.

  • 2023-05-23 - KataGo v1.13.0 is released! Supports a new version of neural nets with improved output heads for policy and error prediction and various other analysis and search and training improvements. Once most or all contributors upgrade, we will be able to switch to the improved nets. If you're an active contributor please upgrade when you can!

  • 2023-03-04 - We're fully switched to v1.12 now and the first new net of the new architecture, b18c384nbt, has been uploaded for testing! Note the learning rate has been kept far higher than every other network, so it might not be as strong yet as the "uec" version of the new net on the releases page.

  • 2023-02-18 - KataGo is now up to version v1.12.4, with some bugfixes for training data generation! Once enough users are upgraded to this version and particularly off of v1.11, we can try the new improved b18 net and architecture for rating games and data generation. Please upgrade if you can!

  • 2023-01-07 - New release of KataGo, v1.12.0, supporting a new neural net architecture! The new net, b18-uec is about as strong as the 60-block nets but should be faster to run.

  • 2022-05-16 - Disabling support for versions older than v1.11.0 in selfplay data contribution so that we can make full use of new graph search parameters for search during selfplay.

  • 2022-03-20 - KataGo v1.11.0 is released! New graph search algorithm instead of tree search, and various parameter improvements.

  • 2022-01-27 - Switching to 60-block net for selfplay data contribution! 40-block net will continue to be trained as well on the data and be rated as well.

Downloading KataGo

If you simply want to run KataGo, the latest releases are here and you can download the latest networks from here. You very likely want a GUI as well, because the engine alone is command-line-only. Some possible GUIs include KaTrain, LizzieYzy, Lizzie, and q5Go, more can be found searching online.

How to Contribute

Contributors are much appreciated! If you'd like to contribute your spare GPU cycles to generate training data for the run, the steps are:

First, create an account on this site, picking a username and secure password. Make sure to verify your email so that the site considers your account fully active. Note: the username you pick will be publicly visible in statistics and on the games you contribute.

Then pick one of the following methods.

Likely easiest method, for a home desktop computer:

  • Download and install KaTrain
  • Inside the GUI menu, select the option for distributed training, provide the username and password for the account you created, and choose a few settings, then just let it run!

Command line method: if running on a remote server, or have already set up KataGo for other things, or if you want a command line that will work in the background without any GUI, or want slightly more flexibility to configure things:

  • Download KataGo from the latest release.
  • Edit the contribute_example.cfg that came when you downloaded KataGo, use a text editor to fill in your username, password, and the few different settings you want.
  • Run it on the command line like: ./katago contribute -config contribute_example.cfg on Linux, or katago.exe contribute -config contribute_example.cfg on Windows. If it is working, it should print out various stats as it runs, including when it finishes and uploads a game.

Either way, once some games are finished, you can view the results at https://katagotraining.org/contributions/ - scroll down and find your username! If anything looks unusual or buggy about the games, or KataGo is behaving weirdly on your machine, please let us know, so we can avoid uploading and training on bad data. Or, if you encounter any error messages, feel free to ask for help on KataGo's GitHub or the Discord chat.

For advanced users, instead of downloading a release, you can also build it from source. If you do so, use the stable branch, NOT the master branch. The example config can be found in cpp/configs/contribute_example.cfg

And if you're interested contribute to development via coding, or have a cool idea for a tool, check out either KataGo's GitHub or the this website's GitHub, and/or the Discord chat where various devs hang out. If you want to test a change that affects the distributed client and you need a test server to experiment with modified versions of KataGo, it is available at test.katagodistributed.org, contact lightvector or tychota in Discord for a testing account.

Stats for kata1

This run is named kata1 and began on 2020-11-28 20:23:43 UTC.

Data Generation

Across all time, 1362 distinct users have uploaded 4,499,217,586 rows of training data, 90,928,819 training games, and 1,929,152 rating games.

In the last week, 56 distinct users have uploaded 17,576,084 rows of training data, 376,957 new training games, and 14,415 new rating games.

In the last 24h, 39 distinct users have uploaded 3,225,487 rows of training data, 69,018 new training games, and 2,277 new rating games.

Look up and view games for this run here.

Networks

A total of 930 networks have been uploaded for kata1.

Latest network: kata1-b28c512nbt-s12464049920-d5727206990

Strongest confidently-rated network: kata1-b28c512nbt-s12464049920-d5727206990

Approximate Elo Ratings Graph
Graph is based on about 1,929,152 rating games using mid to high hundreds of playouts. Ratings might still be mildly inflated due to only playing other KataGo nets, but otherwise are fresh and unbiased and involve a variety of nets to avoid rock-paper-scissors. Vertical bars indicate approximately a 95% confidence interval.

Graph is based on games at equal visits rather than equal compute time, since the former is easier to control on widely varying user hardware. Larger/slower networks will be advantaged due to getting more total compute time. Given particular hardware, one can approximately correct for this by benchmarking to measure the speed difference, each doubling of speed may be worth somewhere around 150-250 Elo.

Click and drag to zoom. Double-click or click on a button to reset zoom.

Approx Elo given equal time rather than equal visits (might NOT be accurate, varies with hardware)

Top Contributors

See here for a full list of contributors for kata1.

In the Last 24h

User Training Rows Training Games Rating Games
yaoge123 1,659,144 rows generated 35,330 training games 439 rating games
congxinzhisong 232,733 rows generated 4,991 training games 0 rating games
kibic777 223,235 rows generated 4,767 training games 0 rating games
Friday9i 175,271 rows generated 3,759 training games 47 rating games
Legno 140,901 rows generated 3,014 training games 53 rating games
Bubblesld 120,497 rows generated 2,627 training games 36 rating games
hansi 102,224 rows generated 2,185 training games 743 rating games
Schelp76 63,766 rows generated 1,371 training games 25 rating games
xinjing 55,721 rows generated 1,183 training games 12 rating games
Arcannite 47,320 rows generated 1,017 training games 16 rating games
carton 46,841 rows generated 1,032 training games 32 rating games
zhanghong64 44,083 rows generated 967 training games 0 rating games
家疼跑谱 39,861 rows generated 869 training games 12 rating games
ez4u 31,904 rows generated 673 training games 10 rating games
maxueba 29,369 rows generated 624 training games 0 rating games

In the Last Week

User Training Rows Training Games Rating Games
yaoge123 7,416,636 rows generated 158,967 training games 2,219 rating games
kibic777 1,478,862 rows generated 31,555 training games 0 rating games
hansi 1,338,004 rows generated 28,553 training games 5,021 rating games
congxinzhisong 1,292,978 rows generated 27,711 training games 0 rating games
Bubblesld 858,900 rows generated 18,410 training games 272 rating games
Legno 744,395 rows generated 15,988 training games 220 rating games
Friday9i 687,882 rows generated 14,686 training games 177 rating games
xinjing 524,742 rows generated 11,339 training games 72 rating games
Arcannite 321,609 rows generated 6,930 training games 124 rating games
maxueba 273,606 rows generated 5,955 training games 92 rating games
家疼跑谱 272,827 rows generated 5,888 training games 100 rating games
TheOnly92 268,399 rows generated 5,732 training games 76 rating games
zhanghong64 211,844 rows generated 4,560 training games 0 rating games
ez4u 208,319 rows generated 4,461 training games 86 rating games
egri-nagy 201,587 rows generated 4,282 training games 98 rating games

Overall

User Training Rows Training Games Rating Games
yaoge123 486,130,416 rows generated 9,794,348 training games 153,545 rating games
luckyangman 342,435,207 rows generated 6,418,062 training games 140,115 rating games
angliu 304,968,775 rows generated 6,481,845 training games 173,491 rating games
水底2022 264,920,064 rows generated 5,461,179 training games 127,379 rating games
luotiany 261,860,656 rows generated 5,555,659 training games 23,547 rating games
Friday9i 209,928,002 rows generated 4,299,338 training games 62,034 rating games
maomaochong 154,868,811 rows generated 3,190,535 training games 57,157 rating games
AiqiGo 148,551,176 rows generated 2,819,086 training games 53,342 rating games
jiusi010302 111,549,344 rows generated 2,157,135 training games 32,148 rating games
maxueba 104,372,046 rows generated 2,166,185 training games 44,907 rating games
TheOnly92 96,528,605 rows generated 2,009,851 training games 33,835 rating games
Bubblesld 87,613,943 rows generated 1,846,178 training games 31,733 rating games
congxinzhisong 79,951,875 rows generated 1,704,199 training games 244 rating games
VegetableKnife 79,204,855 rows generated 1,470,688 training games 23,367 rating games
zhongtiao1 73,965,449 rows generated 1,567,182 training games 12,315 rating games