This is a game played on June 19 between Ueno Asami (as black) and Fujisawa Rina (as white). At move 159, Asami cut with K14.
It involves a followup of the life and death of the white group M10, and most human players would be able to judge it, but AI (from Golaxy to Katago) all seem to deem it “alive” and continue to fight without securing the life of that group first. While a human player can read out the sequence like Rina did during the game and make the right choice.
But it takes like 10k+ playouts before AI realize the K14 cut is a very good move, and (with few playouts AI even judges K14 as a blunder). And it takes millions of playouts before AI realizes the M10 white group is in trouble.
What other AI blindspots and hallucinations have you seen in real games?
Blind spots like this occur all of the time. Can you give some additional details and context? And I’ll try to get this position as an sgf position for training.
What network were you using to evaluate this position?
Do you have an sgf file of this game that you can share, so that I can attempt to reproduce this issue? (Sometimes, the real blind spot is few plys into the tree, so it’s sometimes useful to be able to look into the position.)