The other day I came across an interesting article - all leading AIs show signs of mild dementia when they need to connect visual and numerical content. AIs couldn't draw a regular clock...
https://bmjgroup.com/almost-all-leading-ai-chatbots-show-signs-of-cognitive-decline/
So I went to play with Galaxy AI. Wow, I have to say that at first I was impressed that Galaxy AI generated a clock from my drawing without any errors. All the numbers and hands in place.
Ok, I went to play further and deleted all the numbers except 12. AI first generated the same clock with only the number 12, and then after the 5th attempt it added the numbers 3,6,9.
Oh, I was already happy that our AI is very "healthy", eh, too early. First it added minutes to the hour, then a second hand and that was also very cool. And then it started mixing up the numbers, putting 8 on 3 and so on. The longer I played with new generation, the more the AI started to "fantasize", but I would be surprised if in between these fantasies it suddenly displayed a correct clock.
Now just imagine how difficult it really was to get the AI to correctly generate a calendar from my drawn calendar with a picture and numbers.
Here some failed calendars
And here is Copilot kalendar for January 2025
It would be nice if this could be solved with vitamins B and C, but they are not living beings, so I asked Gemini what is needed for the health of artificial intelligence. This is his answer
If you draw a slightly more complex clock, say like this one, Galaxy AI is not as successful as when it generates a clock from a 2D drawing - it generates with errors, displaying it correctly in 45% of the generation.
The generation accuracy drops drastically to zero if flowers, a picture on a wall with wallpaper, and a book are also drawn.
Since it's still Christmas time, I erased the flowers and the picture and drew a Christmas arrangement and calendar on the wall. The accuracy of the numbers on the clock and calendar is still zero.
Then I drew my favorite monster in the foreground. Oops, missing clock and calendar and I got a monster roaming around my AI city.
Then I moved the monstera to line up with the clock and got a monstera figure next to the clock and below the calendar, but the numbers are still not correct.
Then I moved the monster behind the clock and calendar, wiped the wall, and got the clock and calendar back, without the correct numbers.
Then I removed my favorite monster and drew some more monsters. I got a monster that broke through the calendar with its head 😂
By further generating the last drawn image with multiple monsters, I got one sticking its tongue out at me, as if the AI wanted to say - you won't get a picture of a clock and calendar with the correct numbers from me. At the time of writing this, I still haven't managed to get the AI to generate all the numbers on the clock and calendar correctly.
🤭😂🤭
