The capatilise letters thing is happening with my phone too after the last keyboard update and I usually have to press back space and the letter changes to a capital.
It's a bug.
I do not get the arrows situation however.
I'm not sure if you could get a screenshot to show what's happening.
Do look in the keyboards settings please.
🌈 Stay Safe 🌈
Daily Driver > Samsung Galaxy s²³ Ultra 512Gb in Phantom Black.
The advice I offer is my own and does not represent Samsung’s position.
I'm here to help. " This is the way. "