Yes, I have the same issue. It is never accurate despite having Google location set to high accuracy. I have also attempted to change the location in the Samsung gallery app to the correct location but it jumps straight back to the wrong one
Enable GPS as well as network location for more accurate location stamps. The issue with that is very high battery consumption so don't be surprised when it tanks very quickly. GPS only works reliably outdoors though unless you live in a timber frame bungalow for example. Half a mile out indicates it is picking up the location of your phone exchange (WiFi) or nearest mast (mobile data)