I couldn't agree more.
I have a case of 2 cousins, identical names (John) and age but born in adjacent parishes and both married a Margaret. Even the kids were similar. Between two census's person A moved away and person B moved into parish A. Couldn't figure it out for a long time until I found person A on the other side of the country. This was in Scotland, but it could happen anywhere.
So, if it doesn't feel right, chances are it isn't right.