It's rage-inducing because the 1900 shop keeper doesn't keep a book about you specifically, notes down your presence to the last second, follows you home or into other establishments, etc. Also his memory is not accurate and no tangible proof (it's just his word after all), so nobody can download his memory if they want to spy on you for whatever reason (dissident, whistleblower, etc.)