A Small Lie

I lied to my partner about meeting an old patient for coffee yesterday. In truth, I stopped by their place unexpectedly, and we ended up talking way longer than planned because they needed emotional support more than anything else. Yet I felt so guilty that I fibbed, justifying it as a harmless white lie. Why am I so bothered by this little inaccuracy when everything else is good between us?