Hi Anna, I've got one of these & what you describe is exactly right.
I've actually got an issue with mine of a very slow leak even when not attached to any kegs. I think the problem is either internal or with the connection to the cylinder itself. Would you mind telling me what type of washer...