While possible, it’s also possible Janeway is just fucking with him and where Chakotay hides his booze is an open secret.
That conversation was in the elevator, and Chakotay had just said he wasn’t going to talk about what the experience was like because of the temporal prime directive.