Parrying

when you guys parry do you parry and your gun remains equipped or do you parry and you are left with the knife in hand?

im the latter, some people claim they parry and then it auto switches back to the gun. im wondering if im doing something wrong or if its a bug or what?

What happens for you?