Nah, I’m not a genius, I’m just aggressively lazy. Just like you, I really value my downtime. I need a lot throughout the day or I find my tension levels get out of hand.
Office politics can be pretty silly sometimes, but I think you might be surprised to find your coworkers may be as perplexed by your behavior as you are by theirs. People have different priorities but often interpret others’ motives in reference to their own values.
Don’t be afraid of being -tactfully- honest about what you need to be successful at your job. My coworkers know I value candor and efficiency, meaning I like being to the point and getting work done quickly (unspoken: so I can proceed to fuck around). They know when it’s time to talk and when it’s time to leave me alone so I can do my thing and, since I’ve tricked them into liking me, they actually want to leave me alone because they know it helps me.