It just depends on your abstraction you’re mentally using. If you think of a sliding moving visual window on a document, then you like the scroll bar mental model. If you think of moving the content itself, then you like the phone scroll model.
But it’s two different directions whether you grab the scrollbar handle or move two fingers. Why would I need to learn two different movement directions for a single scroll direction? That makes no sense and it’s not natural.