Personally I don’t think you would need the tape. It’s usually for the gaps between sheets of drywall which can be significantly wider than these cracks. You should be fine just filling with the drywall compound and sanding.
For this you might end up seeing the thickness of the tape beneath the new layer of paint afterwards.