Since you’ve had it running already with a 960, I don’t think you’ll have any issues. And if you’re running the igpu for the host processes/transcodes with the dedicated gpu for gaming, that eliminates any possible issues from having to use a single gpu for everything. Also, I wonder if using the dedicated card for the vm avoids the issues that could pop up from running nvidia in linux.
One thing I forgot to mention, you’re going to need a new psu especially to power the higher class card. 500W might be enough for the lower tier and a much more power efficient processor but you’ll be trading some flexibility which isn’t worth it imho.