There are a couple of things to consider. If you're talking about the same instrument then you should try and use the ivi driver so state caching etc is not affected.
If you're using multiple instruments and some have IVI drivers and others have non-IVI drivers using VISA then you should be able to use both.
Basically, use the IVI driver only to communicate with that instrument and the VISA driver for the other one. Mixing and matching for the same instrument could be troublesome.
Hope that helps.
Kamran - NI