I doubt it hinders your fighting Ian. If it really did, why would he use it, hm?
Like I said before, you are famous for using poitions, your whole group. Its how you win the majority of your fights, you toss potions galore then you wip out your sword and attack. Potions dont stack, so throwing more than one poition requires you to press you number keys a few times to get the same effect as you, where as you can do the exact same, and have your sword ready at all times.