Having played some games with friends, we've found that holding the mouse button to pick up a deck of cards feels clunky and unintuitive.

My suggestion: Add an alternative to it in the form of double-clicking the mouse button and holding the second click (while over a deck).