don't buy a set of ball head allen keys, get straight flat ended ones, ball ones simply are a ballache to use and you never use them for most tinkering.
You can get ones that have one at each end. I've found the ball heads to be good for grub screws in hops and the like, but you're right in that they wear a lot lot faster.
The reason you'll have used the ball ones for grub screws is that they're usually further in to the object and traditionally the ball end is on the long part of an L shaped allen key. a decent set of drivers with enough reach allows much finer adjustment
Just buy a set of Bondhus allen keys they are ball ended on the long arm and wont round off easily. My current set is 10yrs old and still going strong.