I'm not disputing that mate as I'm the same, took me 5 years to earn my beret & single tape but from threads I've read, people frown upon guys wearing a cap badge
But me personally, I would wear it, I wear my patches on my kit as I earned it & even toying with the idea of wearing my beret
You can see 10 years worth of wearing in & mud graining on your webbing aswell