inb4 all the "never use silicone on a hop rubber" posts.
it should just be good to go, just be sure when you have the barrel and hop unit re-assembled to check that everything is nice and centred and the adjustment is working fine, you may need to "twiddle" a bit to get it all sitting nice.