It's definitely worth checking if you need to put a tiny bit of lube on the edges of your BCG. If you take it out of the receiver, do you see any lines where there could have been direct metal on metal contact?
Which mag are you using with your N4? The original "D-Mag" by Double Eagle is a bit...