zjones,
as has been suggested, make sure your bcg is properly lubed.
When shooting, did you try using the forward assist to fully engage the bolt instead of the charging handle?
If you have already polished the lugs, and still have an issue, try pulling the bcg, disassemble it, clean, lube and reassemble it.
I just finished my first build. When I went to lube before final assembly, I thought my cam key was really stiff, so I ended up working it manually until it moved more cleanly. It should loosen up as it breaks in, but it should move cleanly to start with.
There's a good thread on ar15.com with some diagrams showing where and how much to lube. Also watch one of the disassembly vids on youtube and see if your bcg functions properly.
If that doesn't solve it, test your gas system. You can use a compressor; I used a can of air.
If those two things don't work, let Eyeguy have a look.
Good luck.