Colored family moved beside me, what do i do?

I live in Rural North Carolina, this colored family moved beside me and it really worries me, i know they their kind is prone to stealing and such. I have kept my huntin rifle next to my best ever since they moved in. What should i do to make sure me and my wife are safe from them? I am thinking about putting my confederate flag out in the front yard to show them they arnt wanted.