There's a powder poison you can get to kill them, basically the idea is you get as close as you can to the nest, spray the powder over the entrance, the bees/wasps end up bringing the powder in with them into the nest and it kills more in the nest. I've used it on a wasp nest in my own attic two...