The first thing you want to do is to locate their nest. Once you have done that, I would suggest sucking them up with a vacuum. You will want to wait early morning before they go out to forage, or early evening when they have returned. Thick gloves and thick clothing are a must! Although the males do not sting, the females do and they will be mighty angry.When you have sucked up all the bees, just patch the hole.