Yeah, they didn't kill Gary because they thought he learned his lesson and he actually didn't get anyone killed. And they didn't kill Patrick because they couldn't-he was too powerful. I imagine the guy witch they did kill just wasn't expecting them and maybe wasn't that powerful (despite being a few hundred years old apparently).