Wasps act as pollinators in the garden. Unlike bees however, they do not produce honey, and unlike bees, they can sting more than once.
If you have a lot of wasps that bother you in the garden, you can try the glass wasp catcher. It is an organic way to trap these insects.