Fruit flies...more affectionately know in our house as "Party flies" seem to be attracted to anything especially sticky or generally rotting. I have not observed that they actually do damage to the stick or rot by eating it (PERISH THE THOUGHT!), rather that they like to lay their little eggs in it.
If you are observing them around your plants, its likely that they are happy about something eewy gooey in the dirt or pots or in/on the area surrounding them. Depending on what you use to grow your plants, the flies might like the smell and are rooting around looking for a new nursery. My mother got the bright idea of emptying old eggs into the soil of one of her house plants to fertilize it, and was plauged for months by the little bastards. They never actually hurt the plant though.
Do a wipe down around the area and re-evaluate what you may be using to fertilize the plants with.
I am fairly certain they arent interested in your fresh crispy cannabis, but rather something in or around it.
GOOD LUCK!
After all, who wouldn't prefer Middle Earth, unless they've been corrupted by a Ring of Power?
http://www.lewrockwell.com/elkins/elkins73.html' target='_new'>December 24, 2002