Yes, downvoting with a trail adds responsibility.
So far our delegators are doing a great job, I constantly keep an eye on their suggestions and very seldomly removed something so far. I keep the option to block delegators from adding entries if they repeatedly add stuff without proper reasoning, but I hope I won't need to make use of that.