Congress workers were detained while protesting at the Collector's Office