This uses the same number of workers as the pod sync workers. We may want to start a worker queue here instead, but I think for now this is ok, particularly because we are limiting the number of goroutines being spun up at once.