He was probably on his way to work and was trying to scare monger you. The police do have certain powers available to them even if off duty, esp if in uniform. But from what you've said, he wouldn't be able to. Even if he had no video camera evidence, he would have to of pulled you over and got you to admit it whilst noting it all down.