Correct me if im wrong, but he will only loose his no claims if HE claims for his own damage.
You sound like you let him away too easily. I hope you took down his registration number? Normaly I try to get that, name, phone number, name of insurance company.
If the damage is there, claim him.
Hell get a whiplash claim in as well, takes 2 years or so, but you cant knock 3 grand for nothing.