I can't speak for Ned on this, but I do know that the first thing he would do before banning would be to check the logs (which would show if you did, or did not damage Grim), and then question you about it, the logs do not lie, but like I say, I cannot say for certain that Ned checked them (although it is highly likely)