Peter Hodge, honorary general secretary of the Normandy Veterans Association, said:
"There is no way in the world I am going to agree with the National Lottery standing up and saying they sent our veterans to Normandy in the 65th anniversary,"
The Normandy Veterans Association said it would not accept the money at this late stage.
It said it had almost raised enough with the help of a national newspaper.