In Town of Charlotte v. Richmond, 158 Vt. 354, 609 A.2d 638 (1992), the Court held that Colehamer applied to affirmative defenses and therefore the defendants' affirmative defense of a permitted nonconforming use was barred by failure to properly appeal a zoning decision under 24 V.S.A. 4472.