(1) No member of the board shall participate in the hearing of any appeal in which he has an interest nor shall any such member appeal in which he has an interest nor shall any such member represent any interested party or witness at any appeal hearing. Any interested party may challenge any member of the board in writing, served upon the chairman of the board, five days in advance of any scheduled appeal hearing stating the reasons therefore, and if the board shall find merit in the challenge, it shall disqualify the challenged member and appoint another person in his place to hear the appeal if it deems such appointment advisable.