Gareth Graham, a retired paramedic team manager, has quit his job as Alpine Shire mayor 10 days after he was elected.