To remove a number from your Allow list, navigate to the Allow tab, select the number you want to remove, and tap the Allowed icon on the detail view.