Should one apply for de registration if the turnover threshold is less than required?

My company is in designated zone registered in Vat voluntarily. However our taxable supplies for the last 11 months is below 187,500 as most of the transactions are out of scope. Do we need to apply for de-registration next month in this case?