Removing it is the correct option, as there are likely people at 120 who effectively got months worth of AP in 30 minutes. Losing a few levels on your neck as a 110 is barely any stat difference anyways, where as for the 120s it is going to be impacting azerite trait unlocks in the next raid...