Update:
Problem solved.
Adjusting the platter height didn't fix the noise, but it's now at the correct height—thanks for noticing that Martin (luckily this was the first time I've used the unit, so no damage has been caused).
I ended up figuring out that applying a small amount of pressure on the wheel pictured below stopped the noise.
A drop of lubricant where the wheel meets the shaft did the trick.
Thank you all for the advice.
Hamish