Having sold both of them, they basically had everything working against them.
There was never a cohesive set of best practices for button layout. Text color, upper & lower case, same button in different places on different pages, made it feel more poorly designed than it was. Most B&O employees weren't programmers and it showed.
The programming tool was proprietary and linked to the internal corporate web portal via credentialing. It was difficult even for a trained sales person to use let alone a client. So any change no matter how minor was a headache and since the program could not be extracted it made it necessary for a copy of the program to exist on a computer before things like dropbox were widely available.
It was fragile. Any slight impact would deform the aluminum ball and clamp down on the button pad making the wheel difficult or impossible to turn. The glass would chip and delaminate.
The wifi on the Beo6 was basically non-functional for its intended purpose.
And ultimately it wasn't easy to use and hold in a world where control apps on the iPhone were coming online at the same point in time.
I have one on my desk as a little totem, but it was and is a truly terrible remote.