Yeah, OK, let me prefix the following by saying that I am absolutely *not* an expert:
That smells to me *exactly* like some bug with Sleep Proxy on a network and a device that is not aware of such behavior! The iDevice says "tell me about yourselves, all you Airplay renderers", and, everybody responds, except that without waking any sleeping devices, the Sleep Proxy server responds for some of them. How? It has substituted its own MAC address for theirs and the router sends messages to it. So the Sleep Proxy says, "Yes, here I am: DeviceName(etc.)" for every device which has slept but it thinks does not need to awaken, because hey, it's "only" supplying names/DNS services, right? But then the iDevice tries to set up the stream to one of them before sending data, whereupon the Sleep Proxy gets its first packet that it knows must be handled by the device. So it tells the router to switch back the MAC address (how? I dunno, maybe TTL=0?) and then sends the special wake packet, and then also passes along the packet it knows the device must handle itself. How long does the wake take? Does the Sleep Proxy know how long to wait before passing that first packet? Does the device have a packet buffer? If it's UDP, does the packet just go off and get ignored by a waking device? If it's TCP, how long does the sending device wait before deciding to retransmit (or give up)? All unknown to me, though someone at B&O must have written code for this case.
That correlates to how a speaker device might be seen, but then takes longer than usual to start playing, and sometimes... just doesn't! Now, I do not *know* that an A9 can sleep, or that yours is sleeping. And I do not know if Bonjour Sleep Proxy is responsible. But what you just said sure looks suspicious.
If you are not using Apple Airport's for wireless or routers (which also have Sleep Proxy built in), I would at least *try* turning off the AppleTV and restart all the rest of your network, then use it like normal, and wait to see if the A9 works as well as all your other devices. This may be a total red herring. But at least it's easy to test.