Why?
In that case, I think of Steam, which keeps requesting access to the Accessibility Panel. I don't think I want that, because Steam is not an Accessibility tool.
What?
I'd like to say "No, I don't want to give you access, stop asking".
NOTE: Buscar's answer clearly explains why it needs to be accessed, which makes the problem a non-problem.