Hide layer by clicking on object inside xref scene?

We use xref scenes a lot and I'd like a way to simply click on an object in view and hide it's layer. It's not as simple as a pickbutton because the objects in an xref scene aren't accessible like regular objects are...

So - I want the script to let me click on an object (that's inside an xref scene), get the layer name that object is on and turn off that layer. Any ideas how I'd do it?

Thanks,