Handle the mouse events in the panel containing the rectangles as you would normally do and then use VisualTreeHelper.FindElementsInHostCoordinates to figure out which elements are available at the current mouse position. Something like this: ...