For each window, use JComponent.registerKeyboardAction
with a condition of WHEN_IN_FOCUSED_WINDOW
. Alternatively use:
JComponent.getInputMap(WHEN_IN_FOCUSED_WINDOW).put(keyStroke, command);
JComponent.getActionMap().put(command,action);
as described in the registerKeyboardAction API docs.