On Windows, you can use the middle-click button to close app windows directly from the taskbar. All you have to do is hover your mouse over the taskbar icon and middle-click the thumbnail preview ...