When you're working on your computer or laptop ... All you have to do is hover your mouse over the taskbar icon and middle-click the thumbnail preview of the window you want to close.