Read more: How To Bring Old Hardwood Floors Back To Life First, build and install the window jambs, head, and sill, which conceal the gap between the window and the drywall. Start with the sill.