After your first frost, don't wait to remove annual plant material from your beds. If you want your flowers to reseed for volunteers next spring, let them dry a bit, but the rest needs to come out. Add the dead residue to your compost heap or mulch them into the grass. Your garden beds (and your neighbors) will thank you!