What Does It Mean If You Peel Labels Off Bottles? - RideAble Baking “Sticky” Labels Off Preheat your oven to 350℉ Place the bottle in the middle of the center rack of the oven, label side up. Bake the bottle for 5 minutes. Put the oven mitt on your non-dominant hand. Carefully remove the bottle from the oven, holding it by the neck. Rest the bottom of the bottle on your work surface.