The key to treating oily skin is moisturizing. Your skin feels the need to produce oil when it is dry. Try to cleanse your face at least twice a day. Try mashing a papaya up and applying it to your face for about ten minutes. The acid in the fruit will eat up the oils on your face.