Short Answer: Exfoliate!
According to Dr. Doris Day, New York dermatologist, ingrown hairs are caused when the hair grows out sideways or inwards, rather than straight through the skin". "Skin then grows over the hair, making it ingrown."
In appearance, your skin will look as though it has tiny, raised lumps or bumps under the skin. The skin will have these patches on the area of your beard, if you are a man such as on your neck, cheeks, and chin, and the nape of the neck. patches of tiny, hard bumps resembling small pimples on the skin’s surface. These patches of skin are keratosis pilaris or "chicken skin" and for women usually appears on the backs of the upper arms, the thighs, the buttocks, or the face as a rough patch of bumpy skin that does not itch. The bumps are hair follicles that are plugged by keratin, a protein found in skin cells.
Cosmetic ingredients that can treat ingrown hair, bumps, and the appearance of chicken skin include topical moisturizers, salicylic acid, lactic acid, urea, vitamin D, or tretinoin. Also, Vitamin A helps as chicken skin and razor bumps has a connection to Vitamin A deficiency.
One effective tip to treat razor bumps going forward: Use a body Scrub or a product with an exfoliating ingredient such as lactic acid or a scrubby effect such as sugar, coffee, sea salt. Shave after using the exfoliating product. Use a moisturiser with urea and vitamin A for maintaining razor bump-free skin.
Two Hazelberry Skinfood products that have urea and allantoin for maintaining a razor bump-free skin are : Hazelberry Skinfood Hemp Repair Body Moisturiser and Hazelberry Skinfood Super Intense Face Cream.
Hazelberry Skinfood Intimates for Men Black Shaving Butter also contains urea, lactic acid, coconut oil, witch hazel, and activated charcoal for exfoliating and moisturising as you shave.