Have you noticed some sort of raised bump at the exit point of your piercing?
This could be due to a number of sources of irritation or infection that can result in overgrowth of scar tissue when the healing process is disrupted. There may be a single, simple solution though it commonly may take a combination of protective measures to help this turn out well.