How can I delete an iOS configuration profile?

Stored iOS profiles on the iPhone, iPad or iPod touch can be deleted in a few easy steps. Note that deleting actively used configuration profiles can cause issues with Wi-Fi or VPN settings, Email, Exchange, Credentials and other configuration information within the profile.