You can delete LinkedIn messages in just a moment by heading to your inbox and selecting the "Delete" option.
You can delete your LinkedIn account if you no longer want to use the site, but it will take about a week for your personal information to be erased.