Thank you for your responses.
Here are the details:
We are sending emails to list of insurance agents in all fifty states.
The databases are public records.
The first list we need cleaned up is from WisCONsin. (How the natives pronounce it.)
http://oci.wi.gov/agentlic/agntlist.shtml
Scroll down to bottom of page:
Format 2 - Agents by Company Appointments
There are 17 files. First one is al_1st-al.exe. We figured out how to separate columns, and remove the records without email addresses.
1) We need all the first and last name duplicates removed; and 2) words turned into lower cases.
We would prefer a way to automate this whole process.
If interested, please PM.
Thanks