[mso] Sorting huge file (remove dupes, if possible)

  • From: "Robert Carneal" <carnealre@xxxxxxxxxxxx>
  • To: <mso@xxxxxxxxxxxxx>
  • Date: Thu, 14 Dec 2006 20:37:47 -0600

I have a file that is horrible duplicated in records. I might have 1,000
"US","Florida","Miami-Dade County","Miami", 25.77389, -80.19389
(Plus other locations that have 100s of duplicates.)
strewn throughout the file. I thought I could import into Access 2000, and
it would accept all of it, I could sort it, and then de-dupe it.

However, upon attempting to import, Access complains there are too many
duplicates, and stops. Excel is out also.

Given this, then, can I make Access import it, duplicates and all? Then I
could sort, and have Access remove the duplicates after importing? If not, I
could sort, export, and I will write a C program to remove the duplicates,
and re-import the resulting file into a new Access file?

Given a file of supposedly about 1,750,500 records, I expect to retain
slightly around one million, doing away with 750,000 or so records. Then
since they are unique , Access should import that just fine.

Any help in getting Access to accept the duplicates anyway would help. Thank
you.

Robert

*************************************************************
You are receiving this mail because you subscribed to mso@xxxxxxxxxxxxx or 
MicrosoftOffice@xxxxxxxxxxxxxxxx

To send mail to the group, simply address it to mso@xxxxxxxxxxxxx

To Unsubscribe from this group, visit the group's homepage and use the dropdown 
menu at the top.  This will allow you to unsubscribe your email address or 
change your email settings to digest or vacation (no mail).
//www.freelists.org/webpage/mso

If you are using Outlook and you see a lot of unnecessary code in your email 
messages, read these instructions that explain why and how to fix it:
http://personal-computer-tutor.com/abc3/v28/greg28.htm
*************************************************************

Other related posts: