[mso] Re: Sorting huge file (remove dupes, if possible)

  • From: "Green" <1z@xxxxxxxxxxxxxx>
  • To: <mso@xxxxxxxxxxxxx>
  • Date: Fri, 15 Dec 2006 20:16:31 +0100

Robert,

It maybe sounds strange but is there any way you can make the records
unique? Maybe adding a record count to each record? What format is your
file? If it's text then even with so many records you could write a VB/VBA/C
whatever, to reasonably quickly do this.

HTH
Lisa

> I have a file that is horrible duplicated in records. I might 
> have 1,000 "US","Florida","Miami-Dade County","Miami", 
> 25.77389, -80.19389 (Plus other locations that have 100s of 
> duplicates.) strewn throughout the file. I thought I could 
> import into Access 2000, and it would accept all of it, I 
> could sort it, and then de-dupe it.
> 
> However, upon attempting to import, Access complains there 
> are too many duplicates, and stops. Excel is out also.
> 
> Given this, then, can I make Access import it, duplicates and 
> all? Then I could sort, and have Access remove the duplicates 
> after importing? If not, I could sort, export, and I will 
> write a C program to remove the duplicates, and re-import the 
> resulting file into a new Access file?
> 
> Given a file of supposedly about 1,750,500 records, I expect 
> to retain slightly around one million, doing away with 
> 750,000 or so records. Then since they are unique , Access 
> should import that just fine.
> 
> Any help in getting Access to accept the duplicates anyway 
> would help. Thank you.
> 
> Robert

-- 
No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.5.432 / Virus Database: 268.15.20/588 - Release Date: 15/12/2006
10:02
 

*************************************************************
You are receiving this mail because you subscribed to mso@xxxxxxxxxxxxx or 
MicrosoftOffice@xxxxxxxxxxxxxxxx

To send mail to the group, simply address it to mso@xxxxxxxxxxxxx

To Unsubscribe from this group, visit the group's homepage and use the dropdown 
menu at the top.  This will allow you to unsubscribe your email address or 
change your email settings to digest or vacation (no mail).
//www.freelists.org/webpage/mso

If you are using Outlook and you see a lot of unnecessary code in your email 
messages, read these instructions that explain why and how to fix it:
http://personal-computer-tutor.com/abc3/v28/greg28.htm
*************************************************************

Other related posts: