[mso] Re: Sorting huge file (remove dupes, if possible) :VSMail mx3

  • From: "James LaBorde" <jlaborde@xxxxxxxxx>
  • To: <mso@xxxxxxxxxxxxx>
  • Date: Fri, 15 Dec 2006 12:49:07 -0800

Robert,

Importing to a new file would work for you and you wouldn't have a No =
Duplicates restraint on any of the fields.  From the looks of your data, =
you really need to normalize your data.  That should help out =
significantly.

James

-----Original Message-----
From: mso-bounce@xxxxxxxxxxxxx [mailto:mso-bounce@xxxxxxxxxxxxx]On =
Behalf Of Robert Carneal
Sent: Friday, December 15, 2006 12:13 PM
To: mso@xxxxxxxxxxxxx
Subject: [mso] Re: Sorting huge file (remove dupes, if possible) :VSMail =
mx3


-Emphasis-
You didn't say in which format the records to be imported are presently;
would you mind sharing that with the class? :-)
-End-

They are CVS text. Thinking about it, you are saying if I import to a =
*new*
file with duplicates allowed, it should work then? Example:
"USA, Alabama, Autauga County, Bishop Cemetery","Bishop Cemetery, =
Autauga
County, Alabama, USA","Ala., Autauga Co, Bishop
Cemetery",323212.4813,-868967.0596
"USA, Alabama, Autauga County, Coee Cemetery","Coee Cemetery, Autauga
County, Alabama, USA","Ala., Autauga Co, Coee
Cemetery",323725.4681,-868856.0588
"USA, Alabama, Autauga County, Congregational Holiness
Campground","Congregational Holiness Campground, Autauga County, =
Alabama,
USA","Ala., Autauga Co, Congregational Holiness
Campground",323750.4757,-866892.0877
"USA, Alabama, Blount County, Aaron Branch","Aaron Branch, Blount =
County,
Alabama, USA","Ala., Blount Co, Aaron Branch",340853.345,-866482.0541
"USA, Alabama, Blount County, Adams Lake Dam","Adams Lake Dam, Blount
County, Alabama, USA","Ala., Blount Co, Adams Lake
Dam",334954.3649,-867688.0501

... and so on.  This is for familial genealogy work.

I had been trying to import to an already existing file.

Thank you.

Robert

-----Original Message-----
From: mso-bounce@xxxxxxxxxxxxx [mailto:mso-bounce@xxxxxxxxxxxxx]On =
Behalf Of
Jim Pettit
Sent: 2006-12-15 06:59
To: mso@xxxxxxxxxxxxx
Subject: [mso] Re: Sorting huge file (remove dupes, if possible)

Robert--

The only reason Access would have for refusing the records is if you're
trying to import them into an existing table which has a field (or set =
of
fields) which has/have the 'Indexed' property set to 'Yes (No =
Duplicates)'.
You can remove this constraint--I'd suggest setting it to 'Yes =
(Duplicates
OK)'. Then do your import, followed by running a query to show the
duplicates. Then 'simply' strip out the bad records.

You didn't say in which format the records to be imported are presently;
would you mind sharing that with the class? :-)

Hope this helps....

--Jim

-----Original Message-----
From: Robert Carneal
Sent: Thursday, December 14, 2006 9:38 PM
Subject: [mso] Sorting huge file (remove dupes, if possible)

I have a file that is horrible duplicated in records. I might have 1,000
"US","Florida","Miami-Dade County","Miami", 25.77389, -80.19389
(Plus other locations that have 100s of duplicates.)
strewn throughout the file. I thought I could import into Access 2000, =
and
it would accept all of it, I could sort it, and then de-dupe it.

However, upon attempting to import, Access complains there are too many
duplicates, and stops. Excel is out also.

Given this, then, can I make Access import it, duplicates and all? Then =
I
could sort, and have Access remove the duplicates after importing? If =
not, I
could sort, export, and I will write a C program to remove the =
duplicates,
and re-import the resulting file into a new Access file?

Given a file of supposedly about 1,750,500 records, I expect to retain
slightly around one million, doing away with 750,000 or so records. Then
since they are unique , Access should import that just fine.

Any help in getting Access to accept the duplicates anyway would help. =
Thank
you.

Robert

*************************************************************

--
No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.5.432 / Virus Database: 268.15.18/586 - Release Date: =
12/13/2006
6:13 PM


*************************************************************
You are receiving this mail because you subscribed to mso@xxxxxxxxxxxxx =
or
MicrosoftOffice@xxxxxxxxxxxxxxxx

To send mail to the group, simply address it to mso@xxxxxxxxxxxxx

To Unsubscribe from this group, visit the group's homepage and use the
dropdown menu at the top.  This will allow you to unsubscribe your email
address or change your email settings to digest or vacation (no mail).
//www.freelists.org/webpage/mso

If you are using Outlook and you see a lot of unnecessary code in your =
email
messages, read these instructions that explain why and how to fix it:
http://personal-computer-tutor.com/abc3/v28/greg28.htm
*************************************************************

*************************************************************
You are receiving this mail because you subscribed to mso@xxxxxxxxxxxxx =
or MicrosoftOffice@xxxxxxxxxxxxxxxx

To send mail to the group, simply address it to mso@xxxxxxxxxxxxx

To Unsubscribe from this group, visit the group's homepage and use the =
dropdown menu at the top.  This will allow you to unsubscribe your email =
address or change your email settings to digest or vacation (no mail).
//www.freelists.org/webpage/mso

If you are using Outlook and you see a lot of unnecessary code in your =
email messages, read these instructions that explain why and how to fix =
it:
http://personal-computer-tutor.com/abc3/v28/greg28.htm
*************************************************************
*************************************************************
You are receiving this mail because you subscribed to mso@xxxxxxxxxxxxx or 
MicrosoftOffice@xxxxxxxxxxxxxxxx

To send mail to the group, simply address it to mso@xxxxxxxxxxxxx

To Unsubscribe from this group, visit the group's homepage and use the dropdown 
menu at the top.  This will allow you to unsubscribe your email address or 
change your email settings to digest or vacation (no mail).
//www.freelists.org/webpage/mso

If you are using Outlook and you see a lot of unnecessary code in your email 
messages, read these instructions that explain why and how to fix it:
http://personal-computer-tutor.com/abc3/v28/greg28.htm
*************************************************************

Other related posts:

  • » [mso] Re: Sorting huge file (remove dupes, if possible) :VSMail mx3