Users Lost during Import/Merge with no warning!!

[sblair]

LOST USERS IN IMPORT!

I just found out the very hard way after 12 hours of importing and reconfiguring that I've lost a bunch of users somehow.

Running vBulletin v3.5.4 using Impex 1.30

Imported 2 different UBB.Threads databases into a new vB database. Have just discovered that some of the users are missing completely.

Their posts are there, but they user records are not. During the import it indicated all the users were succesfully imported but they were not.

When I look at posts those users made I see this in the Postbit:

"MACotter

Posts: n/a "

When I look in the Users db they are no where to be found.

What are my options here....do I have to start all over again??

[sblair]

Forgot to mention we're out of our testing phase and this happened in the process of our live rollover....so any quick help on what to try would be great!

[Steve Machol]

At this point I would start over since this is just a test. And watch each of the modules to make sure they are completing.

Opps: Not a test. Nonetheless still think you need to start over.

[sblair]

Okay...

I rolled back to a Pre-Import backup. Only Admin users and no forum/post data.

I imported the first UBB database. It reported 179 users successful, 0 fail.

I checked the vb_user table in MySQL and it reported the correct number.

I then Removed the ImportID's to do the next import. It reports it successfully imported 1530 Users, 0 Fail.

I then go look in the vb_user table again and it stopped at *exactly* userID 1000! There is some over lap between users in the two databases, but only about 40 people...even 100% overlap wouldn't result in losing 500 people.

One of the systems being imported has over 4000 posts, but when I look in vb_post it has exactly 1000 post ID's. Same thing with Threads.

The import routine is putting data in but it doesn't seem to be making it all into MySQL.

Any ideas?

[Jerry]

If you are performing a multi import you have to finalize each import before doing the next one.

http://www.vbulletin.com/forum/showpost.php?p=764435&postcount=2

http://www.vbulletin.com/docs/html/impex_multi_import

[sblair]

After each of the Imports I do the following...

After the last import is there something different I need to do?

Should there be any concern with running Repair/Optimize tables?

Remove importids

To delete the importids in the database, click here, also removes the session. This will allow you to do consecutive imports

[Jerry]

The only thing you need to do is remove the importid's, you can check that it has run correctly by running this SQL :


SELECT count(*) FROM user WHERE importuserid <> 0;

[sblair]

Is there any danger of losing data when doing a Repair/Optimize after I'm done doing all the import and cleaning?

Heard on other systems where this can be an issue.

[Jerry]

Is there any danger of losing data when doing a Repair/Optimize after I'm done doing all the import and cleaning?

Heard on other systems where this can be an issue.

No, that just fixes any broken tables, as with any import test the process from beginning to end to ensure that its ok.