Can't import any users on second try

[D. Thomas]

UBB Classic to VB 3.6, I imported 25,000 users sucessfully but server response so slow had to get host to optimize server and then couldn't get threads to import, so hit "delete session and all imported data" "for clean retry" and started over.

But now it won't import users at all. Briefly on screen I see "importing 0 to -1 users" and one second later it's finished ! Have tried various combinations of users to import per cycle..nothing works.

Ideas ?

[peterska2]

Delete the session and then start the import again and ensure that you run each module twice up to and including the users module.

[D. Thomas]

I saw that mention of running them twice in the manual and I'm pretty sure I did run the modules twice up to that point but not positive. If you think that has high probability of good result I will try yet again.

[peterska2]

It is important to run the previously ran ones twice to ensure that the data is imported correctly when a previous import attempt has been made.

[D. Thomas]

Actually there are only two modules before the user import module, the "get paths" module and the "associate users" I did run "get paths" twice and "quit" for "associate users" (since I don't have any to associate)...so what is left to try in that regard ??

[peterska2]

In that case, please submit a support ticket with all the relevant information then we can look into this in more detail.

[D. Thomas]

D'oh ! I found the problem. When I copy/pasted the paths back in the blanks, somehow the end of the filename "Members" got left off ! I think it's working now. :o

Now I can only hope I can import 35,000 members in less than 3 hours this time....so far it's not looking good....10 minutes for 2,000.....

Last time I imported the users it got progressively slower the more it imported...such that it took 12 minutes to do 2,000 but by the time it got to 26,000 it was taking 30 minutes per 2,000....depressing...

[peterska2]

:)

It's usually the simple things that cause the biggest problems.

Keep us posted and just say if you have any other questions during your import.

[D. Thomas]

Just out of curiosity, when I look at the list of imported user names as they are being imported, to the left of each name is a percentage figure. In my lists the percentages range from 18 to 27 percent. What does that "mean" exactly ?

[peterska2]

This is just an indicator to show that the import has been successful. The actual value shown there does not have any impact on the import and can be ignored safely.

[D. Thomas]

OK, but the natural reaction is to think it means only 18 percent of the users info has been imported, and to therefore worry during the whole process that all is not going as it should. I know better now of course having done the import twice already, but was curious why the particular percentages. Thanks.

[D. Thomas]

Some improvement. Imported all members in only 40 minutes this time.

[D. Thomas]

While user import time improved, the time to import 72,000 threads did not...still took *6 hours*

At first it was importing 800 threads per minute, so I calculated 90 minutes. But as the threads stacked up it got slower and slower, so toward the end was only importing 200 per minute. Anyone have any idea why this is happening ?

[D. Thomas]

For instance, you leave forum no. 24 open in the source forum, but close forums (or "hide" really) forums 1 thru 23, while forums 1 thru 23 are being imported ?

Reason= Taking many, many hours to import posts and would be nice to at least have one forum useable by members during the process.

Source -UBB Classic 6.7
Target - VB 3.6.8
Size- 650,000 posts

[D. Thomas]

Well, I now know why the import got slower and slower as it progressed...just amazing I had to figure it out on my own......

[Steve Machol]

All forums are imported, regardless of status. You should cclose the forums while doing any import, otherwise there is a high likelihood of data being messed up.

[D. Thomas]

All forums are imported, regardless of status.

Yes I know but that's sort of the point....wouldn't it be safe to import a forum that is archived on the source board with the overall forum site still open ? In other words, a forum that no one could be adding to or altering in any way during the import even when all the other forums are still "open" ?

I would be monitoring the process of course and when I see Forum 24 is finished import, then I would close the source site to import the other forums that would be otherwise still active.

FWIW, I should have said Forum 1 for this example instead of Forum 24, but hopefully you get the idea.

[Steve Machol]

You cannot do a partial import, i.e., importing one forum at a time.

[Jerry]

Well, I now know why the import got slower and slower as it progressed...just amazing I had to figure it out on my own......

Because of the nature of the source data, the only way to speed it up is to set the dupe_checking to false in ImpExConfig, though then you trade speed for the integrity to a degree,

[Jerry]

Idealy you should shut the forums as Steve has said.

That being said ........ knowing how long ubb.classic imports take, you're plan would work in theory, by having all the others closed (or hidden or with a redirect) to protect them from change.

ImpEx will be ok, it's just the consistency of the source data that is the issue with importing against an open form, and in ubb.classics case PHP getting a read on the files while perl is using some of them.

Answer in short is it's a bit risky, but can be done, though I advise against it.

[be cool]

Delete the session and then start the import again and ensure that you run each module twice up to and including the users module.

Sorry to bump in here, but I had one question. I ran each module only once during conversion and the conversion went without a glitch. Is running a module twice a must or it is recommended only in case when errors occur? Thank you

[Steve Machol]

That is only needed if something goes wrong.

[be cool]

That is only needed if something goes wrong.

Thank you for your answer :). Now it is clear to me

[D. Thomas]

Because of the nature of the source data, the only way to speed it up is to set the dupe_checking to false in ImpExConfig, though then you trade speed for the integrity to a degree,

Bingo, just wish someone had told me this weeks ago...would have saved alot of headache. In my case I was trading "integrity" for the possiblity of doing it at all...it was that or nothing.

[D. Thomas]

OK, thanks. I did it and am finished now and all seems to be ok...but of course no way to know for sure just yet.

[D. Thomas]

Members are now in registered usergroup and do show at member searchs and logins do work, but in the stats at bottom of page still showing zero members.

Under "maintenance" I have updated user titles and ranks, rebuilt thread and forum data. I think I "updated user names" but can't remember now. Any ideas ?

Should I "rebuild statistics" ?

Rebuilding statistics will cause the loss of the total forum view and active users data. Only run this if you believe you really need to! Once the data has been replaced, there is no way to restore your database

[Jerry]

Members are now in registered usergroup and do show at member searchs and logins do work, but in the stats at bottom of page still showing zero members.

Under "maintenance" I have updated user titles and ranks, rebuilt thread and forum data. I think I "updated user names" but can't remember now. Any ideas ?

Should I "rebuild statistics" ?

Rebuilding statistics will cause the loss of the total forum view and active users data. Only run this if you believe you really need to! Once the data has been replaced, there is no way to restore your database

Though all the members appear in the usergroup manager ?