RE: [cobalt-users] MySQL on RAQ2

["Douglas MacDougall" <mac@xxxxxxxxx>]

>Okay.  Here's the scenario.  We've finished writing the application.
>Runs like a dream.  Now, I have to convert data.  My client has sent me
>a text dump from his old database.  Some 50, 000 records.  I use a php3
>script to parse this file, and insert the rows in to mysql.

First, I would try to use mysql to parse the data if at all possible. Create
a temp table dump the data in using INSERT FROM LOGFILE... then parse that
into your separate tables. I would use a .sql script and then mysql -p <
myslickscript.sql

If it requires some programming perhaps use perl, but you probably need to
run that from the command line rather than with php3.

When I first built my web access system I had to dump in tons of data from
the old logfiles (almost 100MB!) the program ran for several hours before
completing.. but it ran without a hitch. once the data was in the first time
subsequent daily log updates take only a few minutes, and run from cron
jobs.


Douglas MacDougall
CTO - GNA Co. Ltd.
Japan