We had a brief hiccup tonight with our database. Luckily we had a recent copy and we were able to rebuild about 59 lost topics using a script we developed last year for this very purpose.
The only problem is that some of the topic titles were lost. So we updated those threads with what we think were the topic titles!
I think this was the fastest recovery we ever had from a database crash!
We are working on a behind the scenes admin panel / watch dog so that the lovely Killian can monitor the entire operation during the day and spot troubles right away.
Also we have re-enabled nightly backups of the database which is probably a good idea!
Yes we lost some of the posts (64) in the historical archives as well because i posted last night in it and there is only 33 posts showing and some are missing also in the celtic heart forum, the poem "The blade" shows 0 replies when in fact there was quite more.
It seems like I see an old page of celtic radio.
LOA
--------------------
"Few men are brave:many become so through training and discipline." Flavius Vegetius Renatus
"I think a hero is an ordinary individual who finds strenght to persevere and endure in spite of overwhelming obstacles." Christopher Reeve
Let's give it another try. Looks like the database crashed again, although I can see that we did not completed one little aspect of the database recovery which might have caused this latest problem.
Yes we lost some of the posts (64) in the historical archives as well because i posted last night in it and there is only 33 posts showing and some are missing also in the celtic heart forum, the poem "The blade" shows 0 replay when in fact there was quite more.
It seems like I see an old page of celtic radio.
LOA
LOA;
What happened? I go get 9 teeth removed and disaster strikes. I guess I shouldn't have screamed so loud.
I'm not sure if 64 posts where lost. Could you describe the posts, the issue is only effecting the topic table, no posts have been lost so we can recreate which we have done.
We had a bit of weirdness on our server, seems strange it happened at the same time some major security updates happened on our radio server. We also did a few more things today that we should have done yesterday. Please, if this happens send an email to us right away. Killian will be monitoring all day tomorrow.
No worries, we have plenty of backups and are running nightly backups of all data and programs. We also have remote backups too!
Could you let us know when you go to the dentist again? Not sure if that had something to do with it!
Lost a few posts in the General Discussion/Ireland thread, that were posted between 6 PM and 7:30 PM. Also, a few that UlsterScotNutt posted during the late morning.
I show them under my profile as making the posts but they do not come up when you click on the thread. It's like there are two seperate threads for the same topic.
We updated the title names of the topics as our "rebuilding" script uses all of the posts to rebuild the topic names. I think we counted 59 missing topics last night, but they should have been rebuilt. But can't rule out other missing stuff.
Well, we have a nightly backup of the database scheduled for 2AM every night now, so if it happens again we should be adequetely protected.
Thanks for everyone checking out the forums and letting us know about any problems. We will try to get them fixed ASAP.
Be aware that since the second hiccup, the count on replies to topics may be off. I've noticed that in some topics (including this one) that the replies before the second outage are not included in the total count even though they are still here.
Also, just so everyone's knows, we rebuilt/repaired the database using a method which we believe will prevent the topic table from crashing again. This seems to be an issue atleast once a year with the topic table.
This repair used a new method we had not used in the past and actually rebuilt the index for the topics. There could be some missing posts / topics / reply count - but if it works it is probably worth the minor inconvenience if we stop these crashes from happening every so often.
Wow, little do we realise how much something means to us til its gone!! Some topics show locked such as TamiMcLeods word of the week and Confederate flag issues, along with days worth of posts missing as A Shrule Egan mentioned in Ireland also, Gas Costs and a few others.
USN
--------------------
Be kind, for everyone you meet is fighting a hard battle. Plato(427-347 BC) Philosopher and Educator
Three things in human life are important: The first is to be kind. The second is to be kind. And the third is to be kind. Henry James (1843-1916) Writer
When I was young, I admired clever people. Now that I am old, I admire kind people. -Abraham Joshua Heschel (1907-1972) Theology Professor