For those interested, another small glimpse into ongoing forum administration, behind the scenes.
Since the forum went online on 30-Nov-2008, we have performed regular backups of the forum database. The ONE exception to this was the first 7 months or so of the forum, back in the first half of 2009, when I DID NOT make any backups. And when the forum's hosting company, 1&1, deleted the forum files from their server accidentally, around the 4th of July 2009, I didn't have a current backup to reconstruct the first six months or so of forum posts.
I was able to reconstruct some forum posts and threads (perhaps 15-20% of them) from Google's cache over the next week or so, but sadly we had to start from scratch on July 5 with a new database. From that point onward, I made regular backups.
When the forum moved, in Feb/March 2019, to a true Virtual Machine setup, and we migrated the software from vBulletin to XenForo, which is 100% administered by myself, I set up an Ubuntu "cron job" for daily, automated backups of the forum database. In addition to this, the company that provides the VM server, Linode (now part of Akamai) based in Philadelphia, also provides daily backups of the entire Virtual Machine and retains snapshots going back a day, a week, and up to a month.
In addition, I also every Sunday morning do a manual "snapshot" backup of the server. I often also invoke a manual snapshot backup of the entire server immediately before any major software upgrade, as a restore point in case something goes haywire. And since 2019, I've had to restore from these manual "snapshots" about 8-10 times when something did go wrong. It takes about 30-40 minutes to do a full restore from the snapshot, after wiping the server clean.
The Linode backups are a paid "extra" service, but only $5.00 a month for a lot of peace of mind.
Anyway, here are a few screen shots from my computer that show database backups stored. I have stored EVERY SINGLE BACKUP ever made of the database, since July 2009. As two extra layers of security, ALL of these historic database backups are continuously backed up to the cloud via Backblaze.com, and also to a local, attached external hard drive sitting next to my computer via Apple's "Time Machine" backup functionality.
Here are the very first backups I have on hand, from July 2009. Notice the first forum header image (the JPG file "site_logo_1.jpg"), which dates from May 2008. This is when I first started setting up the forum. It was all set up and ready to go by the end of June 2008, ready and waiting to see if 500Ecstasy was going to solve its problems and come back online (or not). I moved from Portland to Houston in August/Sept. 2008, and after getting settled there, and determining that 500Ecstasy was not going to be reliable from that point forward (i.e. likely to go down for good at some point), I fired up the dormant forum, and it went online on the evening of November 30, 2008.
You can see a very initial backup on December 3, 2008 .... just four days after the forum officially came online. There weren't many posts at that point, and so the forum's database was only 117K compressed (probably about 400K uncompressed) !!
Here are the last backups done with the "vBulletin" software, and the very first backups done with the "new" XenForo forum. Note that I named the final manual backup of the vBulletin database "VB_backup_3-14-2019" just in case I needed to revert back to vBulletin for some reason. The actual changeover to the new XenForo software was 3-9-2019. You can see that I did SEVERAL backups of the new forum database after the changeover was completed.
You can see the first file in the listing below, an uncompressed database, was 494.5MB in size, and 126.2MB compressed. That's quite a bit of growth from the 117K of the very first database backup in the previous image!!!
In the image below, you can see the databases BEFORE the switch to XenForo. Before we converted it (the new forum was EMPTY) as of March 9th, the XenForo database was 4-5MB in size. The next backup, after the switch from vBulletin to XenForo, was 93.6MB!
So interestingly, the database LOST size (didn't lose any data) when we converted from vBulletin to XenForo, going from 126.2MB in size with vBulletin down to 93.6MB with XenForo.
And now you can see the latest XenForo database backup (I move the accumulated backups from my local hard drive to the external drive on a quarterly basis) stored on the external drive, from December 28th, now at 231.2 MB. Uncompressed that would probably be somewhere around 800MB-1GB in size.
And here is a view of the Linode administration console, showing the automatic backups via its server backup service that I pay extra for. It has the latest backups, plus snapshots from the past two weeks, PLUS the manual snapshot that I run every Sunday (or when a major upgrade is going to happen):
And lastly......here is the Ubuntu console that shows the daily database backups (created automatically via the aforementioned
"cron job") that are preserved on the 500Eboard server. It keeps EIGHT DAYS of daily backups, and automatically deletes the oldest database backup file when the latest backup is completed.
Thought you all would be interested to see this glimpse of how the forum retains its data, using multiple levels of redundancy so that we NEVER lose data again. The July 4th 2008 data loss taught me a lesson that I have never forgotten. Fortunately that time was very early in the forum's existence, so there was no major data loss. It would be catastrophic to lose the 17+ years of accumulated information that we now have on this forum !!!