Forum upgrade
Author | Message | ||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
The forum code and database is getting old. It was first fired up in 2004, making it 15 years old. It's written in "Classic ASP" which was popular back then, and uses a Access database as the back end storage. Its been heavily modified my me over the years to add security and features. Been written in ASP means it can only run on Microsoft web servers, which is ok, but not cheap. I've looked at moving to a different forum software system for a few years, preferably in a language with more support and cross platform compatibility, like PHP. But I've not found one that would meet my criteria. 1. I need to import all existing posts and members details. 2. I need to be able to read and modify the code. So I've kept the old forum and database kicking over. But recently the database is starting to struggle, so something has to happen. My solution is to write my own forum code from scratch in php, using MySQL to store the data. I've been using php and MySQL for a few years now and its a good combination with more power than ASP and future proof, plus it will run on both Windows and Linux servers. This will be a slow project, as I earn my living writing code and I can only do a few hours each day before my brain starts to go fuzzy, so the paying jobs come first. The plan is to build a forum that behaves more or less exactly the same as the old code. Editing posts, uploading images, etc, will be the same. Then once this is done, we can look at adding some features. At some stage the forum will change to the new code. First thing you will notice is you need to reset your password, as passwords are stored as hash in the database and cant be retreived or copied to the new database. Some features will be missing, like the messenger service or email notifications, but these will all come back online as I write the code. Your old messages will still be there. When you get a chance, please check the email address in your member settings is correct, you will need this when you reset your password. Glenn The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Making Progress. Written code to import MSAccess data into MySQL. Lot of records. Written pages to display forums, topics and posts. Fortunately the forum stored the posts in a HTML format, but a few custom fields like CODE will need work to display like they did in the old forum. Images and attachments are displayed and linked correctly. Added paging, 20 posts per page. This is important as many posts refer to other posts on page X. Added code to let member log in. Added code to reset password. Every member will need to do this. Creates a new password using 10 random characters and emails this to member using their email address from records. Member can then log in and change password ( not written yet ). Passwords are HASH'd, so no way to see what they were. The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
Chopperp Guru Joined: 03/01/2018 Location: AustraliaPosts: 1064 |
Oops. Just corrected my incorrect email address. ChopperP |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Written code to post a new reply to a thread. Includes converting the forum codes to html. Includes incrementing the members post count and upgrading their standing ( Newbie, Guru, etc ) if they have reached that milestone. Havn't done the image and file upload bits yet, want to moderise that a bit. Using the original ASP code as a guideline, but the new PHP code is completely new, dont want to infringe any copyright issues. Even changing database table and column names, and dropping a few unused columns while at it. Also dropped support for Flash, it was never used and is a security issue these days. The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
Geoffg Guru Joined: 06/06/2011 Location: AustraliaPosts: 3211 |
Wow, huge job Glenn. Thanks a heap, it is much appreciated. Geoff |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Thanks Geoff Written code to upload images ( jpg, png and gif ) and add watermark. File ( pdf and zip ) uploads also done. Written code to create a new topic. Next is editing a post, bit more complicated that adding a new post. The forum stores posts as html in the database, so all the forum code tags like [img] are converted to <img src="etc before saving into the database. So to edit a post, these need to be converted back into forum codes. The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
Quazee137 Guru Joined: 07/08/2016 Location: United StatesPosts: 576 |
THANKS this is a TON of work and your time. Can you add a donation button at the log in screen. Helping to keep this the VERY BEST forum I have ever ran across with some of the nicest and most helpful members. So very glad that I did find it. Quazee137 |
||||
poida Guru Joined: 02/02/2017 Location: AustraliaPosts: 1424 |
Good progress in the project, Gizmo. I work as IT person where I have written and maintain the custom application we need run everything. It uses mySQL DB as a back end with an ODBC driver for the MS Access front end. My skills extend to networking, writing bridging shims to for instance permit export of mySQL invoice data into Xero (accounting application) Linux based servers all. I have php experience too. If I could be of any assistance, PM me. wronger than a phone book full of wrong phone numbers |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Thanks Quazee. Yeah once the forum has been ported I'll add a donate button. I've rejected the idea of a donate button for years, but maybe its time to add it. Thanks Poida. The forum rewrite is just boring old coding stuff, its not difficult, there just a lot to do, which I dont mind. I look at the old ASP pages for idea's, then write the new pages from fresh. The goal is it will function more or less the same as it does now, so members wont need to learn anything. Do you have any experience with creating the export files to import into Reckon ( Quickbooks )? Thats a area I need to take on for another project and might need some help. No code written today. But good news, I had to get a cancer removed from my nose last week, a BCC. Lots of stitches and a big bill from the doc. Results came back, they got it all and a good margin, so thats a big relief. Glenn The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
Chopperp Guru Joined: 03/01/2018 Location: AustraliaPosts: 1064 |
Great news Glenn!!! (Site work, Donate Button & especially your nose job) ChopperP |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Done the edit post page. Discovered the forum doesn't convert CODE and QUOTE to html before dumping into the database, so wrote the code to display these inline. Next is improving navigation and then start on the messenger system ( where members message each other ), and then email notifications. In a few days I'll need a couple of members to test the new code and look for issues. If you could help, please send me a PM. Glenn The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Done email notifications of replies to posts you are watching, and new posts in forums you are watching. Created a page where you can easily manage your notifications. Next is the messenger. yuk yuk yuk. yuk yuk yuk! Glenn The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
radar Newbie Joined: 09/06/2019 Location: AustraliaPosts: 16 |
[quote=Gizmo] Do you have any experience with creating the export files to import into Reckon ( Quickbooks )? [/quote] Hi Gizmo , I have created query's from the mysql> Shell .. Had been using them to import into earlier QuickBooks Versions . mysql> select * from database WHERE feild INTO OUTFILE '/tmp/forqb.csv' FIELDS TERMINATED BY ',' ENCLOSED BY '"' ESCAPED BY '"' LINES TERMINATED BY '\r\n'; This was using debian . This query gives a file compatible to Excel 2003 export to csv . The resulting file ( /tmp/forqb.csv ) can then be imported to QB's You may have to format the query to suit . Depending on your version of QB's and its New line/terminating requirements . Be shure that you have read write 755 permisions to the output directory and the file ( /tmp/forqb.csv ) ( C:\forqb.csv ) As mysql wont tell you it can't write the file but complain about your syntax , Go Figure And from the shell you can use mysqldump , radar@access:~# mysqldump -u root -p --tab=/tmp --fields-terminated-by=, --fields-enclosed-by='"' --lines-terminated-by=0x0d0a databasename From the above command you will get two files output into the /tmp directory databasename.txt databasename.sql the sql contains the database schema . If you looking for a gui try < phpmyadmin.net > Written in php for administration of mysql .. Very good tool if you like mysql syntax . I guess you don't want a commercial solution QuickBooks import - Zed Axis v13 And thank you for all your work on the forum , It may be from the earlier days but it stands the test of time . |
||||
panky Guru Joined: 02/10/2012 Location: AustraliaPosts: 1101 |
Hi Glenn, Great job in managing this forum - I would be totally lost without it! One feature of the old forum that appears to be missing (and that I used extensivly) was the ability to print an entire multi page thread. I used to use this to print pdf's of threads that I needed to continually refer to - the beauty being that I could do so offline. Is intended for this feature to return? panky. ... almost all of the Maximites, the MicromMites, the MM Extremes, the ArmMites, the PicoMite and loving it! |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
New forum code has gone live on the 27th July 2019. The new code wasn't ready, but the old forum really was on its last legs and proving very unreliable. There are a few bugs to sort out, I've set up the site to email error's to me, so I can sort them out. I'll look at bringing features online over the next couple of weeks. Once these bugs are sorted and the basic features up and working, I can then look at improving the forum with features that were difficult to implement with the old code. For example, a mobile phone friendly version of the forum. Glenn The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
poida Guru Joined: 02/02/2017 Location: AustraliaPosts: 1424 |
Gizzmo, the site runs faster, and clearly to me it will be more stable. and far, far more scalable now you are using a proper db back end. well done. wronger than a phone book full of wrong phone numbers |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Thanks Working through the little bugs members have found, really appreciate the help guys. The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
mackoffgrid Guru Joined: 13/03/2017 Location: AustraliaPosts: 460 |
I second Peters comment. Its running faster and more stable. Smart move to go to good ol' PHP and mysql. You must be pretty tired by now cheers Andrew |
||||
Gizmo Admin Group Joined: 05/06/2004 Location: AustraliaPosts: 5078 |
Thanks Andrew Still bugs popping up, as expected. I think there are issues with the messenger, will look into these in a couple of days. Glenn The best time to plant a tree was twenty years ago, the second best time is right now. JAQ |
||||
wiseguy Guru Joined: 21/06/2018 Location: AustraliaPosts: 1156 |
Hi Glenn, great job on the site - working faster now. Strange thing happened tonight though, I got multiple emails ~10 from radar (Neil) and ~ 40 from Madness's reply to neil. And another 8 from Madness's next reply The two addresses are: https://www.thebackshed.com/forum/ViewTopic.php?TID=11577&PID=138348#138348 & https://www.thebackshed.com/forum/ViewTopic.php?TID=10348&P=29 One listed as Forum Index : : Inverter PCB’s The other as Forum Index : Electronics : Inverter PCB’s Madness reply to Neil also listed as Forum Index : : Payment FYI https://www.thebackshed.com/forum/ViewTopic.php?TID=11580 and a later one as Forum Index : : pcb's FYI https://www.thebackshed.com/forum/ViewTopic.php?TID=11582 But my email subject heading was The Back Shed : pcb''s (not Forum Index : : pcb's) When I use the search for PCB''s it returns me with PCB''''s Sorry for the cryptic report but this is what I got ! My notifications arent even set to receive from any of these Topics Cheers Mike I set the email out nice but the preview has it all squished up. Lastly the private message function when replying to a message doesnt have a "post message" just a "save" (that seems to post the reply) If at first you dont succeed, I suggest you avoid sky diving.... Cheers Mike |
||||