Menu
JAQForum Ver 19.10.27

Forum Index : Microcontroller and PC projects : Forum upgrade

   Page 1 of 15    
Posted: 07:49am
05 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


The forum code and database is getting old. It was first fired up in 2004, making it 15 years old. It's written in "Classic ASP" which was popular back then, and uses a Access database as the back end storage. Its been heavily modified my me over the years to add security and features.

Been written in ASP means it can only run on Microsoft web servers, which is ok, but not cheap. I've looked at moving to a different forum software system for a few years, preferably in a language with more support and cross platform compatibility, like PHP. But I've not found one that would meet my criteria.

1. I need to import all existing posts and members details.
2. I need to be able to read and modify the code.

So I've kept the old forum and database kicking over. But recently the database is starting to struggle, so something has to happen.

My solution is to write my own forum code from scratch in php, using MySQL to store the data. I've been using php and MySQL for a few years now and its a good combination with more power than ASP and future proof, plus it will run on both Windows and Linux servers.

This will be a slow project, as I earn my living writing code and I can only do a few hours each day before my brain starts to go fuzzy, so the paying jobs come first.

The plan is to build a forum that behaves more or less exactly the same as the old code. Editing posts, uploading images, etc, will be the same. Then once this is done, we can look at adding some features.

At some stage the forum will change to the new code. First thing you will notice is you need to reset your password, as passwords are stored as hash in the database and cant be retreived or copied to the new database. Some features will be missing, like the messenger service or email notifications, but these will all come back online as I write the code. Your old messages will still be there.

When you get a chance, please check the email address in your member settings is correct, you will need this when you reset your password.

Glenn


The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 12:04am
07 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Making Progress.

Written code to import MSAccess data into MySQL. Lot of records.

Written pages to display forums, topics and posts. Fortunately the forum stored the posts in a HTML format, but a few custom fields like CODE will need work to display like they did in the old forum. Images and attachments are displayed and linked correctly.

Added paging, 20 posts per page. This is important as many posts refer to other posts on page X.

Added code to let member log in.

Added code to reset password. Every member will need to do this. Creates a new password using 10 random characters and emails this to member using their email address from records. Member can then log in and change password ( not written yet ). Passwords are HASH'd, so no way to see what they were.Edited by Gizmo 2019-07-08
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 01:18pm
07 Jul 2019
Copy link to clipboard
Chopperp
Guru


Oops. Just corrected my incorrect email address.
ChopperP
 
Posted: 08:27am
08 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Written code to post a new reply to a thread. Includes converting the forum codes to html. Includes incrementing the members post count and upgrading their standing ( Newbie, Guru, etc ) if they have reached that milestone.

Havn't done the image and file upload bits yet, want to moderise that a bit.

Using the original ASP code as a guideline, but the new PHP code is completely new, dont want to infringe any copyright issues. Even changing database table and column names, and dropping a few unused columns while at it. Also dropped support for Flash, it was never used and is a security issue these days.
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 10:35am
09 Jul 2019
Copy link to clipboard
Geoffg
Guru


Wow, huge job Glenn. Thanks a heap, it is much appreciated.

Geoff
 
Posted: 12:31pm
09 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Thanks Geoff

Written code to upload images ( jpg, png and gif ) and add watermark. File ( pdf and zip ) uploads also done. Written code to create a new topic.

Next is editing a post, bit more complicated that adding a new post. The forum stores posts as html in the database, so all the forum code tags like [img] are converted to <img src="etc before saving into the database. So to edit a post, these need to be converted back into forum codes.
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 08:16am
10 Jul 2019
Copy link to clipboard
Quazee137
Guru




THANKS this is a TON of work and your time. Can you add a donation button at
the log in screen. Helping to keep this the VERY BEST forum I have ever ran
across with some of the nicest and most helpful members.


So very glad that I did find it.

Quazee137
 
Posted: 08:19am
10 Jul 2019
Copy link to clipboard
poida
Guru


Good progress in the project, Gizmo.

I work as IT person where I have written and maintain the custom
application we need run everything. It uses mySQL DB as a back end
with an ODBC driver for the MS Access front end.
My skills extend to networking, writing bridging shims to for instance
permit export of mySQL invoice data into Xero (accounting application)
Linux based servers all.
I have php experience too. If I could be of any assistance, PM me.
wronger than a phone book full of wrong phone numbers
 
Posted: 08:35am
10 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Thanks Quazee. Yeah once the forum has been ported I'll add a donate button. I've rejected the idea of a donate button for years, but maybe its time to add it.

Thanks Poida. The forum rewrite is just boring old coding stuff, its not difficult, there just a lot to do, which I dont mind. I look at the old ASP pages for idea's, then write the new pages from fresh. The goal is it will function more or less the same as it does now, so members wont need to learn anything. Do you have any experience with creating the export files to import into Reckon ( Quickbooks )? Thats a area I need to take on for another project and might need some help.

No code written today. But good news, I had to get a cancer removed from my nose last week, a BCC. Lots of stitches and a big bill from the doc. Results came back, they got it all and a good margin, so thats a big relief.

Glenn
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 11:12am
10 Jul 2019
Copy link to clipboard
Chopperp
Guru


Great news Glenn!!! (Site work, Donate Button & especially your nose job)
ChopperP
 
Posted: 05:04am
13 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Done the edit post page. Discovered the forum doesn't convert CODE and QUOTE to html before dumping into the database, so wrote the code to display these inline.

Next is improving navigation and then start on the messenger system ( where members message each other ), and then email notifications.

In a few days I'll need a couple of members to test the new code and look for issues. If you could help, please send me a PM.

Glenn
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 10:27pm
14 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Done email notifications of replies to posts you are watching, and new posts in forums you are watching. Created a page where you can easily manage your notifications.

Next is the messenger. yuk yuk yuk.

yuk yuk yuk!

Glenn
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 12:01pm
15 Jul 2019
Copy link to clipboard
radar
Newbie


[quote=Gizmo] Do you have any experience with creating the export files to import into Reckon ( Quickbooks )? [/quote]

Hi Gizmo , I have created query's from the mysql> Shell ..

Had been using them to import into earlier QuickBooks Versions .

mysql> select * from database WHERE feild INTO OUTFILE '/tmp/forqb.csv' FIELDS TERMINATED BY ',' ENCLOSED BY '"' ESCAPED BY '"' LINES TERMINATED BY '\r\n';

This was using debian .
This query gives a file compatible to Excel 2003 export to csv .

The resulting file ( /tmp/forqb.csv ) can then be imported to QB's
You may have to format the query to suit . Depending on your version of QB's
and its New line/terminating requirements .

Be shure that you have read write 755 permisions to the output directory and the file
( /tmp/forqb.csv ) ( C:\forqb.csv ) As mysql wont tell you it can't write the file
but complain about your syntax , Go Figure

And from the shell you can use mysqldump ,

radar@access:~# mysqldump -u root -p --tab=/tmp --fields-terminated-by=, --fields-enclosed-by='"' --lines-terminated-by=0x0d0a databasename

From the above command you will get two files output into the /tmp directory databasename.txt databasename.sql the sql contains the database schema .

If you looking for a gui try < phpmyadmin.net > Written in php for administration
of mysql .. Very good tool if you like mysql syntax .

I guess you don't want a commercial solution QuickBooks import - Zed Axis v13

And thank you for all your work on the forum ,
It may be from the earlier days but it stands the test of time .
 
Posted: 12:28pm
26 Jul 2019
Copy link to clipboard
panky
Guru


Hi Glenn,

Great job in managing this forum - I would be totally lost without it!

One feature of the old forum that appears to be missing (and that I used extensivly) was the ability to print an entire multi page thread. I used to use this to print pdf's of threads that I needed to continually refer to - the beauty being that I could do so offline.

Is intended for this feature to return?
panky.
... almost all of the Maximites, the MicromMites, the MM Extremes, the ArmMites, the PicoMite and loving it!
 
Posted: 06:04am
27 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


New forum code has gone live on the 27th July 2019. The new code wasn't ready, but the old forum really was on its last legs and proving very unreliable.

There are a few bugs to sort out, I've set up the site to email error's to me, so I can sort them out. I'll look at bringing features online over the next couple of weeks.

Once these bugs are sorted and the basic features up and working, I can then look at improving the forum with features that were difficult to implement with the old code. For example, a mobile phone friendly version of the forum.

Glenn
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 11:21am
27 Jul 2019
Copy link to clipboard
poida
Guru


Gizzmo, the site runs faster, and clearly to me it will be more stable.
and far, far more scalable now you are using a proper db back end.

well done.
wronger than a phone book full of wrong phone numbers
 
Posted: 02:50am
28 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Thanks

Working through the little bugs members have found, really appreciate the help guys.
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 07:24am
28 Jul 2019
Copy link to clipboard
mackoffgrid
Guru


I second Peters comment. Its running faster and more stable. Smart move to go to good ol' PHP and mysql. You must be pretty tired by now

cheers
Andrew
 
Posted: 12:17pm
28 Jul 2019
Copy link to clipboard
Gizmo
Admin Group


Thanks Andrew

Still bugs popping up, as expected. I think there are issues with the messenger, will look into these in a couple of days.

Glenn
The best time to plant a tree was twenty years ago, the second best time is right now.
JAQ
 
Posted: 04:03pm
28 Jul 2019
Copy link to clipboard
wiseguy
Guru


Hi Glenn, great job on the site - working faster now.

Strange thing happened tonight though, I got multiple emails ~10 from radar (Neil) and ~ 40 from Madness's reply to neil. And another 8 from Madness's next reply
The two addresses are:

https://www.thebackshed.com/forum/ViewTopic.php?TID=11577&PID=138348#138348
&
https://www.thebackshed.com/forum/ViewTopic.php?TID=10348&P=29
One listed as Forum Index : : Inverter PCB’s
The other as Forum Index : Electronics : Inverter PCB’s

Madness reply to Neil also listed as
Forum Index : : Payment FYI https://www.thebackshed.com/forum/ViewTopic.php?TID=11580

and a later one as
Forum Index : : pcb's FYI https://www.thebackshed.com/forum/ViewTopic.php?TID=11582
But my email subject heading was The Back Shed : pcb''s (not Forum Index : : pcb's)

When I use the search for PCB''s it returns me with PCB''''s
Sorry for the cryptic report but this is what I got !
My notifications arent even set to receive from any of these Topics

Cheers
Mike
I set the email out nice but the preview has it all squished up.
Lastly the private message function when replying to a message doesnt have a "post message" just a "save" (that seems to post the reply)
If at first you dont succeed, I suggest you avoid sky diving....
Cheers Mike
 
   Page 1 of 15    
© JAQ Software 2024