Home
JAQForum Ver 19.10.27
Log In or Join  
Active Topics
Local Time 17:46 11 Dec 2019 Privacy Policy
Jump to

Notice. New forum software under development. It's going to miss a few functions and look a bit ugly for a while, but I'm working on it full time now as the old forum was too unstable. Couple days, all good. If you notice any issues, please contact me.

Forum Index : Price Watch : Forum upgrade

     Page 1 of 8    
Author Message
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 07:49am 05 Jul 2019
Copy link to clipboard 
Print this post

The forum code and database is getting old. It was first fired up in 2004, making it 15 years old. It's written in "Classic ASP" which was popular back then, and uses a Access database as the back end storage. Its been heavily modified my me over the years to add security and features.

Been written in ASP means it can only run on Microsoft web servers, which is ok, but not cheap. I've looked at moving to a different forum software system for a few years, preferably in a language with more support and cross platform compatibility, like PHP. But I've not found one that would meet my criteria.

1. I need to import all existing posts and members details.
2. I need to be able to read and modify the code.

So I've kept the old forum and database kicking over. But recently the database is starting to struggle, so something has to happen.

My solution is to write my own forum code from scratch in php, using MySQL to store the data. I've been using php and MySQL for a few years now and its a good combination with more power than ASP and future proof, plus it will run on both Windows and Linux servers.

This will be a slow project, as I earn my living writing code and I can only do a few hours each day before my brain starts to go fuzzy, so the paying jobs come first.

The plan is to build a forum that behaves more or less exactly the same as the old code. Editing posts, uploading images, etc, will be the same. Then once this is done, we can look at adding some features.

At some stage the forum will change to the new code. First thing you will notice is you need to reset your password, as passwords are stored as hash in the database and cant be retreived or copied to the new database. Some features will be missing, like the messenger service or email notifications, but these will all come back online as I write the code. Your old messages will still be there.

When you get a chance, please check the email address in your member settings is correct, you will need this when you reset your password.

Glenn


"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 12:04am 07 Jul 2019
Copy link to clipboard 
Print this post

Making Progress.

Written code to import MSAccess data into MySQL. Lot of records.

Written pages to display forums, topics and posts. Fortunately the forum stored the posts in a HTML format, but a few custom fields like CODE will need work to display like they did in the old forum. Images and attachments are displayed and linked correctly.

Added paging, 20 posts per page. This is important as many posts refer to other posts on page X.

Added code to let member log in.

Added code to reset password. Every member will need to do this. Creates a new password using 10 random characters and emails this to member using their email address from records. Member can then log in and change password ( not written yet ). Passwords are HASH'd, so no way to see what they were.Edited by Gizmo 2019-07-08
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
Chopperp

Guru

Joined: 03/01/2018
Location: Australia
Posts: 529
Posted: 01:18pm 07 Jul 2019
Copy link to clipboard 
Print this post

Oops. Just corrected my incorrect email address.
ChopperP
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 08:27am 08 Jul 2019
Copy link to clipboard 
Print this post

Written code to post a new reply to a thread. Includes converting the forum codes to html. Includes incrementing the members post count and upgrading their standing ( Newbie, Guru, etc ) if they have reached that milestone.

Havn't done the image and file upload bits yet, want to moderise that a bit.

Using the original ASP code as a guideline, but the new PHP code is completely new, dont want to infringe any copyright issues. Even changing database table and column names, and dropping a few unused columns while at it. Also dropped support for Flash, it was never used and is a security issue these days.
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
Geoffg

Guru

Joined: 06/06/2011
Location: Australia
Posts: 2570
Posted: 10:35am 09 Jul 2019
Copy link to clipboard 
Print this post

Wow, huge job Glenn. Thanks a heap, it is much appreciated.

Geoff
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 12:31pm 09 Jul 2019
Copy link to clipboard 
Print this post

Thanks Geoff

Written code to upload images ( jpg, png and gif ) and add watermark. File ( pdf and zip ) uploads also done. Written code to create a new topic.

Next is editing a post, bit more complicated that adding a new post. The forum stores posts as html in the database, so all the forum code tags like [img] are converted to <img src="etc before saving into the database. So to edit a post, these need to be converted back into forum codes.
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
Quazee137

Senior Member

Joined: 07/08/2016
Location: United States
Posts: 262
Posted: 08:16am 10 Jul 2019
Copy link to clipboard 
Print this post



THANKS this is a TON of work and your time. Can you add a donation button at
the log in screen. Helping to keep this the VERY BEST forum I have ever ran
across with some of the nicest and most helpful members.


So very glad that I did find it.

Quazee137
 
poida

Guru

Joined: 02/02/2017
Location: Australia
Posts: 576
Posted: 08:19am 10 Jul 2019
Copy link to clipboard 
Print this post

Good progress in the project, Gizmo.

I work as IT person where I have written and maintain the custom
application we need run everything. It uses mySQL DB as a back end
with an ODBC driver for the MS Access front end.
My skills extend to networking, writing bridging shims to for instance
permit export of mySQL invoice data into Xero (accounting application)
Linux based servers all.
I have php experience too. If I could be of any assistance, PM me.
wronger than a phone book full of wrong phone numbers
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 08:35am 10 Jul 2019
Copy link to clipboard 
Print this post

Thanks Quazee. Yeah once the forum has been ported I'll add a donate button. I've rejected the idea of a donate button for years, but maybe its time to add it.

Thanks Poida. The forum rewrite is just boring old coding stuff, its not difficult, there just a lot to do, which I dont mind. I look at the old ASP pages for idea's, then write the new pages from fresh. The goal is it will function more or less the same as it does now, so members wont need to learn anything. Do you have any experience with creating the export files to import into Reckon ( Quickbooks )? Thats a area I need to take on for another project and might need some help.

No code written today. But good news, I had to get a cancer removed from my nose last week, a BCC. Lots of stitches and a big bill from the doc. Results came back, they got it all and a good margin, so thats a big relief.

Glenn
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
Chopperp

Guru

Joined: 03/01/2018
Location: Australia
Posts: 529
Posted: 11:12am 10 Jul 2019
Copy link to clipboard 
Print this post

Great news Glenn!!! (Site work, Donate Button & especially your nose job)
ChopperP
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 05:04am 13 Jul 2019
Copy link to clipboard 
Print this post

Done the edit post page. Discovered the forum doesn't convert CODE and QUOTE to html before dumping into the database, so wrote the code to display these inline.

Next is improving navigation and then start on the messenger system ( where members message each other ), and then email notifications.

In a few days I'll need a couple of members to test the new code and look for issues. If you could help, please send me a PM.

Glenn
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 10:27pm 14 Jul 2019
Copy link to clipboard 
Print this post

Done email notifications of replies to posts you are watching, and new posts in forums you are watching. Created a page where you can easily manage your notifications.

Next is the messenger. yuk yuk yuk.

yuk yuk yuk!

Glenn
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
radar

Newbie

Joined: 09/06/2019
Location: Australia
Posts: 16
Posted: 12:01pm 15 Jul 2019
Copy link to clipboard 
Print this post

[quote=Gizmo] Do you have any experience with creating the export files to import into Reckon ( Quickbooks )? [/quote]

Hi Gizmo , I have created query's from the mysql> Shell ..

Had been using them to import into earlier QuickBooks Versions .

mysql> select * from database WHERE feild INTO OUTFILE '/tmp/forqb.csv' FIELDS TERMINATED BY ',' ENCLOSED BY '"' ESCAPED BY '"' LINES TERMINATED BY '\r\n';

This was using debian .
This query gives a file compatible to Excel 2003 export to csv .

The resulting file ( /tmp/forqb.csv ) can then be imported to QB's
You may have to format the query to suit . Depending on your version of QB's
and its New line/terminating requirements .

Be shure that you have read write 755 permisions to the output directory and the file
( /tmp/forqb.csv ) ( C:\forqb.csv ) As mysql wont tell you it can't write the file
but complain about your syntax , Go Figure

And from the shell you can use mysqldump ,

radar@access:~# mysqldump -u root -p --tab=/tmp --fields-terminated-by=, --fields-enclosed-by='"' --lines-terminated-by=0x0d0a databasename

From the above command you will get two files output into the /tmp directory databasename.txt databasename.sql the sql contains the database schema .

If you looking for a gui try < phpmyadmin.net > Written in php for administration
of mysql .. Very good tool if you like mysql syntax .

I guess you don't want a commercial solution QuickBooks import - Zed Axis v13

And thank you for all your work on the forum ,
It may be from the earlier days but it stands the test of time .
 
panky

Guru

Joined: 02/10/2012
Location: Australia
Posts: 669
Posted: 12:28pm 26 Jul 2019
Copy link to clipboard 
Print this post

Hi Glenn,

Great job in managing this forum - I would be totally lost without it!

One feature of the old forum that appears to be missing (and that I used extensivly) was the ability to print an entire multi page thread. I used to use this to print pdf's of threads that I needed to continually refer to - the beauty being that I could do so offline.

Is intended for this feature to return?
panky.
... all the Maximites, almost all of the MicromMites, all the MM Extremes, all the ArmMites, and loving it!
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 06:04am 27 Jul 2019
Copy link to clipboard 
Print this post

New forum code has gone live on the 27th July 2019. The new code wasn't ready, but the old forum really was on its last legs and proving very unreliable.

There are a few bugs to sort out, I've set up the site to email error's to me, so I can sort them out. I'll look at bringing features online over the next couple of weeks.

Once these bugs are sorted and the basic features up and working, I can then look at improving the forum with features that were difficult to implement with the old code. For example, a mobile phone friendly version of the forum.

Glenn
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
poida

Guru

Joined: 02/02/2017
Location: Australia
Posts: 576
Posted: 11:21am 27 Jul 2019
Copy link to clipboard 
Print this post

Gizzmo, the site runs faster, and clearly to me it will be more stable.
and far, far more scalable now you are using a proper db back end.

well done.
wronger than a phone book full of wrong phone numbers
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 02:50am 28 Jul 2019
Copy link to clipboard 
Print this post

Thanks

Working through the little bugs members have found, really appreciate the help guys.
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
mackoffgrid

Guru

Joined: 13/03/2017
Location: Australia
Posts: 439
Posted: 07:24am 28 Jul 2019
Copy link to clipboard 
Print this post

I second Peters comment. Its running faster and more stable. Smart move to go to good ol' PHP and mysql. You must be pretty tired by now

cheers
Andrew
 
Gizmo

Admin Group

Joined: 05/06/2004
Location: Australia
Posts: 4729
Posted: 12:17pm 28 Jul 2019
Copy link to clipboard 
Print this post

Thanks Andrew

Still bugs popping up, as expected. I think there are issues with the messenger, will look into these in a couple of days.

Glenn
"Treat the earth well, it was not given to you by your parents, it was lent to you by your children"

JAQ Software
 
wiseguy
Guru

Joined: 21/06/2018
Location: Australia
Posts: 383
Posted: 04:03pm 28 Jul 2019
Copy link to clipboard 
Print this post

Hi Glenn, great job on the site - working faster now.

Strange thing happened tonight though, I got multiple emails ~10 from radar (Neil) and ~ 40 from Madness's reply to neil. And another 8 from Madness's next reply
The two addresses are:

https://www.thebackshed.com/forum/ViewTopic.php?TID=11577&PID=138348#138348
&
https://www.thebackshed.com/forum/ViewTopic.php?TID=10348&P=29
One listed as Forum Index : : Inverter PCB’s
The other as Forum Index : Electronics : Inverter PCB’s

Madness reply to Neil also listed as
Forum Index : : Payment FYI https://www.thebackshed.com/forum/ViewTopic.php?TID=11580

and a later one as
Forum Index : : pcb's FYI https://www.thebackshed.com/forum/ViewTopic.php?TID=11582
But my email subject heading was The Back Shed : pcb''s (not Forum Index : : pcb's)

When I use the search for PCB''s it returns me with PCB''''s
Sorry for the cryptic report but this is what I got !
My notifications arent even set to receive from any of these Topics

Cheers
Mike
I set the email out nice but the preview has it all squished up.
Lastly the private message function when replying to a message doesnt have a "post message" just a "save" (that seems to post the reply)
There's no such thing as gravity - the earth sucks
Cheers Mike
 
     Page 1 of 8    
Print this page
© JAQ Software 2019