Housekeeping

tahanson43206 · 2023-11-22 18:42:22

For SpaceNut re Backup data download.

The share is enabled, and an email should reach you to help with the link.

I'm hoping everything works properly. (th)

SpaceNut · 2023-11-22 19:56:17

Appears login worked and was able to download the zip.
I am looking at the content of the tables and will see what else is needed to further the ability to save as a backup in the future.
Thats all for tonight.

Mars_B4_Moon · 2023-11-25 18:51:06

the phrase 'Test drive Daihatsu midget 62' from a video title was triggering the filter and preventing a post in the Velomobile topic

tahanson43206 · 2023-11-25 19:15:10

For Mars_B4_Moon re #3178

Thanks for reporting the phrase that triggered the Apache Internal Server Error ...

I'm going to paste it here just to see what happens, but I note that the phrase was allowed in Post #3178....

T e s t d r i ve D a i h a t s u m i d g e t 6 2

Amazing! The phrase caused the error ... I have separated the letters to see if it passes that way

If anyone else is willing to try the phrase, just copy it from Post #3178 and (please) report the results here.

it seems to me that if we can repeatedly cause the error, we have a chance of addressing it.

(th)

SpaceNut · 2023-11-25 19:43:31

Trying the phrase
Test drive Daihatsumid get 6 2.

with the number with no space, it gave the error

tahanson43206 · 2023-11-26 21:16:28

For SpaceNut ... the following text generated an Apache Internal Server Error....

*** As a side note ... kbd512 reviewed the program during this evening's Google Meeting, and advised that steel would probably not survive the operating conditions envisioned for this process. The drop down window can be supplemented with a variety of materials.
The rest of the quote was rejected...

Also for SpaceNut .... we (kbd512 coaching) and I were able to configure the MySQL database to accept an ordinary user as having access to the database, in addition to the root user which was needed to load the data from the backup files.

When you are ready, if you need assistance, I have saved the magic command that granted privileges. We found it using Google, so you can find it as well, of course.

(th)

SpaceNut · 2023-11-27 18:01:14

I did get an error with my post after this one
http://newmars.com/forums/viewtopic.php … 81#p216481
Using the back arrow while it returned to the posting window did not set the submit button for being able to send the post. Instead I copied the post and did a refresh and then did the repost and it seemed to work.

tahanson43206 · 2023-11-30 20:11:13

This is a place holder for a possible post.
(th)

Mars_B4_Moon · 2023-12-01 17:14:28

putting u and i code between letters now

I had a post error repeating in the MSR thread NASA warns of “very problematic” space technology budget cuts

Last edited by Mars_B4_Moon (2023-12-01 17:21:46)

tahanson43206 · 2023-12-03 21:51:17

For Mars_B4_Moon ... Re # 3184

Thanks for reporting the incidents of Apache Internal Server Error when they occur!

Our long term direction is to replace the entire forum package with the latest and greatest software. The process is under the careful management of Webmaster kbd512. This evening, after consultation with kbd512 and a bit of homework, I can report that I now have Apache2 calling up php Version 8.1 properly. Last week we got MySQL working with the restored forum database files. There are only two more details to be completed. We need to tie MySQL to Apache and php, and we need to install the fluxbb forum software that kbd512 has modified to run with php version 8.1. I think that connecting MySQL should be fairly straight forward. I think that the ** big ** hurdles are past us in this quest.

PHP Version 8.1.2-1ubuntu2.14

This line of output is one of several hundred lines of output produced by Apache2 when it was given a small php file to process.

(th)

tahanson43206 · 2023-12-05 12:35:15

For SpaceNut re fluxbb forum software replication mini-project ....

Please try to avoid falling too far behind .... you have shown the ability to download the forum data, and to open it for access by spreadsheet software. Today, I have (apparently) completed the homework assignment kbd512 gave me last Sunday during the Google Meeting.

MySQL Server 8.0.35-0ubuntu0.22.04.1connected on Localhost via UNIX socket

That is the output of a test php file, running on Apache2, and accessing a MySQL database chock full of fluxbb forum data.

I ** think ** that all that remains is for kbd512 to upload the forum software that he has modified to run with php Version 8, and for me (or any of the Admins) to download it. it ** should ** just drop into place in the www folder of the Apache2 installation, and begin to run.

It is possible you have taken no further action after completing the database download, unpacking and spreadsheet test.

While the procedure is fresh in my mind, please consider creating your own duplicate environment in Windows.

Update a bit later: the entire system seems to be working ... here is output from a little php script to show two fields from the topics table:

ID: 1
Poster: Lil_vader
Subject: 1000Planets.com - Cool company with big dreams!

(th)

SpaceNut · 2023-12-05 19:07:11

One issue is that a standalone system will need to become a mirror server, which means having the network always on. Something that I do not have at this time.
That still will not stop me from doing what I can do to help as I can keep doing what I can.

tahanson43206 · 2023-12-05 19:17:35

For SpaceNut re #3187

Thanks for noting our progress in building a backup standalone working copy of the running forum system.

Please note that this has ** nothing ** to do with becoming a mirror server! The Mars Society is providing the host services for us.

All we have to do is to (very carefully) learn how to upgrade the software to wherever we want it to be. kbd512 can perform whatever operations are needed at Dreamhost (in collaboration with Executive Director James Burk). We have a long way to go before that happens. If you can put together the hardware to create a development system that is NOT the same as your home system, then you can help with testing of new software as kbd512 introduces it.

We discussed the option of creating a swap drive capability for your system. I recommended a swap drive system that you can install in a 5.25 inch bay of your system, if you have a desk top. An alternative is to use a USB connected external hard drive, which you can plug in when you want to work on the duplicate forum package, if you have a laptop.

I just priced a 250 Gb SSD drive at a local store, and the price is about $40. I make backups of Linux systems using a mirror system, and I'm in the mood to back up the system where the fluxbb database resides now.

(th)

tahanson43206 · 2023-12-07 19:32:21

For SpaceNut ... the output below is from a little script I prepared some time ago... It was designed to run on the fluxbb forum package, but now that I have all the software and the database loaded here at home, I decided to try it.

This is the list of posts that the script reported for Topic #2 in the test database. There are 27 entries, and there should be 12.
The ID's reported do not match the production database. Since this is a test configuration of the forum software, issues are to be expected.
Complete success at every step would be the surprise.

Post ID: 29205 << in production, this is a post in topic #3253
Post ID: 33049 << in production, this is a post in topic #333
Post ID: 33806
Post ID: 35861
Post ID: 55006
Post ID: 57021
Post ID: 57561
Post ID: 58399
Post ID: 60817
Post ID: 61034
Post ID: 64764
Post ID: 65595
Post ID: 65647
Post ID: 65688
Post ID: 65735
Post ID: 68616
Post ID: 71883
Post ID: 72610
Post ID: 72918
Post ID: 74622
Post ID: 94844
Post ID: 97446
Post ID: 111070
Post ID: 123038
Post ID: 144399
Post ID: 145498
Post ID: 152053

(th)

tahanson43206 · 2023-12-07 21:56:42

For SpaceNut .... Houston, we have a problem!

I checked the Post ID's reported in the list above with the actual database.

The numbers do not match. I suspect the gaps in the Post ID's were not preserved during the reload.

Update: In addition, the count of records does not match. It appears we have a bit of work to do.

This is a ** test ** configuration, and it's purpose is to find any issues with our procedures for backing up and restoring the system.

The production database and software are running along fine.

Analysis step on: Examine the production database topic 2:

Index» Other space advocacy organizations» Zero-G Flights for Public

Update later ... I see only 11 items above, so I missed one.

(th)

tahanson43206 · 2023-12-08 08:22:09

For SpaceNut .... here is some preliminary diagnostic data ...

I'd like to be sure the CSV file contains 12 records with 2 in the topic_id field.

I asked ChatGPT4 to create a little Python program to scan the fluxbb_posts.csv file, looking for records with topic_id set to 2.

Here is the output:

python3 findtopic.py
field name eg topic_idtopic_id
value eg 22
Matching record IDs: ['49567', '49571', '49576', '49581', '49672', '49788', '49790', '49800', '49866', '53336', '126676', '185237']

49672 was missing in my manually prepared list above.

So! This means the CSV file is NOT the source of the problem. I suspect my procedure for delivering the records into the empty table is where we will have to look. The lookup program uses a simply MySQL select statement, so it is probably not the cause of the problem.

Here is the code from the program that performed the lookup, if Apache Internal Server Error will permit it:

query('S E L E C T id FROM fluxbb_posts WHERE topic_id='topic_id)

Apache did not like the word s e l e c t in the quoted text. However, that is the code that produces the incorrect result.

An interim guess is that during conversion of the posts table from CSV into the table, the topic_id field was incorrectly handled. That field is out at the far end of the posts record.

(th)

SpaceNut · 2023-12-08 18:15:59

I did take a few minutes at work to look, and you did find the missing post id number, so something might have needed a bit more time in the fetch cycle.

Also, the libre office excel would only partially open the post.csv file as it exceeded the number of cells as well.
Will see if the import function of access is as well overwhelmed.

tahanson43206 · 2023-12-08 20:43:53

For SpaceNut re Database Validation ...

Thanks for your post #3192 ... I appreciate your taking a look at the situation reported earlier! I was happy to see that the CSV file output matched the contents of the production database. That is what it ** should ** have done, but since I am investigating incorrect data in the test database, I wanted to be sure the CSV file was correct.

Now I am undertaking a much more comprehensive validation procedure. I asked ChatGPT(4) for advice, and learned that Python is indeed capable of comparing a CSV file to the loaded database, row by row and column by column. ChatGPT had already had me load the Python library to process CSV files, so now it instructed me to install the MySQL Python library. Here is what that looks like:

pip install mysql-connector-python
Defaulting to user installation because normal site-packages is not writeable
Collecting mysql-connector-python
Downloading mysql_connector_python-8.2.0-cp310-cp310-manylinux_2_17_x86_64.whl (31.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 31.6/31.6 MB 2.7 MB/s eta 0:00:00
Collecting protobuf<=4.21.12,>=4.21.1
Downloading protobuf-4.21.12-cp37-abi3-manylinux2014_x86_64.whl (409 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 409.8/409.8 KB 1.1 MB/s eta 0:00:00
Installing collected packages: protobuf, mysql-connector-python
Successfully installed mysql-connector-python-8.2.0 protobuf-4.21.12

Tomorrow I'll begin the process of comparing all 19 tables to their CSV input files. It will probably take all day, but if there was an error in how I loaded the CSV data into the empty MySQL tables, this procedure should find it.

As a preview of coming attractions ... I suspect the gaps in the loaded data ID fields were not preserved. As you know from following all the work we did last year, there are thousands of gaps in the production database indexes. These were caused by problems with software crashes and recovery, with software updates, and by simple deletions by members, in the ordinary operations of the forum.

If the gaps were not preserved, then none of the links are going to work.

(th)

SpaceNut · 2023-12-09 17:43:21

Sorry that I am not much for posting tonight as my stepfather passed away this morning at 99 years young.

tahanson43206 · 2023-12-09 18:33:05

For SpaceNut re #3184

Best wishes for smooth flow as you make arrangements!

There are a myriad details to take care of, even if you've been prepared!

The world was a different place in 1924! The first radio broadcast from the White House was made by Calvin Coolidge that year, according to Quora.com.

The first flight around the world started in 1924. I got to see one of those US Army Air Service planes in a museum in Los Angeles. The journey took 175 days.

Per Wikipedia:

Beginning in 1957, the New Orleans was displayed at the National Museum of the United States Air Force in Dayton.[28] The aircraft was on loan from the Los Angeles County Museum of Natural History and was returned in 2005.[29] Since February 2012, the New Orleans is a part of the exhibits at the Museum of Flying in Santa Monica, California.[30]

it would have been the New Orleans that I saw.

Your step dad would have grown up in a very exciting and dynamic era but he would have been 17 when the US entered World War II. Did he see action?

According to the National WWII Museum 12,209,238 people were on the roles in 1945. My dad and two of his four brothers were participants. One brother was in the defense industry, making gigantic electric motors.

(th)

tahanson43206 · 2023-12-09 20:20:37

For SpaceNut ... knowing you are busy ... this post is just for the record ...

I took a look at the topics table in the reconstructed MySQL database.

There are 8309 active topics in the production database, and at the time of the data backup, the most recent topic ID was 10613.

I looked for that ID in the topics table, and it showed up, with the correct values. This is encouraging.

I'm still planning to perform a full validation of each table, but my worry that the gaps between Id's might not have been preserved appears not to be justified in the case of the topics table.

This is what the output from the test of the restored topics table looks like:

ID: 10613
Poster: tahanson43206
Subject: Sabatier Process Deserves it's own topic

The value above is a match for the corresponding topic id in the production data base.

(th)

tahanson43206 · 2023-12-10 08:01:17

A Potholes scan is under way ....

216001-217000

ETA 17:00 locat time

(th)

SpaceNut · 2023-12-10 09:31:30

Those data topic id's are in the other server with different folder topic controls.

Here is the wayback machines content for how many times it was crawled.
https://web.archive.org/web/20230000000 … com/forums

At that time the Manned Mars missions / Colonization aka the old Human which was the original had a sub folder of General manned spaceflight These sub folders happened when Impaler was an active user on the web site back in 2010 and at that time Josh Cryer was the Admin and quite possibly may have copies of the backup files to make use of for fill in the topic gaps.

As you can see by the lack of times for given years that we had times when the website was down after it crashed or changed the php formats.

Of course, if James has those different times that the site did crash it's possible to merge them manually from excel tables.

Its been hard but will get through the grieving process.

tahanson43206 · 2023-12-10 13:23:50

For SpaceNut re #3198 - Thanks for the WayBack notes...

Here is output from the validation run I've started. The posts table does not match the CSV file at record ID 971 ...
The program printed out the differences and stopped as requested....

python3 validatetables05.py
csv_path_file_name: /home/tahanson/mysql_archive/fluxbb_posts_202311121532.csv
table name: fluxbb_posts
Mismatch found in record ID 971: Field 'message' -
CSV: version starts here:
'
Why would Mars "undoubtably" pioneer such colonization?
Think about it... when we went to England, did we necessarily build ships that could traverse huge oceans? Of course not... we didn't need to. Just like we don't need to build a large, self sustaining ship to go to Luna. It's a 3 day trip after all! Heck, passive shielding isn't even necessary. A lot of stuff isn't necessary.
Mars is, as I said, the great landmass on the other side of the ocean. Nothing compares to that.
If you learn to live on Mars, you learn the skills neccessary to live in a near vaccume and certain resources that are available on Mars- if you learn to live on Luna, or in free space, with its relative LACK of resources then you can truly live anywhere.
But then, the question is asked, how would you learn to truely live on Luna with Earth a mere quarter million miles away? Luna would clearly have dependency on Earth. Say we get the capablity to survive on Luna without outside resources; there would still be both diplomatic and economic ties to Earth. Everyone would want a piece of the pie. Wouldn't you agree?
Luna has a constant launch window. Mars has one every two years.
Seems starting a new culture on Mars is HARDER than doing the same thing here on Earth.
I thought I was referring to space colonization, and generalizing aspects of society. But if we were to break it down, obviously it is harder to have one society within the other. ####, almost every #### war is based on societies clashing.
:\
How do you establish this assertion?
It's not self evident? Culture doesn't exclude government, but government isn't generalized enough to cover all the necessary by-products. New lifestyles where people wear space suits every day, or build new kinds of waste reclamation facilities would be cultural, not governmental.
Is this illogical?
It's like expecting the man that holds you hostage will save your life because you ask him to.
I see absolutely no correlation there. Robert Zubrin is constantly saying that self sustenance is necessary. Once you are self sustaining, there is absolutely nothing anyone can do from the outside. Especially when you have a two year launch window!
Mars really offers nothing to anyone except a new place to live. You could make the same claim about Luna, but Luna is still arguably within grasp of anyone who wishes to control.
And Bill, I agree that that would be very ironic! In many ways I hope history pans out that way. But we'll have to see.
On a depressing note, it seems as though American interest in Space is at a 5 year low... so... yeah...'
*** Database version starts here
| DB: '
Why would Mars "undoubtably" pioneer such colonization?
Think about it... when we went to England, did we necessarily build ships that could traverse huge oceans? Of course not... we didn't need to. Just like we don't need to build a large, self sustaining ship to go to Luna. It's a 3 day trip after all! Heck, passive shielding isn't even necessary. A lot of stuff isn't necessary.
Mars is, as I said, the great landmass on the other side of the ocean. Nothing compares to that.
If you learn to live on Mars, you learn the skills neccessary to live in a near vaccume and certain resources that are available on Mars- if you learn to live on Luna, or in free space, with its relative LACK of resources then you can truly live anywhere.
But then, the question is asked, how would you learn to truely live on Luna with Earth a mere quarter million miles away? Luna would clearly have dependency on Earth. Say we get the capablity to survive on Luna without outside resources; there would still be both diplomatic and economic ties to Earth. Everyone would want a piece of the pie. Wouldn't you agree?
Luna has a constant launch window. Mars has one every two years.
Seems starting a new culture on Mars is HARDER than doing the same thing here on Earth.
I thought I was referring to space colonization, and generalizing aspects of society. But if we were to break it down, obviously it is harder to have one society within the other. ####, almost every #### war is based on societies clashing.
:
How do you establish this assertion?
It's not self evident? Culture doesn't exclude government, but government isn't generalized enough to cover all the necessary by-products. New lifestyles where people wear space suits every day, or build new kinds of waste reclamation facilities would be cultural, not governmental.
Is this illogical?
It's like expecting the man that holds you hostage will save your life because you ask him to.
I see absolutely no correlation there. Robert Zubrin is constantly saying that self sustenance is necessary. Once you are self sustaining, there is absolutely nothing anyone can do from the outside. Especially when you have a two year launch window!
Mars really offers nothing to anyone except a new place to live. You could make the same claim about Luna, but Luna is still arguably within grasp of anyone who wishes to control.
And Bill, I agree that that would be very ironic! In many ways I hope history pans out that way. But we'll have to see.
On a depressing note, it seems as though American interest in Space is at a 5 year low... so... yeah...'
Mismatch found. Stopped after validating 981 rows.
tahanson@tom-GA-78LMT-01:~/mysql_archive$

(th)

SpaceNut · 2023-12-10 19:33:43

That post is from the early days of the IKON software as its from 2002. At that time Josh cryer was an admin. and I was just a blink on the horizon as I had not joined yet.

The post has an artifact that is not one of the current smiles

https://en.wikipedia.org/wiki/List_of_emoticons

New Mars Forums

Announcement

#3176 2023-11-22 18:42:22

Re: Housekeeping

#3177 2023-11-22 19:56:17

Re: Housekeeping

#3178 2023-11-25 18:51:06

Re: Housekeeping

#3179 2023-11-25 19:15:10

Re: Housekeeping

#3180 2023-11-25 19:43:31

Re: Housekeeping

#3181 2023-11-26 21:16:28

Re: Housekeeping

#3182 2023-11-27 18:01:14

Re: Housekeeping

#3183 2023-11-30 20:11:13

Re: Housekeeping

#3184 2023-12-01 17:14:28

Re: Housekeeping

#3185 2023-12-03 21:51:17

Re: Housekeeping

#3186 2023-12-05 12:35:15

Re: Housekeeping

#3187 2023-12-05 19:07:11

Re: Housekeeping

#3188 2023-12-05 19:17:35

Re: Housekeeping

#3189 2023-12-07 19:32:21

Re: Housekeeping

#3190 2023-12-07 21:56:42

Re: Housekeeping

#3191 2023-12-08 08:22:09

Re: Housekeeping

#3192 2023-12-08 18:15:59

Re: Housekeeping

#3193 2023-12-08 20:43:53

Re: Housekeeping

#3194 2023-12-09 17:43:21

Re: Housekeeping

#3195 2023-12-09 18:33:05

Re: Housekeeping

#3196 2023-12-09 20:20:37

Re: Housekeeping

#3197 2023-12-10 08:01:17

Re: Housekeeping

#3198 2023-12-10 09:31:30

Re: Housekeeping

#3199 2023-12-10 13:23:50

Re: Housekeeping

#3200 2023-12-10 19:33:43

Re: Housekeeping

Board footer