New Mars Forums

Official discussion forum of The Mars Society and MarsNews.com

You are not logged in.

Announcement

Announcement: As a reader of NewMars forum, we have opportunities for you to assist with technical discussions in several initiatives underway. NewMars needs volunteers with appropriate education, skills, talent, motivation and generosity of spirit as a highly valued member. Write to newmarsmember * gmail.com to tell us about your ability's to help contribute to NewMars and become a registered member.

#1 2023-08-08 08:56:54

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,198

Backup NewMars Using Text

In July of 2023, the NewMars site went down for an extended period.

Thanks to work by kbd512 and with the assistance of James Burk of the Mars Society, the site was brought back online.

During the outage, there was an opportunity to consider what it would take to preserve the site with simple text files.

I have begun an experiment to collect topics.  The resulting data files appear to contain everything that is needed to rebuild the site.

The Index level is included in the capture.
The topic title is included in the capture.
The user ID is captured, as well as date and time of the original post and the status of the the member

What the preliminary/experimental tests do NOT appear to do is to capture the full text of URLs.  To capture those, the Quote feature would appear to be required.

I'm planning to post the capture files on Dropbox, so anyone who might care to work on a website recovery project may do so.

It appears that anyone can create the software configuration needed to support the web site:

Apache web server
MySQL database
php runtime
phpBB forum package

What is needed is software able to pull needed data from the capture logs, and recreate the original posts in a new, empty database.

That software needs to be able to read text files, extract needed data, and write properly formatted commands to the MySQL database.

For each post to be stored, the program must confirm:
1) Index level exists and create it if needed
2) Topic title exists and create it if needed
3) User ID exists and create it if needed

Original post date and time can be preserved as a line of data in the reproduced post. 

(th)

Offline

#2 2023-08-08 09:23:29

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,198

Re: Backup NewMars Using Text

This is a test to confirm that the Quote command can pickup detail of URL's.  An additional confirmation is that a Quote can capture posts by an administrator, which means that a capture procedure run by a moderator can capture the contents of posts by an administrator.  My working assumption is that the protections built into the forum software will carry over, if posts are properly added to the empty database as having ownership by the User ID of record.

SpaceNut wrote:

I have lots to catch up on for these and many other topics.

Energy-storing concrete could form foundations for solar-powered homes

(th)

Offline

#3 2023-08-08 11:32:34

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,198

Re: Backup NewMars Using Text

This is for kb512....

Here is the query to collect all the posts in a topic:
https://newmars.com/forums/viewtopic.php?id=10545

If you still have webmaster privileges, please see if you can create a version of that query that only delivers the post ID's for a topic.

having the post ID's is much more efficient for the process of performing "Quote" on each post.

This is what the URL for a quote looks like:
https://newmars.com/forums/post.php?tid … qid=212321

The query appears to use both the topic ID and the Post ID to find the right post to show.

(th)

Offline

#4 2023-08-08 11:44:47

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,198

Re: Backup NewMars Using Text

Here is a link to the first test capture of topic 1 through 3:

https://www.dropbox.com/scl/fi/imeizq2y … ocdvc&dl=0

The format of the capture log can be improved to help programmers generate MySQL insert commands.

On the other hand, everything needed may already be present.  This is a simple capture of the web page for a topic.  The next version of capture will include quotes of posts, in order to collect the detail of URL's that are abbreviated by FluxBB for display on the screen.

(th)

Offline

#5 2023-08-08 20:37:02

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 28,891

Re: Backup NewMars Using Text

I noticed that the page had the Atom topic link, and it outputted what appears to be some of the html code for the page rendering.

It has all of the markings for the posts that are present before this one.

Offline

#6 2023-08-09 06:18:28

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 17,198

Re: Backup NewMars Using Text

For SpaceNut .... your observations about the Atom feed inspired me to see what it is...

It appears to be an RSS subscription service.... apparently someone can point an RSS Reader at the link, and the new posts in the forum will be delivered automatically to the reader.

I've never used such a service, so I don't have any experience with it.  However, it occurs to me that it might have provided the high quality backup that kdb512 was talking about, if someone had subscribed to the feed over the years it has been available.

Per Google:

About 11,700,000 results (0.38 seconds)
How to subscribe to RSS (Atom) Feeds
Click the website Atom (RSS) feed icon you want to subscribe to.
Click the 'subscribe to this feed' link in the yellow-shaded box.
Click Subscribe in the dialog box.
Jul 1, 2022

How to subscribe to RSS (Atom) Feeds
Queensland Legislation
https://www.legislation.qld.gov.au › help › rss-how
About featured snippets

Feedback

How to Subscribe to or Read RSS or ATOM News Feeds
The Site Wizard
https://www.thesitewizard.com › faqs › howtoreadsitef...
Apr 9, 2018 — To "subscribe" to a site feed, whether RSS or ATOM, you need a feed reader. Simply point the reader to the URL (address) of the site feed, ...
People also ask
How do I subscribe to a web feed?
How do I subscribe to an RSS feed in Chrome?
How to use Atom RSS?
What is the difference between RSS feed and Atom feed?
Feedback

FAQs on How to subscribe and read RSS and ATOM feeds

Brigitte Schuster
https://brigitteschuster.com › faq-rss-atom
Subscription is easy and free. There are several ways to subscribe to RSS or Atom feeds: One way would be to click on the RSS or Atom feed links on the site and ...

Subscribing to an Atom or RSS Feed

SAP Help Portal
https://help.sap.com › saphelp_nw75 › en-us › content
Type Ctrl 3 to display available views, and select the Feed Reader, if it is not already visible. · Click on the pull-down menu of Add feed... in the Feed Reader ...

Subscribe to Atom Feeds in a Scheduled Integration

Oracle Help Center
https://docs.oracle.com › cloud › paas › hcm-adapter
Select the Include Business Object in Atom Feeds checkbox to send an HTTP request for each entry in the feed to the Atom server to fetch the latest snapshot of ...

Subscribe to RSS/Atom feeds
Zimbra server
http://docs.zimbra.com › Navigation_folders_and_tips
Subscribe to RSS/Atom feeds ; In the Folders heading in the Overview pane, click the folder icon. ; In the Name field, type the name of the RSS feed folder.

Subscribing to feeds

Chromium
https://www.chromium.org › feed-subscriptions
Subscribing to feeds. This document describes how Chrome will enable users to subscribe to RSS/Atom feeds in the feed reader of their choice.

How to use RSS feed (ATOM link)

Easy Redmine
https://www.easyredmine.com › article › how-to-use-r...
For Chrome, for example, open Chrome Web Store and type "RSS" into the search field. Then select one from the list of found extensions to your liking, as shown ...

Subscribe to an RSS Feed from Outlook

Microsoft Support
https://support.microsoft.com › en-au › office › subscr...
Subscribe to an RSS Feed from Outlook · In Outlook, right-click the RSS Feeds folder and choose Add a New RSS Feed. · In the New RSS Feed dialog box, enter the ...

Subscribing to an Atom feed in Thunderbird

ChiliProject
https://www.chiliproject.org › chiliproject › wiki › Su...
To add a URL for an Atom feed to your Thunderbird RSS account: Right-click the RSS account (for example News & Blogs), and select Subscribe.
Related searches

It appears that Thunderbird may have an RSS feed reader.

(th)

Offline

Board footer

Powered by FluxBB