New Mars Forums

Official discussion forum of The Mars Society and MarsNews.com

You are not logged in.

Announcement

Announcement: This forum is accepting new registrations by emailing newmarsmember * gmail.com become a registered member. Read the Recruiting expertise for NewMars Forum topic in Meta New Mars for other information for this process.

#1651 2021-10-04 07:03:49

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Posts Repair Initiative ...

The run to 9000 was completed and reported.

However, runs to 10000 and 11000 both failed.

The failure was (I suspect) due to accidental F11 alteration of the browser display during startup, so that the capture step failed.

Another attempt to reach 10000 is under way.

Each run is now taking a reliable 7 hours, to potentially there could be as many as three runs in a day.

Clearing the browser cache before starting seems to be the key to success.

Update at 11:07 local time ...

WBA is in a mode of incremental improvement ... today I added a display of the count of characters in the Clipboard, in hopes it would help the operator to monitor operation of the program.  The recent failure allowed the program to continue running, although it was no longer collecting useful data.  The cause was (likely to have been) an offset of the browser by one field, due to accidental actuation of the F11 key, which toggles full screen mode.

The change I just added will report the length of the text in the Clipboard at the end of a cycle.  That number should change depending upon the size of the post just retrieved.  If the count holds steady, then the fetch operation is "looking" at the wrong field.

Update at 16:11 local time .... the scan to 10000 appears to have succeeded this time:

Completed Sequence for ID: 10000


Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1000

Starting Number: 9001

Last Number of Run: 10000

Summary for Web Automation Report for 10-04-2021 at 16:09:19
Average time of Loop from Main form: 00:00:26

Total time of Processing: 07:19:40

I'll post statistics shortly ...

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

***
For SpaceNut ... how do you feel about resuming manual finishing of the TestID's?

It looks as though kbd512 is tied up with home, car, work and family.

The stretch from 10,901 through 18,344 remains to be done ...  If you finish 100 per day, we'll have them finished in 75 days.

That would be around the end of the year.

(th)

Offline

#1652 2021-10-04 18:52:20

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 29,431

Re: Housekeeping

They have a second dome on site but in recent times it was determined not feasible to continue its construction.

https://en.wikipedia.org/wiki/Seabrook_ … ower_Plant

Seabrook Station has been cited as crucial for allowing Massachusetts to comply with carbon emission legal requirements, which was also evidenced by the closure of Vermont Yankee Nuclear Power Plant in 2015 causing carbon emissions to rise in New England for the first time in five years

https://decommissioningcollaborative.or … k-station/

In 1990, the Nuclear Regulatory Commission granted Seabrook a twenty-year license. Its licensed operational life extends to 2030

1990 + 20 = 2010 and yet they have been extended another 20...

main issue is sea water deterioration of the concrete.

Offline

#1653 2021-10-04 20:40:25

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re #1652

Thanks for your research on nuclear power in New England.  I'm glad to see ** someone ** has the good sense to keep Seabrook going ...

As Calliban keeps reminding forum readers, reactor technology has improved greatly in recent decades, and it will keep improving.

***
Regarding the Posts Repair Initiative ...

Now that I have a better understanding of the 1000 post scan process, I can reasonably hope to deliver two 1000 post scans per day.

The 7 hour runs could be combined into three per day, but I found that trying to achieve that increases chances of operator error.  That is why I lost two 1000 post scans recently.  Two scans per day would complete the process through 80,000 within 40 days, or midway into November.

The update runs will take less time, because the number of fetches are a fraction of 1000 .... There are usually multiple bandits per post that has any at all, so only one fetch is needed to update a number of bandits.

We might well be able to wrap this up before the end of the year.

(th)

Offline

#1654 2021-10-05 06:42:05

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Post Repair Initiative

A run to 11000 completed overnight ... a run to 12000 will start shortly

Statistics:

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/05 10001-11000 Admins 167 Bandits 765
2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

Update at 12:26 local time ... work is started on an update to pull useful data from the scans currently existing.

I stopped work because there is no obvious place to put the new code.  I'll come back to it later.

Update at 15:52 local time.... a preliminary version of the new function is working.  It needs a bit of fine tuning.

I should have some results to show later today, or tomorrow for sure.

Meanwhile, here is an update showing through 12000

2021/10/05 11001-12000 Admins 211 Bandits 1208
2021/10/05 10001-11000 Admins 167 Bandits 765
2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

(th)

Offline

#1655 2021-10-05 07:21:17

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Color parameter

Post 11004 contains the Color keyword with a parameter of six zeros.

It doesn't seem to cause problems.  It probably doesn't do anything useful.

I'm wondering it it is worth bothering with these?  Removing the bandit seems to fix the post.

What is your opinion about the color keyword ?

In the section below, I replace left bracket with ampersand, and right bracket with dollar sign

Before post 11004

&color=#000000:post_uid0$&url=http://www.space.com/businesstechnology/technology/nuclear_power_030117.html$Space.com has picked up the story&/url$ -

How soon this initiative will lead to a deployed propulsion system seems to be an open question. According to space.com, NASA is now saying the LA Times story is not entirely accurate.&/color:post_uid0$

After post 11004

URL is shown in red

text is shown in black

Color=#000000 seems to have no effect

&quote=Bill White$&color=#000000$&url=http://www.space.com/businesstechnology/technology/nuclear_power_030117.html$Space.com has picked up the story&/url$ -&/color$

&color=#000000$How soon this initiative will lead to a deployed propulsion system seems to be an open question. According to space.com, NASA is now saying the LA Times story is not entirely accurate.&/color$&/quote$

Hopefully the text will survive FluxBB processing

(th)

Offline

#1656 2021-10-05 17:44:19

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Posts Repair Initiative ...

The extract is now pulling Admins and Bandits from the log file.

Extract Report for 10-05-2021 at 19:19:41
  Generic Extract Lines Utility
Version 2021.10.6.1

Concatenate Function precludes any other function
Input File is Open as D:\NewMars\BanditsInPosts2021\Posts11001-12000\WebRunlog_10-05-2021_09-01-03_32464_11001_12000.txt
Function Concatenate requested: String2 to String1

Search String One is: starting sequence
Search String Two is: do not have permission
Search String Three is:

Total Input Lines 12,089
Total Output Lines 230
  Lines containing String One 999
  Lines containing String Two 211

Starting Sequence for ID: 11008 DO NOT HAVE PERMISSION
Starting Sequence for ID: 11011 DO NOT HAVE PERMISSION
Starting Sequence for ID: 11025 DO NOT HAVE PERMISSION
Starting Sequence for ID: 11028 DO NOT HAVE PERMISSION
...to the end ...
Starting Sequence for ID: 11985 DO NOT HAVE PERMISSION
Starting Sequence for ID: 11988 DO NOT HAVE PERMISSION
Starting Sequence for ID: 11989 DO NOT HAVE PERMISSION

The Post numbers are then extracted so they can be fed into a script to find Admin posts with bandits.

Extract Report for 10-05-2021 at 19:27:52
  Generic Extract Lines Utility
Version 2021.10.6.1

Input File is Open as D:\NewMars\BanditsInPosts2021\Posts11001-12000\WebRunlog_10-05-2021_09-01-03_32464_11001_12000.txt
Function Concatenate requested: String2 to String1

Search String One is: starting sequence
Search String Two is: post_uid
Search String Three is:

ReadyForString1 POST_UID
Starting Sequence for ID: 11002 POST_UID
Starting Sequence for ID: 11003 POST_UID
Starting Sequence for ID: 11004 POST_UID
Starting Sequence for ID: 11005 POST_UID
...to the end ...
Starting Sequence for ID: 11998 POST_UID
Starting Sequence for ID: 11999 POST_UID
Starting Sequence for ID: 12000 POST_UID

Total Input Lines 12,089
Total Output Lines 632
  Lines containing String One 999
  Lines containing String Two 1,208

The Post ID's will be extracted and fed into a script that will use a new (not yet written) function to update the posts.

(th)

Offline

#1657 2021-10-05 18:38:12

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 29,431

Re: Housekeeping

The color command was at one time a string of numbers and later that was changed to have the word instead.
I would rather remove that command completely but if you can identify those and report I will take care of them.

Offline

#1658 2021-10-05 18:50:06

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re #1657

The color command is as easy to remove as the post_uid, so I'll include that in the design of the cleanup function.

***
Update re delivery of data from the scans ...

Post ID's have been isolated for Admin and for Bandits for the series ending at 12,000.

A script is written for display of posts by Admin that contain Bandits.

I'll run that tomorrow morning after the current scan finishes.

The result should be a list considerably fewer than the number of Admin posts, because our Admins working at the time did not use quotes a lot.

it will be interesting (to me for sure) to see what the homework assignment for you looks like.

(th)

Offline

#1659 2021-10-06 06:41:42

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Post Repair Initiative

Last night I ran a test of a new script intended to find Admin posts that need attention.

The script worked as intended, but it produced far more data than is needed.

The request was submitted by Post number, but using the viewtopic format.

As a result, FluxBB came back with a full page of posts, with the target post somewhere in the blob.

It will take ** more ** work (new function in the Extract) to pull the needed information out of the blob.

What I'm trying to discover is which Admin posts need your attention.

It appears that Josh Cryer was active in the period, and he appears to have used expressions that contain Bandits frequently.  It might make sense for you to simply look at all of his posts in the period, if you want to get started.  However, I ** will ** try to produce a report that shows just Admin posts that need attention.

The scan run from 12001-13000 is in progress.  I'll try to sustain a pace of two of these scans per day.

Update at 11:42 local time

The log file of lookups for the Admin posts in the 12000 series totaled to over 4 megabytes.

That is ridiculous!  I'm planning to improve the performance of the script by adding a new command to report count of bogies instead of all the text.

However, in the ** mean ** time, I'm working on an update to the Extract to pull just the Post #'s that were written by Admins and have bogies.

It ** looks ** as though the solution will involve:

a. Find start of report for a Post # (Post #'s come from a file of Post Id's for Admins)
b. Within that Post #, look for "Administrator" (eg, Josh Cryer)
c. Within the text for that Administrator, count occurrences of "post_uid"
d. Report count of bogies for that Post #

(th)

Offline

#1660 2021-10-06 09:55:14

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut ...

A while back, kbd512 suggested using Internet Video Conferencing (eg, Zoom, Skype, Gather.Town, Twitch.tv) to bring the members of Dr. Johnson's project team together when rapid coordination is needed.

Dr. Johnson has mailed to various key people (out ** there ** in the World) to propose landing engineering probes on Mars in 2025.

At any moment, a reply could come in, and Dr. Johnson might want to assemble the team in real time to consider strategy.

kbd512 and I have equipment, software and Internet connection capable of supporting such a video conference.

It is unknown whether SpaceNut, RobertDyck and GW Johnson have the needed capability.

I'll open the floor for discussion of what upgrades (if any) might be needed to insure each of us can join an online conference if one is called.

It anyone would like to test their ability to join a conference, I am happy to provide a test site.  I can support:

1) Zoom
2) Gather.Town
3) Skype
4) Twitch.tv

Plus, if someone has ** another ** Internet Conference system they like, I'm willing to see if works for me.

I'd like to point out that Gather.Town has features that other sites do not.  It is set up for larger (eg, ** very ** large) organizations, but it can work for just two people.  It has meeting rooms, a huge conference room, a chat feature and (probably) other features I don't know about.

Let's see if we can set up this capability within October.  It is possible that one (or more) of us might need to find an alternate Internet connection (such as a library or university) to participate.  We have plenty of time to find and negotiate such arrangements, if they are necessary.

(th)

Offline

#1661 2021-10-06 13:23:58

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Posts Repair Initiative ...

Completed Sequence for ID: 13000


Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1001

Starting Number: 12000

Last Number of Run: 13000

Summary for Web Automation Report for 10-06-2021 at 15:21:16
Average time of Loop from Main form: 00:00:25

Total time of Processing: 06:55:03

Total time Program was Active: 06:58:39

The seven hour run time seems to be holding ...

Update at 16:14 local time...

We appear to have progress on two fronts today ...

The scan from 12001-13000 produced reasonable looking results.

The new function, to find posts by admins that contain bogies is working, but it is counting too many bogies.

The only piece that's missing is the StopAt feature.  At present, without StopAt, the program counts bogies created by Members.

I should have the StopAt feature working some time tomorrow.

Meanwhile, here is the latest status report:

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/06 12001-13000 Admins 253 Bandits 1473
2021/10/05 11001-12000 Admins 211 Bandits 1208
2021/10/05 10001-11000 Admins 167 Bandits 765
2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

A scan through 14,000 just completed ...

Completed Sequence for ID: 14000


Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1000

Starting Number: 13001

Last Number of Run: 14000

Summary for Web Automation Report for 10-06-2021 at 22:38:19
Average time of Loop from Main form: 00:00:25

Total time of Processing: 07:04:30

Update at 10:59 local time ... here are the results from the scan to 14000

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/06 13000-14000 Admins 183 Bandits 1725
2021/10/06 12001-13000 Admins 253 Bandits 1473
2021/10/05 11001-12000 Admins 211 Bandits 1208
2021/10/05 10001-11000 Admins 167 Bandits 765
2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

A trend line for Member posts with Bandits is upward during this period.
The number of posts in each sample is 1000, so it is the length of the posts that is increasing.

Update at 15:47 local time ... the scan to 15,000 completed ...

Completed Sequence for ID: 15000

Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1001

Starting Number: 14000

Last Number of Run: 15000

Summary for Web Automation Report for 10-07-2021 at 15:45:07
Average time of Loop from Main form: 00:00:26

Total time of Processing: 07:21:17

(th)

Offline

#1662 2021-10-07 06:14:01

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Post Repair Initiative

This post is reserved for updates for today ...

Two runs are planned:  14001-15000 and 15001-16000

In addition, an Extract update to deliver a list of posts to be handled by an Admin should be working.

***
On the Lander front, the proposal is complete and the five resume's/CV's are in hand.

It may be time to send the package to NASA.  I'd like to see discussion.

In addition, there is the potential for the team to gather in an Internet venue to discuss how to proceed in general, and specifically, how to proceed if Dr. Johnson receives a reply from anyone to whom he has sent correspondence.
***

The scan to 15,000 is complete:

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/07 14000-15000 Admins 102 Bandits 1976
2021/10/06 13000-14000 Admins 183 Bandits 1725
2021/10/06 12001-13000 Admins 253 Bandits 1473
2021/10/05 11001-12000 Admins 211 Bandits 1208
2021/10/05 10001-11000 Admins 167 Bandits 765
2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

(th)

Offline

#1663 2021-10-07 12:31:56

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Post Repair Initiative....

The Extract function to show posts by Admins who used post_uid is working.

I'll show you what it looks like but not the whole report .... I'll renew my offer ... If you make Josh Cryer a Moderator temporarily, I can use the program to make the updates.  Otherwise you'll have to do it.

There are over 200 posts to update in just the 1000 posts from 11000 to 12000.

Extract Report for 10-07-2021 at 14:11:38
  Generic Extract Lines Utility
Version 2021.10.7.1

Input File is Open as D:\NewMars\BanditsInPosts2021\Posts11001-12000\WebRunlog_10-05-2021_23-06-09_83169_Admin_12000.txt

Search String One is: Text from Clipboard Row 1 in Step
Search String Two is: Josh Cryer
Search String Three is: post_uid
Search String Four is: Offline

Total Input Lines 56,776
Total Output Lines 406
  Lines containing String One 210        Post #
  Lines containing String Two 1,436    Josh Cryer
Lines containing String Three 7,827    post_uid
Lines containing String Four 4,467    Offline

Results for: Text from Clipboard Row 1 in Step: 5 11008
Count of String 3: 2
Results for: Text from Clipboard Row 1 in Step: 5 11011
Count of String 3: 2
Results for: Text from Clipboard Row 1 in Step: 5 11025
Count of String 3: 4

The bottom of the file looks like this ...

Results for: Text from Clipboard Row 1 in Step: 5 11984
Count of String 3: 2
Results for: Text from Clipboard Row 1 in Step: 5 11985
Count of String 3: 2
Results for: Text from Clipboard Row 1 in Step: 5 11988
Count of String 3: 12

Total Input Lines 56,776
Total Output Lines 406
  Lines containing String One 210        Post #
  Lines containing String Two 1,436    Josh Cryer
Lines containing String Three 7,827    post_uid
Lines containing String Four 4,467    Offline
Successful Run. No Warning Errors.

Somewhere along the line I noted a comment by Josh Cryer that he was transitioning to retirement.

His last post was: 2018-02-06 17:06:31

That was three years ago.

If you write him and ask, he might understand the problem and grant you permission to make the change.

(th)

Offline

#1664 2021-10-08 06:05:27

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Post Repair Initiative

Completed Sequence for ID: 16000
 
Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1000

Starting Number: 15001

Last Number of Run: 16000

Summary for Web Automation Report for 10-08-2021 at 08:00:51
Average time of Loop from Main form: 00:00:27

Total time of Processing: 07:24:53

Statistics will be reported later today.

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/08 15001-16000 Admins  70 Bandits 2199
2021/10/07 14000-15000 Admins 102 Bandits 1976
2021/10/06 13000-14000 Admins 183 Bandits 1725
2021/10/06 12001-13000 Admins 253 Bandits 1473
2021/10/05 11001-12000 Admins 211 Bandits 1208
2021/10/05 10001-11000 Admins 167 Bandits 765
2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

Admins down, Members up in this series.

Code to perform updates is next on the agenda here.

Completed Sequence for ID: 17000

Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1000

Starting Number: 16001

Last Number of Run: 17000

Summary for Web Automation Report for 10-08-2021 at 15:29:05
Average time of Loop from Main form: 00:00:26

Total time of Processing: 07:22:23

Statistics will be posted later today.

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/08 16001-17000 Admins 81 Bandits 2056
2021/10/08 15001-16000 Admins  70 Bandits 2199
2021/10/07 14000-15000 Admins 102 Bandits 1976
2021/10/06 13000-14000 Admins 183 Bandits 1725
2021/10/06 12001-13000 Admins 253 Bandits 1473
2021/10/05 11001-12000 Admins 211 Bandits 1208
2021/10/05 10001-11000 Admins 167 Bandits 765
2021/10/04 09001-10000 Admins 142 Bandits 373
2021/10/03 08001-09000 Admins 57 Bandits 434
2021/10/02 07001-08000 Admins 130 Bandits 571
2021/10/01 06001-07000 Admins 75 Bandits 578
2021/09/30 05001-06000 Admins 78 Bandits 595
2021/09/29 04001-05000 Admins 53 Bandits 509
2021/09/27 03001-04000 Admins 29 Bandits 858
2021/09/26 02001-03000 Admins 15 Bandits 622
2021/09/25 01001-02000 Admins 79 Bandits 388
2021/09/22 00101-01000 Admins 103 Bandits 114
2021/09/21 00001-00100 Admins 000 post_uid 21

Starting run to 18000 now

Completed Sequence for ID: 18000
 
Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1001

Starting Number: 17000

Last Number of Run: 18000

Summary for Web Automation Report for 10-08-2021 at 23:57:24
Average time of Loop from Main form: 00:00:27

Total time of Processing: 07:27:55

Statistics will be reported tomorrow

(th)

Offline

#1665 2021-10-09 08:16:50

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re Post Repair Initiative

This post is reserved for updates on:
(a) statistics for 18000
(b) scan through 19000
(c) scan through 20000

Inventory of Todo Items NewMars Posts Repair Initiative

2021/10/09 17001-18000 Admins 90 Bandits 1987
2021/10/08 16001-17000 Admins 81 Bandits 2056
2021/10/08 15001-16000 Admins  70 Bandits 2199
2021/10/07 14000-15000 Admins 102 Bandits 1976
2021/10/06 13000-14000 Admins 183 Bandits 1725
For earlier statistics see earlier updates

(th)

Offline

#1666 2021-10-09 09:28:01

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 29,431

Re: Housekeeping

Thanks for the statistics for the project
Had to fight with my computer this morning as the default browser wants to be edge, of course I can not stand it as it lacks many functions that are in Internet explorer which kept closing and starting edge. Had to start Firefox instead and set it as the default browser just to get back onto the web site. Had removed my google chrome a month ago when it let malware through to the computer.
Now to port my web links to it.

Offline

#1667 2021-10-09 10:22:07

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re #1666

Firefox has security features that I like, and I use it frequently, as a backup for Chrome on Linux.

I don't (generally) use Microsoft for online access, but I do take a risk every time I break that rule.

Thanks for noting the steady accumulation of data on where the bogies are in the posts from 1 to 80,000

I completed the Extract function to find bogies inside posts by Josh Cryer, and I recommend you set Josh back to Moderator.

He's not posted anything since 2018, and if you ask him, I'll bet he'd agree with the change.

Otherwise, you are going to have to manually update all those posts.

If you set Josh back to Moderator, I can ask WBA to perform the updates.

You have better things to do with your time, I'm sure.

Speaking of things to do ... the TestID's from 10901 through 18344 are unfinished.

The best thing would be to see if kbd512 can return to the updates.  He showed us a nifty piece of software that appears able to do the job.

He did a couple of demos, and then his car and house took all his free time.

However, if he cannot do the updates, then you can do them.  I recommend trying for 100 per day as you were doing previously.

11,000 > 18,344 >> 7,344 plus 100 from 10900 so 7,444 ... 75 days would do the trick.

You can still complete the updates before the end of the year.

According to timeanddate.com, we have 83 days from now until the end of the year.

(th)

Offline

#1668 2021-10-09 11:06:02

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 29,431

Re: Housekeeping

Done for now will reset it back once we are done

Offline

#1669 2021-10-09 11:36:32

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re #1668

Thanks for making that change!

If Josh Cryer is truly retired, he might appreciate being relieved of the responsibility of having a loose Administrator ID floating around.

***
I resumed work on the function to perform edits of posts.  I wrote a "strategy" for the process today.

It would be best if the function is generic in nature, so it can be used by someone else for another customer.

My thinking right now is to:

1) Retrieve the contents of the post
2) Copy it to a work space #1
3) Perform the delete operation by writing text NOT to be deleted to work space #2
4) Copy #2 back to #1
5) Perform step 3 as many times as necessary (eg, color:00000 and post_uid)
6) Copy #2 back to #1
7) write #1 back to the server as an Edit to the Post
8) Submit the update

***
In other news ....

The files from RobertDyck to GW Johnson are being blocked by the Google Nanny.

We tried an alternative sending email and it didn't help.

I have a Dropbox account, and set up a NewMars folder and gave GW Johnson access.

I copied the two files of interest to the folder, and am now waiting for confirmation Dr. Johnson was able to pull them down.

***
A scan to 19,000 is in progress.  I should be able to complete two scans per day so should be done in early November.

Completed Sequence for ID: 19000
 
Total Command Lines found: 25
Total input Lines in script: 87

  Number of ID's processed: 1001

Starting Number: 18000

Last Number of Run: 19000

Summary for Web Automation Report for 10-09-2021 at 18:40:52
Average time of Loop from Main form: 00:00:27

Total time of Processing: 07:24:26

Note Color terminator format: [ / c o l o r:p o s  t_u i d 0]

Offline

#1670 2021-10-09 11:40:43

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 29,431

Re: Housekeeping

If that does not work I can send them to GW as I have done so in the past with no issues.

Offline

#1671 2021-10-09 11:53:58

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re #1670

Please do try.  I expect you will fail.  The problem is (I believe) the Google Nanny, and GW Johnson is using a Gmail account.

No one (even you) can send those particular files to GW Johnson. However, please do try.

Since the attempt is likely to fail, send another email notifying GW Johnson that you attempted to send the files.

He will confirm if the files arrived or if they did not.

(th)

Offline

#1672 2021-10-09 12:14:44

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 29,431

Re: Housekeeping

Most emails do have the option to turn off files that are coming in with an email attachment. This may be set to not allow attachments.

Edit
both versions have been sent

Offline

#1673 2021-10-09 12:19:16

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re #1672

What GW Johnson is reporting is that the failing emails do not show up at all, and they are not in the spam filter.

My assumption is that there is something in the files that Google Nanny thinks is against the law, so it deleted everything.

Your experiment of trying to send the files from your account will help us to pin down the nature of the problem.

Please be sure to send ** two ** messages!  The one with the files will be deleted.  The one without files will be allowed to proceed.

If anything ** else ** happens I am confident GW Johnson will let us know.

(th)

Offline

#1674 2021-10-09 18:01:57

SpaceNut
Administrator
From: New Hampshire
Registered: 2004-07-22
Posts: 29,431

Re: Housekeeping

My last attempt was to send attachments but as pdf so as to not set the doc detection which at one time would be targeted for infection.
My libreoffice software does an export of a document to pdf...

Offline

#1675 2021-10-09 20:32:19

tahanson43206
Moderator
Registered: 2018-04-27
Posts: 19,400

Re: Housekeeping

For SpaceNut re #1674

Thanks for trying the pdf version idea!  I tried changing the spelling of the file names, and that had no effect.  Your observation about the file type is interesting. 

Hopefully we'll hear back from GW Johnson at some point, but if he never receives anything there's not much to report.  That is why I trust you send an email without attachment along with the one with attachment.

If I hear anything one way or the other I'll post here.

(th)

Offline

Board footer

Powered by FluxBB