You are not logged in.
I was happy to see Steve Stewart return and posting so what we have been doing is being noticed.
Offline
For SpaceNut re Steve Stewart ....
He is the third "working" engineer in the group.
Calliban is still working 9-5, and I'm calling GW Johson a "working" engineer because he is still wonderfully productive as a freelance writer.
I just realized your background includes responsibilities in the engineering sector.
So! Let's call it four working engineers!
Good enough for forum purposes!
(th)
Offline
For SpaceNut re TestID updates
The first full run to 11700 finished with a Green screen.
Completed Sequence for ID: 11700
Total Command Lines found: 51
Total input Lines in script: 207Number of ID's processed: 296
Starting Number: 11405
Last Number of Run: 11700
Summary for Web Automation Report for 10-16-2022 at 23:13:33
Average time of Loop from Main form: 00:00:39Total time of Processing: 03:11:55
I was (am) surprised that this run takes an average of 39 seconds, but it ** does ** perform an update.
And! The update (probably) has to do more than just remove a record from the bans table.
It is possible it goes over to the users table as well, to change status from banned to member.
The current running script ** does ** check to be sure the TestID is converted to a member, but in this version, it only shows that information to the operator. A refinement would add that information to the log.
There are 135*50 or (about) 6750 TestID's to update to members.
At 300 a day that would be about a month. Having the JavaScript version running would speed up the process.
(th)
I'll start tonight's Potholes scan now. The goal is 158000
(th)
Offline
For SpaceNut re Potholes Scan ...
Completed Sequence for ID: 158000
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 1000
Starting Number: 157001
Last Number of Run: 158000
Summary for Web Automation Report for 10-17-2022 at 18:22:28
Average time of Loop from Main form: 00:00:26
53 Skip Exceptions were recorded.
53 is down from previous 72
Admin posts: 459 << -- that's amazing!
For details request file: WebRunlog_10-16-2022_23-26-29_84389-Potholes-158000
(th)
Offline
For SpaceNut ....
I decided to run the TestID update this evening, rather than the potholes scan.
There are more than 6000 TestID's to be upgraded to member status, and at 300 a day it will take a month (or so) to finish them.
I'll drop the potholes schedule back to 1000 per day, from the recent 2000, until the TestID's are all moved into the show case, ready for brand new members.
I was a day ahead in thinking the Linux meeting was this evening. I logged into the Zoom and there was no one there.
A quick check of the schedule confirmed the meeting is tomorrow.
I'm currently planning to drop the CORS problem into their collective lap, to see if anyone has a suggestion for how to deal with it.
One option that ** might ** work is to write my own browser. That is not too hard to do (I gather) and it would solve the problem of the JavaScript running in a separate session from the browser session logged into the NewMars server.
Still, I'll prefer to find out how to run a JavaScript solution on any OS or browser.
(th)
Offline
For SpaceNut re TestID update...
Last night's run was supposed to cover 11701 through 12000.
However, it stopped with a Red screen after completing 11870.
I'll restart the run at 11871
The run to 12000 completed...
Completed Sequence for ID: 12000
Total Command Lines found: 51
Total input Lines in script: 207Number of ID's processed: 130
Starting Number: 11871
Last Number of Run: 12000
Summary for Web Automation Report for 10-18-2022 at 11:46:17
Average time of Loop from Main form: 00:00:40
(th)
Offline
For SpaceNut ... today's Potholes scan reached 159000
Completed Sequence for ID: 159000
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 1000
Starting Number: 158001
Last Number of Run: 159000
Summary for Web Automation Report for 10-18-2022 at 21:16:16
Average time of Loop from Main form: 00:00:26
65 Skip Exceptions were recorded.
Admin posts: 519 <<== over 50% (Impressive)
For details request file: WebRunlog_10-18-2022_11-50-14_42614-Potholes-159000
Tonight's run will work on TestID's ...
We run a couple of times with 300 ID's, and the runs seemed to go smoothly.
This evening i'll set up a run to 13000 ...
(th)
Offline
For SpaceNut re TestID upgrade ...
Last night's run was set for 1000 ID's, but it stalled out at 12507.
Today's planned runs include:
1) Finish TestID's to 13000
2) Try for Potholes scan goal of 160000
3) Email if we have a candidate
In the JavaScript front ... I'm hoping to build on momentum from last night's Linux meeting.
Even though we did not find a solution, the session was ** very ** helpful in showing how to use the developer tools in a browser. While Safari was the browser used for the demo, I am hopeful that both Edge and Firefox are comparable in their capability.
The show stopper at this point is the proxy server. One is installed on a Linux box, but I have no idea how to use it, so will begin today by studying the examples already reported in the JavaScript topic.
A generous person set up a demo web site, and a generous author showed how to use it, and i am pretty sure I was successful in using the demo, so the next step is to find out how to use a proxy server running locally to satisfy CORS, and let the requests for data from FluxBB to proceed.
Beyond reaching ** that ** goal is the original challenge of trying to understand/work-with the output from Fetch.
Ultimately, the goal is to be able to issue a PUT command to click the submit button, or to execute the Remove stored procedure.
Meanwhile, the Simulated Operator WBA program is working reasonably well.
The script for TestID updates could be improved, but it works well enough to process 500 ID's at a sitting.
(th)
Offline
For SpaceNut re TestID upgrades
Completed Sequence for ID: 13000
Total Command Lines found: 51
Total input Lines in script: 207Number of ID's processed: 266
Starting Number: 12735
Last Number of Run: 13000
Summary for Web Automation Report for 10-19-2022 at 20:32:25
Average time of Loop from Main form: 00:00:38
I'll schedule Potholes to 160000 for overnight.
(th)
Offline
Sorry for not being able to get onto the computer last night as I went to bed early due to acid reflux that even with antacids still lasted most of the night.
Seems the solution to the java was to create a small server condition to send command through if I have read this correctly.
Will see If I have the drive space as it would be nice to know.
Offline
For SpaceNut re #2610
Hoping you're feeling better after a rough night!
***
Thanks for noting the direction I am looking for a resolution to the JavaScript CORS problem.
Along the way I read an explanation of the prohibition. My interpretation is that the problem (of long standing) is that an innocent consumer might visit a web site run by a hacker. The hacker can include some JavaScript in the web site to look for a person's banking information, and then try to access the bank. The CORS system is intended to block that kind of activity.
At last night's Linux meeting, one of the members asked how a Proxy Server could help. I didn't know, and still don't, but I have a clue ... If you set up a proxy server on your computer (like Squid which I've set up) the hacker wouldn't know about it. It ** may ** be like two-factor-authentication. If ** you ** send a message to your proxy server, it is inside your "domain" so CORS is happy, and the hacker won't know about it.
At least, that's my ** theory ** of why a proxy server might be acceptable. I'll be watching for confirmation.
I wasn't able to work on Java today, but hope to find time tomorrow. In the mean time, the Simulated Human system I've created is doing the job in it's slow but reliable way.
(th)
Offline
For SpaceNut re Potholes scan ...
Completed Sequence for ID: 160000
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 1000
Starting Number: 159001
Last Number of Run: 160000
Summary for Web Automation Report for 10-20-2022 at 08:22:37
Average time of Loop from Main form: 00:00:26
37 Skip Exceptions were recorded.
Admin posts: 448
For details request file: WebRunlog_10-19-2022_20-37-50_74270-Potholes-160000
Alternating runs:
Today: TestID's through 14000
Tonight: Potholes through 161000
This next section is passing data from Dell to script development machine:
#
# User List button
<esc>,goto,455,85.
<esc>,goto,455,85.
<esc>,click.
# System X = 1198 System Y = 228
# Contents of Address Bar Save field
Text:http://newmars.com/forums/userlist.php
#
# Username window
<esc>,goto,440,185.
<esc>,goto,440,185.
<esc>,click.
# System X = 1152 System Y = 487
***
The mouse clicks above are intended to improve performance of the TestID script.
(th)
Offline
For SpaceNut re TestID upgrades
WBA hit a snag on it's way to 14000...
Delay for long paste: 0 seconds
Starttext from Clipboard Row 1 in Step: 29
TestID13318
End of Text from Clipboard Row 1
Resuming at 13319 ...
The video broadcast of the conference has been flawless so far.
I expect that everyone not able to hear the presentations live will appreciate the recordings.
The session on life on Mars was particularly interesting (to me for sure)...
The presenter reported that research shows that DNA can exist in more combinations than the one that won the competition on Earth. This discovery led to development of a way of testing that works for ** all ** possible forms of DNA.
(th)
Offline
For SpaceNut re Potholes scan ...
Completed Sequence for ID: 161000
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 1000
Starting Number: 160001
Last Number of Run: 161000
Summary for Web Automation Report for 10-21-2022 at 07:26:19
Average time of Loop from Main form: 00:00:27
37 Skip Exceptions were recorded.
Admin posts: 335
For details of 37 potholes request file: WebRunlog_10-20-2022_22-01-03_79263-Potholes-161000
Today's starting run will be to finish the TestiD's from 13887-14000
(th)
Offline
For SpaceNut re TestID updates
Completed Sequence for ID: 14000
Total Command Lines found: 51
Total input Lines in script: 207Number of ID's processed: 114
Starting Number: 13887
Last Number of Run: 14000
Summary for Web Automation Report for 10-21-2022 at 09:01:30
Average time of Loop from Main form: 00:00:37
(th)
Offline
For SpaceNut re TestID updates
Total Command Lines found: 51
Total input Lines in script: 207Number of ID's processed: 200
Starting Number: 14001
Last Number of Run: 15000
Summary for Web Automation Report for 10-21-2022 at 15:28:34
Average time of Loop from Main form: 00:00:38Total time of Processing: 06:22:08
Total time Program was Active: 06:23:47
Early end of run requested. at 14201
Will resume try for 15000...
Offline
For SpaceNut re TestID upgrade ...
The run was proceeding normally, but I decided to stop it at 14711, because the run would have continued past midnight local time.
Completed Sequence for ID: 14711
Starting Sequence for ID: 14712
Total Command Lines found: 51
Total input Lines in script: 207Number of ID's processed: 510
Starting Number: 14202
Last Number of Run: 15000
Summary for Web Automation Report for 10-21-2022 at 21:29:20
Average time of Loop from Main form: 00:00:42
I'll queue up a Potholes run to 162000. it will run overnight.
There is an email to send. I'll take care of that in the morning.
(th)
Offline
For SpaceNut re Potholes scan ....
This evenings try for 162000 was cut short at 161128 ...
Completed Sequence for ID: 161128
Starting Sequence for ID: 161129
Smart Wait Address Retry Count = 0Report of status at compare failure:
Row counter: 8 Row contents: WEPLogged in as tahanson43206
Expected string: 0
Received string: Actual
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 128
Starting Number: 161001
Potholes: 1
Admin posts: 66
SK: Skipping to Next Item from Post ID: 161093 Bad request
Will restart the run. Perhaps the Internet chop will ease a bit overnight.
(th)
Offline
For SpaceNut re Pothole scans...
The restart last night only completed 16 more posts...
The Dell has been working non-stop for days. I think I'll give it some time off today.
Completed Sequence for ID: 161144
Starting Sequence for ID: 161145
Report of status at compare failure:
Row counter: 7 Row contents: WEnewmars.com/forums/misc.php?action=rules
Expected string: 0
Received string: Actual
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 16
Potholes: 0/zero
Admin Posts: 10
No potholes found
(th)
Offline
For SpaceNut re TestID upgrades ...
WBA reached 15000 without further difficulty.
TestID15000
End of Text from Clipboard Row 2Delay for long paste: 0 seconds
Smart Wait Address Retry Count = 0
Completed Sequence for ID: 15000
Total Command Lines found: 51
Total input Lines in script: 207Number of ID's processed: 289
Starting Number: 14712
Last Number of Run: 15000
Summary for Web Automation Report for 10-22-2022 at 16:59:31
Average time of Loop from Main form: 00:00:39
(th)
Offline
I started to look through the testid***** bans from the end forward and found at page 39-40 duplicate username with the old email that once was in the data base. One must go first into the edit and edit the username before it can be cleared from the data base with the remove function. That will remove any crosslinking that might be present.
Offline
For SpaceNut re #2621
Thanks for doing the investigation you reported!
The current version of FluxBB is updated to NOT create duplicate Bans table entries. However, it appears there are plenty left over from an earlier time.
As a first guess on how to approach this ...
It might be possible to write a script that audits the Bans table and removes any records that are not tied back to the User table.
From your study so far, do you think work should stop on removing TestID's from the Bans table?
We've completed work through TestID15000. We have 3450 TestID's to restore to member status.
I'll hold at 15000 until you have time to evaluate the situation.
We should NOT have any duplicate Usernames in the TestID series.
Do you have a Username I can look at, to see the problem?
Update a bit later ... If you have time, please think about what might go into a script to remove orphan Bans table records. The procedure might involve selecting a record in the Bans table, and performing a lookup to see if there is a corresponding record in the Users table. If the answer is no, then we can safely remove the record from the Bans table. That would be a good application for the still-in-development JavaScript capability. At the rate we've been progressing with TestID updates, we will be done in a few days.
At that point, it would be helpful to have something for the JavaScript program to do.
***
Meantime, the Pothole scan reached 162000 last night...
Completed Sequence for ID: 162000
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 856
Starting Number: 161145
Last Number of Run: 162000
Summary for Web Automation Report for 10-23-2022 at 06:12:30
Average time of Loop from Main form: 00:00:27
33 Skip Exceptions were recorded.
Admin posts: 289
For details request file: WebRunlog_10-22-2022_17-08-47_61727-Potholes-162000
Today's Pothole scan will try for 163000
(th)
Offline
For SpaceNut re "Speaking of giving folks something to do"....
One of the sessions i was able to hear from the 25th Mars Society Convention was one on the difficulty and challenges of trying to collaborate with other nations on space projects.
The presenter discussed the US/Russia collaboration in depth, and touched on successful collaboration between the US and other nations (or regions such as the EU).
One of the points the speaker made was the importance of insuring that citizens of each partner are given plenty of work that is significant to the success of the endeavor.
At the ** same ** time, the speaker emphasized the importance of trying to "stay out of each other's way".
The speaker gave several (moderately humorous) examples of differences between Russian and US ways-of-doing-things. The speaker was careful to emphasize that the collaboration with Russia was set up as truly equal partners working (successfully) together over a number of years.
I personally hope the collaboration with Russia in space survives the current unpleasant situation in Ukraine.
However, admittedly, prospects don't look good at this point.
(th)
Offline
For SpaceNut re Potholes scan ...
Completed Sequence for ID: 163000
Total Command Lines found: 34
Total input Lines in script: 206Number of ID's processed: 1000
Starting Number: 162001
Last Number of Run: 163000
Summary for Web Automation Report for 10-23-2022 at 15:51:15
Average time of Loop from Main form: 00:00:26
25 Skip Exceptions were recorded.
423
This a full run without interruptions ... only 25 potholes!
Admin Posts:
For details request file: WebRunlog_10-23-2022_07-45-38_27938-Potholes-163000
While we wait for SpaceNut to decide what to do about TestID's, I've queued up a Potholes run to 164000.
(th)
Offline
Located and removed the 41 testid **** duplicates from the ban table
Offline