Email Outreach Campaign 2022-2023

tahanson43206 · 2023-09-13 08:58:30

Today's test succeeded in sending all four test email. No test emails were received yesterday.

http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=437393

The local time when the run started was 10:55 so UTC would have been 14:55

Update at 12:42 local time ... all three test messages arrived today.

SpaceNut ... based on this result, your should have received yours as well.

(th)

NewMarsMember · 2023-09-14 09:11:11

Today's test send four emails. None were received yesterday.

http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=437393

(th)

NewMarsMember · 2023-09-16 08:53:02

Today's test sent four emails. None were received yesterday.

http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=437393

(th)

NewMarsMember · 2023-09-17 07:23:33

Today's test will begin shortly after UTC 13:23

Today's test ended some time before UTC 14:23

http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=437393

(th)

Last edited by NewMarsMember (2023-09-17 08:24:18)

NewMarsMember · 2023-09-18 09:34:19

The email test was run again today. No messages were received from yesterday's test.

The forum email subsystem is apparently hosed. Unfortunately, it will be at least a week and maybe more before anyone will be able to look at the problem.

Here is the send for today:
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

(th)

NewMarsMember · 2023-09-19 08:41:27

One of three test emails arrived yesterday. I will not consider the email system reliable until all three test messages arrive.

Today's test run included five sends:
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

(th)

NewMarsMember · 2023-09-20 09:19:10

Today's test of the forum email service sent five messages.

Yesterday, I took a look at the sent message that arrived (out of three attempted)

The server that provides the email service is provided by dreamhost .... I assume the forum submits a request to the dreamhost email server, and the request goes into a queue for processing. Obviously the dreamhost server is not able to keep up.

Here are the sends for today:
Extract Report for 09-20-2023 at 11:16:50
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

If any test emails arrive today, I'll update this post.

Update at 12:54 local time .... One of three messages arrived today:

Received: from 10.217.151.75
by atlas207.free.mail.ne1.yahoo.com pod-id NONE with HTTPS; Wed, 20 Sep 2023 14:46:33 +0000
Return-Path: <newmars@vps31385.dreamhostps.com>
X-Originating-Ip: [69.163.253.124]
Received-SPF: pass (domain of vps31385.dreamhostps.com designates 69.163.253.124 as permitted sender)
Authentication-Results: atlas207.free.mail.ne1.yahoo.com;
dkim=unknown;
spf=pass smtp.mailfrom=vps31385.dreamhostps.com;
dmarc=fail(p=NONE,sp=NONE) header.from=marssociety.org;
X-Apparently-To: tahanson43206@yahoo.com; Wed, 20 Sep 2023 14:46:33 +0000
<snip>
Received: from 69.163.253.124 (EHLO vps31385.dreamhostps.com)
by 10.217.151.75 with SMTPs
(version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256);
Wed, 20 Sep 2023 14:46:33 +0000
Received: by vps31385.dreamhostps.com (Postfix, from userid 16645360)
id 4RrLvX6YQXz8Vr; Wed, 20 Sep 2023 07:46:32 -0700 (PDT)
<snip>
-----------------------------------------------------------------------
--
New Mars Forums Mailer

(th)

NewMarsMember · 2023-09-21 08:11:01

Today's test included these sends:

Update for Web Automation Report for 09-21-2023 at 09:51:26
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

If any of the test messages arrive I'll update this post.

Update after checking inbound email:
To my amazement, all three of the test messages arrived today.
One possibility is that someone made an adjustment at dreamhost.
Another possibility is that this is a fluke. In any case, I am not going to restart email outreach until I see some consistency in the behavior of the email transmission subsystem, which operates independently of the forum software.

(th)

tahanson43206 · 2023-09-22 07:46:51

Today's test of the email system is using just four sends, because all three test messages arrived yesterday.

Update for Web Automation Report for 09-22-2023 at 09:05:06
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=437393

I'm planning to report results here later today.

Just one of three messages arrived today.

Received: from 10.197.39.201
by atlas105.free.mail.bf1.yahoo.com pod-id NONE with HTTPS; Fri, 22 Sep 2023 13:11:54 +0000
Return-Path: <newmars@vps31385.dreamhostps.com>
X-Originating-Ip: [69.163.253.124]
Received-SPF: pass (domain of vps31385.dreamhostps.com designates 69.163.253.124 as permitted sender)
Authentication-Results: atlas105.free.mail.bf1.yahoo.com;
dkim=unknown;
spf=pass smtp.mailfrom=vps31385.dreamhostps.com;

This problem may not be in the province of the Mars Society.... It appears that the dreamhostps.com site is assigned to handle requests from newmars.com, and clearly some of the messages are being dropped. It is even possible that on some days all messages are dropped.

I will continue running these tests until the problem is resolved. That could be a while. The first step is to understand the nature of the problem, and where any information about the failure might be found.

(th)

NewMarsMember · 2023-09-23 08:40:07

Today's test has four sends:

Update for Web Automation Report for 09-23-2023 at 10:05:06
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=437393

I'll report the results later .... Since it appears the email process involves FluxBB sending requests to an email queue provided by dreamhost, one variable we have under our control is the time between requests. The time we are using now is 60 seconds, as requested by FluxBB itself, but we could make the interval greater.

There was a significant break between the first send today, and the follow up set.

Update after checking email:
Two of the three test messages arrived.
The first arrived at 10:06, which is almost immediately after the start of send reported above.
The second arrived at 10:29, which is about right considering the delay reported earlier.

One of the two secondary emails was lost. As an experiment, I'll change the interval between sends to five minutes. It may make no difference, and if fact, it ** should ** make no difference, since the queue manager at dreamhost should be able to handle a large number of requests, on a FIFO basis.

(th)

NewMarsMember · 2023-09-24 08:17:03

Today's run has four sends. The key difference this time is that the wait between sends is increased from one minute
to five minutes. On the assumption the problems we have been seeing are happening in dreamhost, an increase in wait time may help the dreamhost queue manager. Here are today's sends:

Update for Web Automation Report for 09-24-2023 at 09:47:09
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=437393

Results will be posted later today

Only one of three expected emails arrived.

(th)

Last edited by NewMarsMember (2023-09-25 18:39:42)

NewMarsMember · 2023-09-25 18:39:13

Today's test run included five sends. Wait interval is a full five minutes.

Update for Web Automation Report for 09-25-2023 at 19:59:51
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

Results will be posted later today.

No emails arrived. Emails 0: Bit bucket: 3

(th)

tahanson43206 · 2023-09-26 11:45:27

Two emails arrived today:

Emails 2 Bit bucket 1

Here is the list of emails sent:
Update for Web Automation Report for 09-26-2023 at 11:35:49
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

Tomorrow Steve Stewart will join the test panel.

(th)

NewMarsMember · 2023-09-27 09:10:22

Today's email outreach test of the dreamhost email server will feature six sends.

We are adding Steve Stewart to the test panel.

The send sequence will begin shortly.

Update later:
Update for Web Automation Report for 09-27-2023 at 11:10:45
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=432265
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

Results will be posted later today.

Preliminary results: Two of three emails arrived here, so (at this point) Email 2 / BitBucket 4

(th)

tahanson43206 · 2023-09-28 10:19:41

Today's send of six emails resulted in a short series:

Update for Web Automation Report for 09-28-2023 at 11:25:31
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393

Neither of these arrived.

I'll restart the test.. the first run hit an Internet bump of some kind...

Update for Web Automation Report for 09-28-2023 at 12:37:42
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=432265
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

(th)

NewMarsMember · 2023-09-29 09:34:25

We have a reply from Dreamhost, reported in Housekeeping

Today's test run included all six sends:
Update for Web Automation Report for 09-29-2023 at 09:44:16
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=432265
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

If any of these arrived at the destination, I'd be surprised.

Time interval was five minutes between sends.

I would like to point out that we have over 1000 active members. The system needs to be designed to handle all 1000 members online and sending three emails once every 60 seconds, as prescribed by the FluxBB documentation.

Update at 12:57 local time: two of three test messages arrived:

NewMars 2, BitBucket 1

(th)

tahanson43206 · 2023-09-30 12:03:55

Surprise ... one of the test emails arrived ... I wasn't expecting any...

Today, BitBucket 2 NewMars 1

Here is what was sent:
Update for Web Automation Report for 09-30-2023 at 13:17:23
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=432265
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

(th)

NewMarsMember · 2023-10-01 06:32:55

Today's test run will feature the usual six sends:

Update for Web Automation Report for 10-01-2023 at 08:29:50
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=432265
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

If any of these arrive I'll update this post.

Update at 11:48 local time: Amazing! All three emails arrived! It is possible someone at Dreamhost made an adjustment.

If that theory is correct, then all six emails should have arrived.

If any of you members of the test group received an email, please let me know!

For now, it looks like NewMars 3 - BitBucket 0

(th)

Last edited by NewMarsMember (2023-10-01 07:28:25)

NewMarsMember · 2023-10-02 09:18:19

Yesterday's test was at least 50% successful. I received all three test emails, but I have heard nothing from the other three participants in the test, so I'm unsure of the success of the test.

Today's run will start shortly.

Update for Web Automation Report for 10-02-2023 at 11:18:42
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=916
http://newmars.com/forums/misc.php?email=432265
http://newmars.com/forums/misc.php?email=281745
http://newmars.com/forums/misc.php?email=437393

Update at 19:56 local time ... only one of three emails sent to this address were received.

BitBucket 2 vs NewMars 1

Whatever happened yesterday was apparently a fluke.

(th)

Last edited by NewMarsMember (2023-10-02 11:00:03)

tahanson43206 · 2023-10-03 12:33:51

Today's test consists of six sends all to my test address.
Sends to other have been removed.

Update for Web Automation Report for 10-03-2023 at 12:22:34
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393
http://newmars.com/forums/misc.php?email=437393

If any of these test messages get through the log jam at Dreamhost I'll be surprised.

If all get through, I'll e astonished.

Update at 21:34 local time: 4 of the 6 emails arrived:

NewMars 4 vs BitBuck 2

I will not be able to rely on this service until all sent emails arrive.

(th)

NewMarsMember · 2023-10-04 12:04:30

The email test for today features 10 sends, all to the same address.

Yesterday 4 of 6 emails arrived, at a completion rate of 66% ... I will not be satisfied until 100% delivery is achieved for a solid week. From my perspective, the dismal performance of this subsystem is quite remarkably poor, but I assume it has something to do with the crash that occurred in July of this year.

If any of these show up I'll report later today.

Four emails arrived.... BitBucket 6 NewMars 4 (40%)

(th)

NewMarsMember · 2023-10-05 10:08:46

Today's test features 10 emails ...

If any arrive this post will be updated.

For of the ten emails showed up: BitBucket 6 NewMars 4

(th)

NewMarsMember · 2023-10-06 08:22:53

Today's test included ten sends ...

I'll report as usual if any emails arrive.

Six of the 10 sent emails arrived: NewMars 6 BitBucket 4

I will not be satisfied until all 10 emails arrived for a week straight. The email subsystem should be able to handle all 1000+ members sending one email every minute for as many emails as they want to send. From my perspective, there is no technical reason why this (relatively simple) queue management is not working perfectly. As a reminder, the process that sends these emails waits five minutes between sends. Failure to handle that light load is a situation that I hope Dreamhost will be willing to study after the conference is over. They want to work with a representative from the customer, so (obviously) ** that ** will have to wait, and the wait may be long, because there is a lot of post-conference activity that needs attention.

(th)

NewMarsMember · 2023-10-07 16:39:56

Today's run featured 10 sends...

I'll report if any arrived. More accurately, I'll report however many arrive.

The email forwarding service provided by Dreamhost must be reliable.

The process that sends these test emails spaces them out every five minutes. The email server must be capable of handling 1000 members logged in and sending an email per minute to as many people as they want to reach. Each email is to be held in a queue, and the held messages will be processed at whatever rate the Dreamhost server can manage. The current performance is not anywhere near that level.

Update from email machine...

Today seven of the ten test emails arrived:

NewMars 7 BitBucket 3

(th)

NewMarsMember · 2023-10-08 11:48:10

Today's run featured ten sends:

I'll report results later today.

Six of the ten emails arrived: NewMars 6 BitBucket 4

I will not be satisfied until I see 10 for 10 for a week.

(th)

New Mars Forums

Announcement

#326 2023-09-13 08:58:30

Re: Email Outreach Campaign 2022-2023

#327 2023-09-14 09:11:11

Re: Email Outreach Campaign 2022-2023

#328 2023-09-16 08:53:02

Re: Email Outreach Campaign 2022-2023

#329 2023-09-17 07:23:33

Re: Email Outreach Campaign 2022-2023

#330 2023-09-18 09:34:19

Re: Email Outreach Campaign 2022-2023

#331 2023-09-19 08:41:27

Re: Email Outreach Campaign 2022-2023

#332 2023-09-20 09:19:10

Re: Email Outreach Campaign 2022-2023

#333 2023-09-21 08:11:01

Re: Email Outreach Campaign 2022-2023

#334 2023-09-22 07:46:51

Re: Email Outreach Campaign 2022-2023

#335 2023-09-23 08:40:07

Re: Email Outreach Campaign 2022-2023

#336 2023-09-24 08:17:03

Re: Email Outreach Campaign 2022-2023

#337 2023-09-25 18:39:13

Re: Email Outreach Campaign 2022-2023

#338 2023-09-26 11:45:27

Re: Email Outreach Campaign 2022-2023

#339 2023-09-27 09:10:22

Re: Email Outreach Campaign 2022-2023

#340 2023-09-28 10:19:41

Re: Email Outreach Campaign 2022-2023

#341 2023-09-29 09:34:25

Re: Email Outreach Campaign 2022-2023

#342 2023-09-30 12:03:55

Re: Email Outreach Campaign 2022-2023

#343 2023-10-01 06:32:55

Re: Email Outreach Campaign 2022-2023

#344 2023-10-02 09:18:19

Re: Email Outreach Campaign 2022-2023

#345 2023-10-03 12:33:51

Re: Email Outreach Campaign 2022-2023

#346 2023-10-04 12:04:30

Re: Email Outreach Campaign 2022-2023

#347 2023-10-05 10:08:46

Re: Email Outreach Campaign 2022-2023

#348 2023-10-06 08:22:53

Re: Email Outreach Campaign 2022-2023

#349 2023-10-07 16:39:56

Re: Email Outreach Campaign 2022-2023

#350 2023-10-08 11:48:10

Re: Email Outreach Campaign 2022-2023

Board footer