• ~M

    From Oli@21:1/151 to Al on Thursday, December 05, 2019 09:11:57
    On Wed, 4 Dec 2019 23:09:08 -0800
    "Al -> Spectre" <0@106.4.21> wrote:

    I got two copies of the message I am replying to. The first had the
    ~M and the second didn't. I dunno why that would be.

    ~M looks like it could represent a <CR>.

    I don't see anything wrong with the message (in hexcurses), maybe the other one
    was catched by dupe checking on the path? Or is it a problem with your system or 4/100? It looks like you are getting most of these weird messages (or you are the one who reports it more often).

    I wonder why the path in Spectre's message (@MSGID: 21:3/101 01051a14) says this:

    @PATH: 3/101 100 4/100 1/100 151

    Doesn't 3/100 has a direct link to 1/100? Or is some tosser ignoring SEEN-BY lines?

    Which PATH do you see on both messages? The same or a different one?

    It looks like you are getting most of these weird messages. I wonder why?

    ---
    * Origin: (21:1/151)
  • From Oli@21:1/151 to Al on Thursday, December 05, 2019 09:40:50

    @PATH: 3/101 100 4/100

    This is the first one I recieved. It has the ~M.

    @PATH: 3/101 100 2/100 4/100

    And I also got this one, without a ~M.

    What is going on there? is 2/100 removing the ~M? Very weird.

    1/100, 2/100 run Mystic, 4/100 switched to hpt, right?

    ---
    * Origin: (21:1/151)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 00:47:10
    Hello Oli,

    I got two copies of the message I am replying to. The first had
    the ~M and the second didn't. I dunno why that would be.

    I'm unsure. Looking at those messages on the BBS they look identical. Looking at them with golded all lines in a paragraph start with ~M, except the first line.

    ~M looks like it could represent a <CR>.

    Maybe, I have not seen it before.

    I don't see anything wrong with the message (in hexcurses), maybe the other one was catched by dupe checking on the path? Or is it a problem with your system or 4/100? It looks like you are getting most of these weird messages (or you are the one who reports it more often).

    Yep, the messages look good on the BBS too, and in golded aside from the ~M characters.

    I wonder why the path in Spectre's message (@MSGID: 21:3/101 01051a14) says
    this:

    @PATH: 3/101 100 4/100 1/100 151

    Doesn't 3/100 has a direct link to 1/100? Or is some tosser ignoring SEEN-BY lines?

    Yes, but it might reach 1/100 via 4/100 first.. :)

    It should be trapped as a dupe if it is a dupe.

    Spectre's last couple message arrived, alone with ~M, one was too short to get one, if it was going to get one.

    Which PATH do you see on both messages? The same or a different one?

    The one with ~M arrived via 3/101 100 4/100 and the second without ~M arrived via 3/101 100 2/100 4/100.

    It looks like you are getting most of these weird messages. I wonder
    why?

    I don't always get two of them, just at times and I can't see a pattern.

    The last two i got both passed dupe checking at 4/100 and here. They are both in my message base. The good one (without ~M) is about 150 bytes larger than the one with ~M according to the size indicated below the subject in golded.


    I dunno.. I don't understand.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 00:59:26
    Hello Oli,

    This is the first one I recieved. It has the ~M.

    @PATH: 3/101 100 2/100 4/100

    And I also got this one, without a ~M.

    What is going on there? is 2/100 removing the ~M? Very weird.

    It seems the ~M is not on that path.

    1/100, 2/100 run Mystic, 4/100 switched to hpt, right?

    Yes, 1/100 is considering, but by the time he reads this he is going to halt.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From apam@21:1/126 to Al on Thursday, December 05, 2019 19:27:29
    Hello Oli,

    I got two copies of the message I am replying to. The first
    had the ~M and the second didn't. I dunno why that would be.

    I'm unsure. Looking at those messages on the BBS they look
    identical. Looking at them with golded all lines in a paragraph
    start with ~M, except the first line.

    My guess is the packet has windows/DOS linebreaks in it (CR then LF) and
    is getting imported into the jam base. Jam bases should only have CR for
    a line break, so my guess is it's the LF that's showing up.

    Which is odd because ^M is carriage return, not line feed.

    I think Magicka filters out LF in jam bases (because they shouldn't be
    there) but I'm not sure off the top of my head.

    Andrew


    --- MagickaBBS v0.13alpha (Linux/x86_64)
    * Origin: HappyLand - telnet://magickabbs.com:2023/ (21:1/126)
  • From Oli@21:1/151 to Al on Thursday, December 05, 2019 10:30:30
    On Thu, 5 Dec 2019 00:47:10 -0800
    "Al -> Oli" <0@106.4.21> wrote:

    Hello Oli,

    I got two copies of the message I am replying to. The first had
    the ~M and the second didn't. I dunno why that would be.

    I'm unsure. Looking at those messages on the BBS they look identical. Looking at them with golded all lines in a paragraph start with ~M,
    except the first line.

    Do you have DISPSOFTCR is golded.cfg? It's just a hunch, I don't know if it has
    anything to do with it. Could you check in the Jam .jdt file which control character that is? It's obviously not a literal "~M" or it would be displayed in the BBS too.

    I wonder why the path in Spectre's message (@MSGID: 21:3/101
    01051a14) says
    this:

    @PATH: 3/101 100 4/100 1/100 151

    Doesn't 3/100 has a direct link to 1/100? Or is some tosser
    ignoring SEEN-BY lines?

    Yes, but it might reach 1/100 via 4/100 first.. :)

    But 4/100 shouldn't export to 1/100 if it is already in the SEEN-BYs (but maybe
    it is configured this way intentionally).

    It should be trapped as a dupe if it is a dupe.

    But what is a dupe? All message with the same MSGID? Or only messages that are exactly the same? E.g. Crashmail only checks the MSGID.

    It looks like you are getting most of these weird messages. I
    wonder why?

    I don't always get two of them, just at times and I can't see a
    pattern.

    Maybe it depends on which path is the fastest. I'm not sure if that makes sense
    ...

    The last two i got both passed dupe checking at 4/100 and here. They
    are both in my message base. The good one (without ~M) is about 150
    bytes larger than the one with ~M according to the size indicated
    below the subject in golded.

    More SEEN-BY lines.

    I dunno.. I don't understand.

    Yeah, it's weird.

    ---
    * Origin: (21:1/151)
  • From Al@21:4/106 to apam on Thursday, December 05, 2019 02:06:52
    Hello apam,

    I'm unsure. Looking at those messages on the BBS they look
    identical. Looking at them with golded all lines in a paragraph
    start with ~M, except the first line.

    My guess is the packet has windows/DOS linebreaks in it (CR then LF)
    and is getting imported into the jam base. Jam bases should only have
    CR for a line break, so my guess is it's the LF that's showing up.

    I think it must be that or something like that.

    Which is odd because ^M is carriage return, not line feed.

    I think Magicka filters out LF in jam bases (because they shouldn't be there) but I'm not sure off the top of my head.

    Yep, both message look good on the BBS, no ~M.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 02:08:00
    Hello Oli,

    Do you have DISPSOFTCR is golded.cfg? It's just a hunch, I don't know
    if it has anything to do with it.

    Not that I know of. I don't remember seeing ~M before.

    Could you check in the Jam .jdt file which control character that is?
    It's obviously not a literal "~M" or it would be displayed in the BBS
    too.

    I'll have a look and see, I'm not sure what I'm looking for but I'll try.

    I just put fsx_gen.zip in my web root. If anyone wants to have a look they are at..

    https://trmb.ca/fsx_gen.zip

    I think that'll work..

    Yes, but it might reach 1/100 via 4/100 first.. :)

    But 4/100 shouldn't export to 1/100 if it is already in the SEEN-BYs
    (but maybe it is configured this way intentionally).

    That's right too, I know the hubs are all linked but they shouldn't get another
    message when the node is in the seen bys.

    It should be trapped as a dupe if it is a dupe.

    But what is a dupe? All message with the same MSGID? Or only messages
    that are exactly the same? E.g. Crashmail only checks the MSGID.

    They seem to be getting changed somewhere, so I suppose that is how it happens.

    More SEEN-BY lines.

    Yep, that is it.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 02:30:04
    Hello Al,

    Could you check in the Jam .jdt file which control character that
    is? It's obviously not a literal "~M" or it would be displayed in
    the BBS too.

    I'll have a look and see, I'm not sure what I'm looking for but I'll
    try.

    I can see the ~M in my viewer but it doesn't tell me what that character is made of. My editor goes loopy trying to edit that file! I've copied those files
    and am just going to delete enough of those messages that I can get a better look at what that character is..

    Be back in a bit.. :)

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Oli@21:1/151 to Al on Thursday, December 05, 2019 11:57:37
    On Thu, 5 Dec 2019 02:08:00 -0800
    "Al -> Oli" <0@106.4.21> wrote:

    I just put fsx_gen.zip in my web root. If anyone wants to have a look
    they are at..

    https://trmb.ca/fsx_gen.zip

    404

    ---
    * Origin: (21:1/151)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 03:01:34
    Hello Oli,

    https://trmb.ca/fsx_gen.zip

    404

    I thought I had it in the webroot.

    I think I have it in the root of the ftp server.

    ftp://trmb.ca/fsx_gen.zip

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Oli@21:1/151 to Al on Thursday, December 05, 2019 12:30:46
    On Thu, 5 Dec 2019 03:01:34 -0800
    "Al -> Oli" <0@106.4.21> wrote:

    Hello Oli,

    https://trmb.ca/fsx_gen.zip

    404

    I thought I had it in the webroot.

    I think I have it in the root of the ftp server.

    ftp://trmb.ca/fsx_gen.zip

    Okay, it's a 0x8D character aka soft CR.

    ---
    * Origin: (21:1/151)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 03:33:34
    Hello Oli,

    ftp://trmb.ca/fsx_gen.zip

    Okay, it's a 0x8D character aka soft CR.

    I wonder where that would come from? I wonder if it is in Spectre's original message. I don't think so, but I'm not sure.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Oli@21:1/151 to Oli on Thursday, December 05, 2019 12:50:43
    On Thu, 5 Dec 2019 09:40:50 +0100
    "Oli -> Al" <0@151.1.21> wrote:

    @PATH: 3/101 100 4/100

    This is the first one I recieved. It has the ~M.

    @PATH: 3/101 100 2/100 4/100

    And I also got this one, without a ~M.

    What is going on there? is 2/100 removing the ~M? Very weird.

    1/100, 2/100 run Mystic, 4/100 switched to hpt, right?

    What do you think about this explanation:

    3/101 generates messages with a soft-CR (0x8d / 141) instead of a regular CR (0x0d / 013). Mystic at 2/100 converts soft-CR to CR. hpt doesn't detect a dupe, because the text body is different. Golded cannot display soft-CRs properly.

    3/101 SuperBBS: everythings fine, soft-CRs are allowed
    2/100 Mystic: changing the mail body is not okay (BUG!)
    4/10? hpt: dupe detection is not perfect
    4/106 Golded: soft-CR should be ignored, see FTS-0001 (BUG!?)

    ---
    * Origin: (21:1/151)
  • From Oli@21:1/151 to Al on Thursday, December 05, 2019 13:20:45
    On Thu, 5 Dec 2019 03:33:34 -0800
    "Al -> Oli" <0@106.4.21> wrote:

    Hello Oli,

    ftp://trmb.ca/fsx_gen.zip

    Okay, it's a 0x8D character aka soft CR.

    I wonder where that would come from? I wonder if it is in Spectre's original message. I don't think so, but I'm not sure.

    I found a message in my own fsx_gen with a shorter path:
    @PATH: 3/101 100 1/151

    and I can also see the ~M in Golded.

    Here we have SuperBBS -> SBBSecho -> Crashmail. It's unlikely that SBBSecho or Crashmail add soft-CR characters.

    Maybe it's just a Golded UTF-8 / charset problem.

    ---
    * Origin: (21:1/151)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 04:33:46
    Hello Oli,

    What do you think about this explanation:

    3/101 generates messages with a soft-CR (0x8d / 141) instead of a
    regular CR (0x0d / 013). Mystic at 2/100 converts soft-CR to CR. hpt doesn't detect a dupe, because the text body is different. Golded
    cannot display soft-CRs properly.

    3/101 SuperBBS: everythings fine, soft-CRs are allowed
    2/100 Mystic: changing the mail body is not okay (BUG!)
    4/10? hpt: dupe detection is not perfect
    4/106 Golded: soft-CR should be ignored, see FTS-0001 (BUG!?)

    That's possible I suppose. But I don't ever recall seeing those ~M's before. I've only seen them in the last day or three.

    Yeah, those soft CRs really shouldn't cause any ripples. They don't for Magicka.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 04:42:32
    Hello Oli,

    Maybe it's just a Golded UTF-8 / charset problem.

    I did get doubles of a number of messages from Spectere, one had ~M and one didn't. How does that happen?

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Alterego@21:2/116 to Oli on Thursday, December 05, 2019 23:59:34
    Re: ~M
    By: Oli to Al on Thu Dec 05 2019 09:11 am

    I wonder why the path in Spectre's message (@MSGID: 21:3/101 01051a14) says this:
    @PATH: 3/101 100 4/100 1/100 151

    3/100 sends a copy of everything to 1/100, 2/100 and 4/100, and it seems in this case, it went to 4/100 first, which in turn sent it to 1/100 before 3/100 sent it there. (So when 3/100 sent it to 1/100, 1/100 should have discarded 3/100 as a dupe.)

    Doesn't 3/100 has a direct link to 1/100? Or is some tosser ignoring SEEN-BY lines?

    It does, but I'll double check this when I get home tomorrow - since Avon noticed he received stuff from 3/100 via another hub. Either I have a bad config, or Agency is the rotten egg :)
    ...лоег

    ... Ambition is the last refuge of the failure.
    --- SBBSecho 3.10-Linux
    * Origin: I'm playing with ANSI+videotex - wanna play too? (21:2/116)
  • From Oli@21:1/151 to Al on Thursday, December 05, 2019 14:02:48
    On Thu, 5 Dec 2019 04:33:46 -0800
    "Al -> Oli" <0@106.4.21> wrote:

    3/101 SuperBBS: everythings fine, soft-CRs are allowed
    2/100 Mystic: changing the mail body is not okay (BUG!)
    4/10? hpt: dupe detection is not perfect
    4/106 Golded: soft-CR should be ignored, see FTS-0001 (BUG!?)

    That's possible I suppose. But I don't ever recall seeing those ~M's before. I've only seen them in the last day or three.

    That would be more or less consistent with the fact that 4/100 switched from to
    hpt on December 1. The message I found was from November 23, that was in the period were my uplink was 3/100 (SBBSecho).

    ---
    * Origin: (21:1/151)
  • From Oli@21:1/151 to apam on Thursday, December 05, 2019 14:05:31
    On Thu, 5 Dec 2019 19:27:29 +1000
    "apam -> Al" <0@126.1.21> wrote:

    My guess is the packet has windows/DOS linebreaks in it (CR then LF)
    and is getting imported into the jam base. Jam bases should only have
    CR for a line break, so my guess is it's the LF that's showing up.

    The spec doesn't set any limitations:

    The .JDT file contains the text of messages. The text is stored as an
    stream of seven or eight bit ASCII data. Allowed characters in the
    text are 00H through ffH

    Which is odd because ^M is carriage return, not line feed.

    It's a soft CR (Ascii 141). 141 - 128 = 13, which is a hard CR. Maybe just a coincidence, I'm to lazy to think about Golded's charset, UTF-8 and what could go wrong.

    I think Magicka filters out LF in jam bases (because they shouldn't be there) but I'm not sure off the top of my head.

    IMHO they should be there, if they were in the original message.

    ---
    * Origin: (21:1/151)
  • From Al@21:4/106 to Oli on Thursday, December 05, 2019 04:59:30
    Hello Oli,

    4/106 Golded: soft-CR should be ignored, see FTS-0001 (BUG!?)

    Golded has a keyword for soft-CR.

    DISPSOFTCR (yes/no)

    So I can set that to no. It doesn't solve the problem of multiple messages passing dupe detection and apparently the soft-CR is getting stripped somewhere
    when it should just be ignored.

    Perhaps if those soft-CRs were simply ignored (as they should be) the dupes wouldn't be happening.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Alterego@21:2/116 to Oli on Friday, December 06, 2019 00:06:38
    Re: ~M
    By: Oli to Al on Thu Dec 05 2019 01:20 pm

    Here we have SuperBBS -> SBBSecho -> Crashmail. It's unlikely that SBBSecho or Crashmail add soft-CR characters.

    I recall SBBS can do something with soft CRs - I dont know what the default is,
    and when I'm back I'll double check what I have for that setting.
    ...лоег

    ... Feed the wolf as you will; he will always look to the forest.
    --- SBBSecho 3.10-Linux
    * Origin: I'm playing with ANSI+videotex - wanna play too? (21:2/116)
  • From Alterego@21:2/116 to Al on Friday, December 06, 2019 00:09:14
    Re: ~M
    By: Al to Oli on Thu Dec 05 2019 04:42 am

    I did get doubles of a number of messages from Spectere, one had ~M and one didn't. How does that happen?

    Sounds like Oli might have identified this. Since we are a mesh, this message went one way where soft-CR was ignored, and another way where it may have been converted to CR. So when both messages arrived at 4/100 there were "different",
    and thus past on as not dupes.
    ...лоег

    ... Death, when unnecessary, is a tragic thing.
    --- SBBSecho 3.10-Linux
    * Origin: I'm playing with ANSI+videotex - wanna play too? (21:2/116)
  • From Al@21:4/106 to Alterego on Thursday, December 05, 2019 05:20:36
    Hello Alterego,

    I did get doubles of a number of messages from Spectere, one had
    ~M and one didn't. How does that happen?

    Sounds like Oli might have identified this. Since we are a mesh, this message went one way where soft-CR was ignored, and another way where
    it may have been converted to CR. So when both messages arrived at
    4/100 there were "different", and thus past on as not dupes.
    ...лоег

    I think that is more or less it. If your SBBS can change it's behaviour WRT soft-CR don't change anything just yet. I'd like to get the facts out if there are more to be had.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Spectre@21:3/101 to Al on Thursday, December 05, 2019 21:47:00
    And I also got this one, without a ~M.

    If you also replied/quoted the ~M it didn't arrive here with a ~M on it....

    Spec

    PS: As a test I've run this back through the message editor inside the BBS, do we have ~M's again?
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Spectre@21:3/101 to Al on Friday, December 06, 2019 00:29:00
    I did get doubles of a number of messages from Spectere, one had ~M and one didn't. How does that happen?

    The central hubs all poll each other, some-one modified it and its different enough not to pass as a dupe?

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Al@21:4/106 to Spectre on Thursday, December 05, 2019 17:14:46
    Hello Spectre,

    And I also got this one, without a ~M.

    If you also replied/quoted the ~M it didn't arrive here with a ~M on it....

    That ~M that I am using here is just the way golded represents the soft CR, it's an 0x8D or ascii 141 I think.

    PS: As a test I've run this back through the message editor inside the BBS, do we have ~M's again?

    You are doing nothing wrong. It appears to me that SuperBBS is using the soft CR that should be ignored and passed as it is.

    That is not common practise to use soft CRs today but it is a thing that seems to still happen today.

    I still need to get a better grip on what is happening here and how it should be dealt with so just keep on keeping on.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Al@21:4/106 to Spectre on Thursday, December 05, 2019 17:28:38
    Hello Spectre,

    I did get doubles of a number of messages from Spectere, one had
    ~M and one didn't. How does that happen?

    The central hubs all poll each other, some-one modified it and its different enough not to pass as a dupe?

    I think so, a few more fact and I'll know better.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Spectre@21:3/101 to Al on Friday, December 06, 2019 15:12:00
    This is another one with the soft CRs. They get moved around when quoted

    I've been wondering if "The Reader" does it, or the bog standard SuperBBS does it.

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Al@21:4/106 to Spectre on Thursday, December 05, 2019 21:12:56
    Hello Spectre,

    This is another one with the soft CRs. They get moved around when
    quoted

    I've been wondering if "The Reader" does it, or the bog standard
    SuperBBS does it.

    It might be. If you take the reader out for a bit we can have a look and see. Regardless of were it comes from it needs to be dealt with differently.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Oli@21:1/151 to Al on Friday, December 06, 2019 08:39:05
    On Thu, 5 Dec 2019 17:14:46 -0800
    "Al -> Spectre" <0@106.4.21> wrote:

    That ~M that I am using here is just the way golded represents the
    soft CR, it's an 0x8D or ascii 141 I think.

    I think it is a UTF-8 display issue. Maybe it just needs the the right configuration in golded.cfg. I never figured out how to configure Golded for UTF-8 properly.

    ---
    * Origin: (21:1/151)
  • From Spectre@21:3/101 to Al on Friday, December 06, 2019 21:00:00
    I've been wondering if "The Reader" does it, or the bog standard SuperBBS does it.

    It might be. If you take the reader out for a bit we can have a look and see. Regardless of were it comes from it needs to be dealt with differently.

    You'll probably have to watch out for the extra tag line from the reader. Its a
    far easier interface to read the entire message base with than the regular SBBS stuff is. As it stands probably 95% of the messages I post come out of it, and the 5% of afterthought messages come from the regular message base options.

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Al@21:4/106 to Oli on Friday, December 06, 2019 03:11:34
    Hello Oli,

    I think it is a UTF-8 display issue. Maybe it just needs the the right configuration in golded.cfg. I never figured out how to configure
    Golded for UTF-8 properly.

    That is an issue too. When folks post with UTF-8 I don't think what I am seeing
    is what they posted. I don't know why that is. When Michiel posts in the UTF-8
    area or Maurice sometimes posts in UTF-8 it doesn't look right to me.

    When you posted some UTF-8 not long ago in FIDONEWS also, I think it was a small graphic.. I didn't see it. I'm not sure what's up there or if there is anything I can do about it.

    These ~M characters I've been seeing lately though are soft CRs.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)
  • From Oli@21:1/151 to Al on Friday, December 06, 2019 15:41:02
    On Fri, 6 Dec 2019 03:11:34 -0800
    "Al -> Oli" <0@106.4.21> wrote:

    Hello Oli,

    I think it is a UTF-8 display issue. Maybe it just needs the
    the right configuration in golded.cfg. I never figured out how
    to configure Golded for UTF-8 properly.

    That is an issue too. When folks post with UTF-8 I don't think what I
    am seeing is what they posted. I don't know why that is. When Michiel
    posts in the UTF-8 area or Maurice sometimes posts in UTF-8 it
    doesn't look right to me.

    When you posted some UTF-8 not long ago in FIDONEWS also, I think it
    was a small graphic.. I didn't see it. I'm not sure what's up there
    or if there is anything I can do about it.

    I cannot see the emoticons in Golded either. E.g. a rainbow emoticon is displayed as "~_~L~H". In UTF-8 bytes it is

    F0 9F 8C 88 (hex)
    or
    240 159 140 136 (dec)

    159 - 128 = 31 -> ~_
    140 - 128 = 12 -> ~L
    136 - 128 = 6 -> ~H

    These ~M characters I've been seeing lately though are soft CRs.

    It's the same with soft CR (8D in hex)
    141 - 128 = 13 -> ~M

    I don't know how Golded works internally, why exactly this is happening and how
    to fix it. I only recognized the pattern, kind of 7bit overflow.

    ---
    * Origin: (21:1/151)
  • From Alterego@21:2/116 to Al on Saturday, December 07, 2019 02:37:47
    Re: ~M
    By: Al to Alterego on Thu Dec 05 2019 05:20 am

    I think that is more or less it. If your SBBS can change it's behaviour WRT soft-CR don't change anything just yet. I'd like to get the facts out if there are more to be had.

    So, I checked my config, and I have Strip Incoming Soft CRs = YES (dont recall if that is the default, or if I may have changed it at some point).

    But even though that is yes, I think that only happens to stuff imported into the BBS, not stuff that I forward on. (Which I'm thinking is true, since we have worked out messages leaving the hub have been modified before getting to 4/100.)

    If DM is listening, he can confirm that.
    ...лоег

    ... Tolkien is hobbit-forming.
    --- SBBSecho 3.10-Linux
    * Origin: I'm playing with ANSI+videotex - wanna play too? (21:2/116)
  • From Spectre@21:3/101 to Al on Saturday, December 07, 2019 09:47:00
    How long ago did UTF become a thing? The Reader is from 1997, and SBBS is from 1993. I'm not surprised SuperBBS doesn't know anything about it, by the time this release arrived, I think it was a given Aki was already on his way to the Finnish army. So there wasn't a lot "new" in there, mostly fixes. The Reader surprises me a little if it is using "Soft <cr>" I still find that whole idea somewhat mind boggling. I can't find any reference to UTF8 in its
    docs, so perhaps its just using the FTC of the time for soft <cr>s. It's also somewhat interesting that its just become visible.

    Spec


    *** THE READER V4.50 [freeware]
    --- SuperBBS v1.17-3 (Eval)
    * Origin: Scrawled in haste at The Lower Planes (21:3/101)
  • From Al@21:4/106 to Spectre on Friday, December 06, 2019 18:51:18
    Hello Spectre,

    How long ago did UTF become a thing?

    The first draft that I know of was published in 1990. I'm not sure the world is
    quite ready for it yet, not the BBS world anyway!

    Synchronet handles UTF-8 nicely as well as Mystic and Magicka. I think the data
    that BBSs store in the msg bases and display files is still cp437. Software in
    development today could go with UTF-8 encoding but there is so much software in use in the BBS world that will never be updated that could be bad for them.

    The Reader is from 1997, and SBBS is From 1993. I'm not surprised SuperBBS doesn't know anything about it, by the time this release
    arrived, I think it was a given Aki was already on his way to the
    Finnish army. So there wasn't a lot "new" in there, mostly fixes.

    Plenty of FTN software, golded included doesn't handle UTF-8 well if at all.

    The Reader surprises me a little if it is using "Soft <cr>" I still
    find that whole idea somewhat mind boggling. I can't find any
    reference to UTF8 in its docs, so perhaps its just using the FTC of
    the time for soft <cr>s. It's also somewhat interesting that its just become visible.

    I'm not sure why soft CRs were used but they were common enough that the FTSC docs say just ignore (not remove) them.

    Ttyl :-),
    Al

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: The Rusty MailBox - Penticton, BC Canada (21:4/106)