Newlines in BSD sed vs gsed





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}







7















The sed, which comes with FreeBSD 11.2 p7, gives:



 $ seq 10 | sed 'N; l; D; p'
1$
2$
2$
3$
3$
4$
4$
5$
5$
6$
6$
7$
7$
8$
8$
9$
9$
10$


While gsed (GNU sed 4.7) gives for the same script:



$ seq 10 | gsed 'N; l; D; p'
1n2$
2n3$
3n4$
4n5$
5n6$
6n7$
7n8$
8n9$
9n10$
10


How can we explain this difference in behavior?










share|improve this question































    7















    The sed, which comes with FreeBSD 11.2 p7, gives:



     $ seq 10 | sed 'N; l; D; p'
    1$
    2$
    2$
    3$
    3$
    4$
    4$
    5$
    5$
    6$
    6$
    7$
    7$
    8$
    8$
    9$
    9$
    10$


    While gsed (GNU sed 4.7) gives for the same script:



    $ seq 10 | gsed 'N; l; D; p'
    1n2$
    2n3$
    3n4$
    4n5$
    5n6$
    6n7$
    7n8$
    8n9$
    9n10$
    10


    How can we explain this difference in behavior?










    share|improve this question



























      7












      7








      7








      The sed, which comes with FreeBSD 11.2 p7, gives:



       $ seq 10 | sed 'N; l; D; p'
      1$
      2$
      2$
      3$
      3$
      4$
      4$
      5$
      5$
      6$
      6$
      7$
      7$
      8$
      8$
      9$
      9$
      10$


      While gsed (GNU sed 4.7) gives for the same script:



      $ seq 10 | gsed 'N; l; D; p'
      1n2$
      2n3$
      3n4$
      4n5$
      5n6$
      6n7$
      7n8$
      8n9$
      9n10$
      10


      How can we explain this difference in behavior?










      share|improve this question
















      The sed, which comes with FreeBSD 11.2 p7, gives:



       $ seq 10 | sed 'N; l; D; p'
      1$
      2$
      2$
      3$
      3$
      4$
      4$
      5$
      5$
      6$
      6$
      7$
      7$
      8$
      8$
      9$
      9$
      10$


      While gsed (GNU sed 4.7) gives for the same script:



      $ seq 10 | gsed 'N; l; D; p'
      1n2$
      2n3$
      3n4$
      4n5$
      5n6$
      6n7$
      7n8$
      8n9$
      9n10$
      10


      How can we explain this difference in behavior?







      sed gnu newlines bsd






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Mar 30 at 17:18









      Jeff Schaller

      44.7k1163145




      44.7k1163145










      asked Mar 30 at 17:02









      wolf-revo-catswolf-revo-cats

      885935




      885935






















          1 Answer
          1






          active

          oldest

          votes


















          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer





















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29













          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34














          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "106"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f509606%2fnewlines-in-bsd-sed-vs-gsed%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer





















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29













          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34


















          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer





















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29













          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34
















          8












          8








          8







          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer















          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.







          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited Mar 30 at 17:43

























          answered Mar 30 at 17:15









          KusalanandaKusalananda

          140k17261435




          140k17261435








          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29













          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34
















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            Mar 30 at 17:29













          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            Mar 30 at 17:31











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            Mar 30 at 17:34










          2




          2





          Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

          – Stéphane Chazelas
          Mar 30 at 17:29







          Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

          – Stéphane Chazelas
          Mar 30 at 17:29















          @StéphaneChazelas Thanks. I did not notice that difference at first.

          – Kusalananda
          Mar 30 at 17:31





          @StéphaneChazelas Thanks. I did not notice that difference at first.

          – Kusalananda
          Mar 30 at 17:31













          Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

          – Stéphane Chazelas
          Mar 30 at 17:34







          Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

          – Stéphane Chazelas
          Mar 30 at 17:34




















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Unix & Linux Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f509606%2fnewlines-in-bsd-sed-vs-gsed%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Færeyskur hestur Heimild | Tengill | Tilvísanir | LeiðsagnarvalRossið - síða um færeyska hrossið á færeyskuGott ár hjá færeyska hestinum

          He _____ here since 1970 . Answer needed [closed]What does “since he was so high” mean?Meaning of “catch birds for”?How do I ensure “since” takes the meaning I want?“Who cares here” meaningWhat does “right round toward” mean?the time tense (had now been detected)What does the phrase “ring around the roses” mean here?Correct usage of “visited upon”Meaning of “foiled rail sabotage bid”It was the third time I had gone to Rome or It is the third time I had been to Rome

          Slayer Innehåll Historia | Stil, komposition och lyrik | Bandets betydelse och framgångar | Sidoprojekt och samarbeten | Kontroverser | Medlemmar | Utmärkelser och nomineringar | Turnéer och festivaler | Diskografi | Referenser | Externa länkar | Navigeringsmenywww.slayer.net”Metal Massacre vol. 1””Metal Massacre vol. 3””Metal Massacre Volume III””Show No Mercy””Haunting the Chapel””Live Undead””Hell Awaits””Reign in Blood””Reign in Blood””Gold & Platinum – Reign in Blood””Golden Gods Awards Winners”originalet”Kerrang! Hall Of Fame””Slayer Looks Back On 37-Year Career In New Video Series: Part Two””South of Heaven””Gold & Platinum – South of Heaven””Seasons in the Abyss””Gold & Platinum - Seasons in the Abyss””Divine Intervention””Divine Intervention - Release group by Slayer””Gold & Platinum - Divine Intervention””Live Intrusion””Undisputed Attitude””Abolish Government/Superficial Love””Release “Slatanic Slaughter: A Tribute to Slayer” by Various Artists””Diabolus in Musica””Soundtrack to the Apocalypse””God Hates Us All””Systematic - Relationships””War at the Warfield””Gold & Platinum - War at the Warfield””Soundtrack to the Apocalypse””Gold & Platinum - Still Reigning””Metallica, Slayer, Iron Mauden Among Winners At Metal Hammer Awards””Eternal Pyre””Eternal Pyre - Slayer release group””Eternal Pyre””Metal Storm Awards 2006””Kerrang! Hall Of Fame””Slayer Wins 'Best Metal' Grammy Award””Slayer Guitarist Jeff Hanneman Dies””Bullet-For My Valentine booed at Metal Hammer Golden Gods Awards””Unholy Aliance””The End Of Slayer?””Slayer: We Could Thrash Out Two More Albums If We're Fast Enough...””'The Unholy Alliance: Chapter III' UK Dates Added”originalet”Megadeth And Slayer To Co-Headline 'Canadian Carnage' Trek”originalet”World Painted Blood””Release “World Painted Blood” by Slayer””Metallica Heading To Cinemas””Slayer, Megadeth To Join Forces For 'European Carnage' Tour - Dec. 18, 2010”originalet”Slayer's Hanneman Contracts Acute Infection; Band To Bring In Guest Guitarist””Cannibal Corpse's Pat O'Brien Will Step In As Slayer's Guest Guitarist”originalet”Slayer’s Jeff Hanneman Dead at 49””Dave Lombardo Says He Made Only $67,000 In 2011 While Touring With Slayer””Slayer: We Do Not Agree With Dave Lombardo's Substance Or Timeline Of Events””Slayer Welcomes Drummer Paul Bostaph Back To The Fold””Slayer Hope to Unveil Never-Before-Heard Jeff Hanneman Material on Next Album””Slayer Debut New Song 'Implode' During Surprise Golden Gods Appearance””Release group Repentless by Slayer””Repentless - Slayer - Credits””Slayer””Metal Storm Awards 2015””Slayer - to release comic book "Repentless #1"””Slayer To Release 'Repentless' 6.66" Vinyl Box Set””BREAKING NEWS: Slayer Announce Farewell Tour””Slayer Recruit Lamb of God, Anthrax, Behemoth + Testament for Final Tour””Slayer lägger ner efter 37 år””Slayer Announces Second North American Leg Of 'Final' Tour””Final World Tour””Slayer Announces Final European Tour With Lamb of God, Anthrax And Obituary””Slayer To Tour Europe With Lamb of God, Anthrax And Obituary””Slayer To Play 'Last French Show Ever' At Next Year's Hellfst””Slayer's Final World Tour Will Extend Into 2019””Death Angel's Rob Cavestany On Slayer's 'Farewell' Tour: 'Some Of Us Could See This Coming'””Testament Has No Plans To Retire Anytime Soon, Says Chuck Billy””Anthrax's Scott Ian On Slayer's 'Farewell' Tour Plans: 'I Was Surprised And I Wasn't Surprised'””Slayer””Slayer's Morbid Schlock””Review/Rock; For Slayer, the Mania Is the Message””Slayer - Biography””Slayer - Reign In Blood”originalet”Dave Lombardo””An exclusive oral history of Slayer”originalet”Exclusive! Interview With Slayer Guitarist Jeff Hanneman”originalet”Thinking Out Loud: Slayer's Kerry King on hair metal, Satan and being polite””Slayer Lyrics””Slayer - Biography””Most influential artists for extreme metal music””Slayer - Reign in Blood””Slayer guitarist Jeff Hanneman dies aged 49””Slatanic Slaughter: A Tribute to Slayer””Gateway to Hell: A Tribute to Slayer””Covered In Blood””Slayer: The Origins of Thrash in San Francisco, CA.””Why They Rule - #6 Slayer”originalet”Guitar World's 100 Greatest Heavy Metal Guitarists Of All Time”originalet”The fans have spoken: Slayer comes out on top in readers' polls”originalet”Tribute to Jeff Hanneman (1964-2013)””Lamb Of God Frontman: We Sound Like A Slayer Rip-Off””BEHEMOTH Frontman Pays Tribute To SLAYER's JEFF HANNEMAN””Slayer, Hatebreed Doing Double Duty On This Year's Ozzfest””System of a Down””Lacuna Coil’s Andrea Ferro Talks Influences, Skateboarding, Band Origins + More””Slayer - Reign in Blood””Into The Lungs of Hell””Slayer rules - en utställning om fans””Slayer and Their Fans Slashed Through a No-Holds-Barred Night at Gas Monkey””Home””Slayer””Gold & Platinum - The Big 4 Live from Sofia, Bulgaria””Exclusive! Interview With Slayer Guitarist Kerry King””2008-02-23: Wiltern, Los Angeles, CA, USA””Slayer's Kerry King To Perform With Megadeth Tonight! - Oct. 21, 2010”originalet”Dave Lombardo - Biography”Slayer Case DismissedArkiveradUltimate Classic Rock: Slayer guitarist Jeff Hanneman dead at 49.”Slayer: "We could never do any thing like Some Kind Of Monster..."””Cannibal Corpse'S Pat O'Brien Will Step In As Slayer'S Guest Guitarist | The Official Slayer Site”originalet”Slayer Wins 'Best Metal' Grammy Award””Slayer Guitarist Jeff Hanneman Dies””Kerrang! Awards 2006 Blog: Kerrang! Hall Of Fame””Kerrang! Awards 2013: Kerrang! Legend”originalet”Metallica, Slayer, Iron Maien Among Winners At Metal Hammer Awards””Metal Hammer Golden Gods Awards””Bullet For My Valentine Booed At Metal Hammer Golden Gods Awards””Metal Storm Awards 2006””Metal Storm Awards 2015””Slayer's Concert History””Slayer - Relationships””Slayer - Releases”Slayers officiella webbplatsSlayer på MusicBrainzOfficiell webbplatsSlayerSlayerr1373445760000 0001 1540 47353068615-5086262726cb13906545x(data)6033143kn20030215029