DEV Community

Franz Wong
Franz Wong

Posted on • Edited on

sed cookbook

#sed #tutorial #cookbook

Table of contents

Write the result to another file

Content of file_1 (before command is executed)

Hello World
Enter fullscreen mode Exit fullscreen mode

Command

sed 's/Hello/Goodbye/;w file_2' file_1
Enter fullscreen mode Exit fullscreen mode

Content of file_1 (after command is executed)

Hello World
Enter fullscreen mode Exit fullscreen mode

Content of file_2 (after command is executed)

Goodbye World
Enter fullscreen mode Exit fullscreen mode

Replace first occurrence on every

Input file

aa
bb bb
aa
bb
Enter fullscreen mode Exit fullscreen mode

Command

sed 's/bb/dd/' file
Enter fullscreen mode Exit fullscreen mode

Output

aa
dd bb
aa
dd
Enter fullscreen mode Exit fullscreen mode

Replace values of all occurrences

Input file

aa
bb bb
aa
bb
Enter fullscreen mode Exit fullscreen mode

Command

sed 's/bb/dd/g' file
Enter fullscreen mode Exit fullscreen mode

Output

aa
dd dd
cc
dd
Enter fullscreen mode Exit fullscreen mode

Replace value of first occurrence in the file

Input file

aa
bb bb
aa
bb
Enter fullscreen mode Exit fullscreen mode

Command

It only works on GNU sed.
See also: https://www.gnu.org/software/sed/manual/html_node/Range-Addresses.html

sed '0,/bb/{s/bb/dd/}' file
Enter fullscreen mode Exit fullscreen mode

Output

aa
dd bb
cc
bb
Enter fullscreen mode Exit fullscreen mode

Replace all occurrences on n-th line

Input file

aa
bb bb
aa
bb
Enter fullscreen mode Exit fullscreen mode

Command

# replace all occurrences on 2nd line
sed '2s/bb/dd/g' file
Enter fullscreen mode Exit fullscreen mode

Output

aa
dd dd
aa
bb
Enter fullscreen mode Exit fullscreen mode

Replace all occurrences within a range of lines

Input file

aa1
aa2
aa3
aa4
aa5
Enter fullscreen mode Exit fullscreen mode

Command

# replace occurrences from 2nd line to 4th line
sed '2,4s/aa/dd/g' file
Enter fullscreen mode Exit fullscreen mode

Output

aa1
dd2
dd3
dd4
aa5
Enter fullscreen mode Exit fullscreen mode

Replace all occurrences on every line matching pattern

Input file

a 1
a 2
a 1 x
b 1
b 2
b 1 x
c 1
c 2
c 1 x
Enter fullscreen mode Exit fullscreen mode

Command

# replace "1" with "10" on all the lines containing "b"
sed '/b/s/1/10/g' file1
Enter fullscreen mode Exit fullscreen mode

Output

a 1
a 2
a 1 x
b 10
b 2
b 10 x
c 1
c 2
c 1 x
Enter fullscreen mode Exit fullscreen mode

Replace all occurrences on every line NOT matching pattern

Input file

a 1
a 2
a 1 x
b 1
b 2
b 1 x
c 1
c 2
c 1 x
Enter fullscreen mode Exit fullscreen mode

Command

# replace "1" with "10" on all the lines NOT containing "b"
sed '/b/!s/1/10/g' file
Enter fullscreen mode Exit fullscreen mode

Output

a 10
a 2
a 10 x
b 1
b 2
b 1 x
c 10
c 2
c 10 x
Enter fullscreen mode Exit fullscreen mode

Replace first occurrence after a pattern

Input file

server-alpha:
    host: '192.168.0.1'
    port: 9090

server-beta:
    host: '192.168.0.1'
    port: 9091

server-charlie:
    host: '192.168.0.1'
    port: 9092
Enter fullscreen mode Exit fullscreen mode

Problem

Change the host of server-beta to 192.168.0.2. Values of other hosts remain unchanged.

Command

sed -e '/server-beta/! b' \
    -e ':label1' \
    -e 's/192.168.0.1/192.168.0.2/' \
    -e 't label2' \
    -e 'n' \
    -e 'b label1' \
    -e ':label2' \
    -e 'n' \
    -e 'b label2' \
    file
Enter fullscreen mode Exit fullscreen mode

Output

server-alpha:
    host: '192.168.0.1'
    port: 9090

server-beta:
    host: '192.168.0.2'
    port: 9091

server-charlie:
    host: '192.168.0.1'
    port: 9092
Enter fullscreen mode Exit fullscreen mode

Explanation

It uses the sed branching commands b and t.

  • /server-beta/! b - if pattern space doesn't contain server-beta, it will jump to the end of script.

  • :label1 - declare a label with name label1

  • s/192.168.0.1/192.168.0.2/ - Replace 192.168.0.1 with 192.168.0.2

  • t label2 - if the previous replacement is done, jump to label2.

  • n - read next line from input and put to pattern space or exit if no more line from input

  • b label1 - jump to label1

  • :label2 - declare a label with name label2

  • n - read next line from input and put to pattern space or exit if no more line from input

  • b label2 - jump to label2

Pseudo code

input = readLineFromInput()
while (input != null) {
    patternSpace.append(input)

    if (patternSpace.contains("server-beta")) {
        while (true) { // label1
            if (patternSpace.replace("192.168.0.1", "192.168.0.2")) {
                break // jump to label2
            }
            /** start of n **/
            display(patternSpace)
            patternSpace.clear()
            input = readLineFromInput()
            if (input == null) {
                exit
            }
            patternSpace.append(line)
            /** end of n **/
        }

        while (true) { // label2
            /** start of n **/
            display(patternSpace)
            patternSpace.clear()
            input = readLineFromInput()
            if (input == null) {
                exit
            }
            patternSpace.append(line)
            /** end of n **/
        }
    }

    display(patternSpace)
    patternSpace.clear()
    input = readLineFromInput()
}
Enter fullscreen mode Exit fullscreen mode

Delete lines matching pattern

Input file

aa1
bb2
cc3
Enter fullscreen mode Exit fullscreen mode

Command

sed /bb/d file
Enter fullscreen mode Exit fullscreen mode

Output

aa1
cc3
Enter fullscreen mode Exit fullscreen mode

Delete n-th line

Input file

aa1
aa2
aa3
aa4
aa5
Enter fullscreen mode Exit fullscreen mode

Command

# delete 2nd line
sed 2d
Enter fullscreen mode Exit fullscreen mode

Output

aa1
aa3
aa4
aa5
Enter fullscreen mode Exit fullscreen mode

Insert before line

Input file

aa1
bb2
cc3
Enter fullscreen mode Exit fullscreen mode

Command

sed "/bb/i bb_before" file
Enter fullscreen mode Exit fullscreen mode

Output

aa1
bb_before
bb2
cc3
Enter fullscreen mode Exit fullscreen mode

Insert after line

Input file

aa1
bb2
cc3
Enter fullscreen mode Exit fullscreen mode

Command

sed "/bb/a bb_after" file
Enter fullscreen mode Exit fullscreen mode

Output

aa1
bb2
bb_after
cc3
Enter fullscreen mode Exit fullscreen mode

Use other delimiter

Input file

/aa/bb/cc/dd
Enter fullscreen mode Exit fullscreen mode

Problem

It is too clumsy to escape slash.

sed 's/bb/bb1\/bb2\/bb3/' file
Enter fullscreen mode Exit fullscreen mode

Command

It is clearer if # is used.

sed 's#bb#bb1/bb2/bb3#' file
Enter fullscreen mode Exit fullscreen mode

Output

/aa/bb1/bb2/bb3/cc/dd
Enter fullscreen mode Exit fullscreen mode

Actually any character can be used.

These are all valid and produce same output.

# , is used
sed 's,bb,bb1/bb2/bb3,' file

# $ is used
sed 's$bb$bb1/bb2/bb3$' file

# a is used
sed 'sabbabb1/bb2/bb3a' file
Enter fullscreen mode Exit fullscreen mode

But you can't use character which is inside the pattern.

# b is used
sed 'sbbbbbb1/bb2/bb3b' file
# sed: -e expression #1, char 5: unknown option to `s'

# 1 is used
sed 's1bb1bb1/bb2/bb31' file
# sed: -e expression #1, char 9: unknown option to `s'
Enter fullscreen mode Exit fullscreen mode

Top comments (0)

Read next

code42cate profile image

Day 6: Docker Image Layers

Jonas Scholz -

obanai profile image

DPLL: All-Time Hit SAT-Solver

Lahari -

auyeungdavid_2847435260 profile image

5 Key Concepts Every .NET Developer Should Know for Job Interviews

David Au Yeung -

chihebabiza profile image

Understanding Transaction Isolation Levels in PostgreSQL

Chiheb Abiza -