Etydhv

Can a UK national work as a paid shop assistant in the USA?

Is my plasma cannon concept viable?

Why does Bran want to find Drogon?

Why does the hash of infinity have the digits of π?

Why did other houses not demand this?

Would Buddhists help non-Buddhists continuing their attachments?

Cardio work for Muay Thai fighters

Who knighted this character?

Does "was machen sie" have the greeting meaning of "what do you do"?

Is keeping the forking link on a true fork necessary (Github/GPL)?

Security vulnerabilities of POST over SSL

What weight should be given to writers groups critiques?

How to deceive the MC

Freedom of Speech and Assembly in China

Which European Languages are not Indo-European?

Why did Jon Snow admit his fault in S08E06?

Storing voxels for a voxel Engine in C++

Why is 'additive' EQ more difficult to use than 'subtractive'?

How to let other coworkers know that I don't share my coworker's political views?

How to politely tell someone they did not hit reply all in email?

Did this character show any indication of wanting to rule before S8E6?

Surprisingly persistent local variable

Best shape for a necromancer's undead minions for battle?

How can I properly write this equation in Latex?

Filter YAML file content using sed/awk

Sed + how to set parameters in sed command in order to display lines from text filefilter based on a field value in awkHow can I add a column to a specific position in a csv file using cat, sed, awk or cut?How well does grep/sed/awk perform on very large files?sed/awk replace a specific pattern under another patternRegex: using awk and sed to match websites by IPvalidate file content with bash Regular Expressionsecho line with var that contains few linesextract field from file using sed or awkHow to print one line below the matching RegEx in AWK or SED

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

2

I have a text file with the following content in it.

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

I would like to filter hosts listed under [prod_env] file in bash.
I tried with sed, awk and grep with my limited knowledge, but I am not sure how to filter them.

Example: I would like to print hosts under prod_env and dev_env. so the final output would be:

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

awk sed yaml

share|improve this question

edited 6 hours ago

Jeff Schaller♦

46k1165150

asked 9 hours ago

smcsmc

205210

add a comment | 

2

I have a text file with the following content in it.

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

I would like to filter hosts listed under [prod_env] file in bash.
I tried with sed, awk and grep with my limited knowledge, but I am not sure how to filter them.

Example: I would like to print hosts under prod_env and dev_env. so the final output would be:

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

awk sed yaml

share|improve this question

edited 6 hours ago

Jeff Schaller♦

46k1165150

asked 9 hours ago

smcsmc

205210

add a comment | 

I have a text file with the following content in it.

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

I would like to filter hosts listed under [prod_env] file in bash.
I tried with sed, awk and grep with my limited knowledge, but I am not sure how to filter them.

Example: I would like to print hosts under prod_env and dev_env. so the final output would be:

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

awk sed yaml

share|improve this question

edited 6 hours ago

Jeff Schaller♦

46k1165150

asked 9 hours ago

smcsmc

205210

$ cat hosts.yml
[prod_env]
foo.example.com
bar.example.com
[stage_env]
foo_stage.example.com
bar_stage.example.com
[dev_env]
foo_dev1.example.com
dev2_bar.example.com

foo.example.com 
bar.example.com 
foo_dev1.example.com 
dev2_bar.example.com

share|improve this question

edited 6 hours ago

Jeff Schaller♦

46k1165150

asked 9 hours ago

smcsmc

205210

share|improve this question

edited 6 hours ago

Jeff Schaller♦

46k1165150

asked 9 hours ago

smcsmc

205210

edited 6 hours ago

Jeff Schaller♦

46k1165150

edited 6 hours ago

Jeff Schaller♦

46k1165150

asked 9 hours ago

smcsmc

205210

asked 9 hours ago

smcsmc

205210

3 Answers
3

active

oldest

votes

3

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 8 hours ago

answered 8 hours ago

PhilipposPhilippos

6,46811851

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for the awesome explanation, this once again reminds me how powerful sed is.
  
  – smc
  7 hours ago
  

  
  
  
  

add a comment | 

2

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 8 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

add a comment | 

2

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 7 hours ago

JJoaoJJoao

7,5691930

add a comment | 

Your Answer

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f520209%2ffilter-yaml-file-content-using-sed-awk%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

3

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 8 hours ago

answered 8 hours ago

PhilipposPhilippos

6,46811851

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for the awesome explanation, this once again reminds me how powerful sed is.
  
  – smc
  7 hours ago
  

  
  
  
  

add a comment | 

3

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 8 hours ago

answered 8 hours ago

PhilipposPhilippos

6,46811851

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks for the awesome explanation, this once again reminds me how powerful sed is.
  
  – smc
  7 hours ago
  

  
  
  
  

add a comment | 

An sed solution:

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

• 
  /[(prod|dev)_env]/!d drops all lines until [prod_env] or [dev_env] ist found


• 
  N;:loop adds the next line and starts a loop


• inside the loop we remove the first of the two lines with s/.*n//, because it is either the [...env] line or we already printed it in the last loop cycle


• 
  $p;d; prints the remaining lines if we reached the last line while printing


• 
  N;P adds the next line and prints the current one


• 
  /n[/D looks if the next line starts with a [. In this case the first line in the buffer (already printed) can be discarded and we start over with that [ line


• 
  bloop otherwise loop

Instead of adding the next line to the buffer, printing and removing the old one, you can go line by line, but this would require another loop, because you can't start over with D

share|improve this answer

edited 8 hours ago

answered 8 hours ago

PhilipposPhilippos

6,46811851

sed -nEe '/[(prod|dev)_env]/!d;N;:loop' -e 's/.*n//;$p;d;;N;P;/n[/D;bloop' hosts.yml

share|improve this answer

edited 8 hours ago

answered 8 hours ago

PhilipposPhilippos

6,46811851

answered 8 hours ago

PhilipposPhilippos

6,46811851

answered 8 hours ago

PhilipposPhilippos

6,46811851

2

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 8 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

add a comment | 

2

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 8 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

add a comment | 

You could do (on a mac):

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

1. 
   tr will get everything on one line


2. The first sed will
   break line before each section


3. 
   grep will cut out the lines
   (sections) you want


4. Second sed will remove the [] part.


5. Last tr will break line so you get one hostname per line.

share|improve this answer

answered 8 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

tr "n" "t" < hosts.yml | sed $'s%t\[%\n[%g' | grep 'prod|dev' | sed $'s%.*]\t%%g' | tr "t" "n"

share|improve this answer

answered 8 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered 8 hours ago

Søren FalchSøren Falch

211

New contributor

Søren Falch is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered 8 hours ago

Søren FalchSøren Falch

211

2

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 7 hours ago

JJoaoJJoao

7,5691930

add a comment | 

2

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 7 hours ago

JJoaoJJoao

7,5691930

add a comment | 

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 7 hours ago

JJoaoJJoao

7,5691930

awk 'BEGINRS="[";FS="]n" 
 $1 ~/(prod|dev)_env/ print $2' ex1

share|improve this answer

answered 7 hours ago

JJoaoJJoao

7,5691930

answered 7 hours ago

JJoaoJJoao

7,5691930

answered 7 hours ago

JJoaoJJoao

7,5691930