awk题目3

1.

http://bbs.chinaunix.net/thread-4157887-1-1.html

cat file:

>a1
1
>a1
11
>a1
111
>a2
2
>a2
22
>b1
3
>b1
33

将各个title 下边的合在一起 输出如下：
>a1
1
11
111
>a2
2
22
>b1
3
33

awk '/^>/&&!a[$1]++||!/^>/'

(可以改写成 awk '/>/{if(!a[$0]++){print $0};next}1' )

awk '{if($0~/>/){m=$0}else{a[m]=a[m]"\n"$0}}END{for(i in a)print i,a[i]}'

（if else语句可以next代替，改写成awk '{if(/>/){m=$0}else{a[m]=a[m]"\n"$0}}END{for(i in a)print i,a[i]}'）

awk '/>/{!a[$0]++;print}' f1
>a1
>a1
>a1
>a2
>a2
>b1
>b1

awk '/>/{print}' f1
>a1
>a1
>a1
>a2
>a2
>b1
>b1

awk '/>/{if(!a[$0]++)print $0}' f1
>a1
>a2
>b1

awk '/>/&&!a[$0]++' f1
>a1
>a2
>b1

2.

http://bbs.chinaunix.net/forum.php?mod=viewthread&tid=4157497&page=1#pid24299288

cat file:

aaaaaa
adada
adadadad
3a3a3
a3a3
a3s0
2a2a2a2a2

重复出现1至4次字符的行都输出，重复出现1至4次字符的结果应是
ababa
adadadad
3a3a3
a3s0

awk -v n=5 -F '' '{delete a;for(i=1;i<=NF;i++)a[$i]++;l=asort(a)}a[l]<n' file

awk -v n=5 -F '' '{delete a;for(i=1;i<=NF;i++)a[$i]++}{for(i in a)print i,a[i]}' f5
a 6
a 3
d 2
a 4
d 4
a 2
3 3
a 2
3 2
a 1
0 1
s 1
3 1
a 4
2 5

（i为每行重复出现的字符，a[i]为每行中某个字符重复出现的次数）

awk -v n=5 -F '' '{delete a;for(i=1;i<=NF;i++)a[$i]++;len=asort(a)}{for(i in a)print i,a[i]}' f5
1 6
1 2
2 3
1 4
2 4
1 2
2 3
1 2
2 2
4 1
1 1
2 1
3 1
1 4
2 5

（a[i]为每行中某个字符重复出现的次数。i为每行中某个字符的数组下标值（每行去重后，每行有哪几个字符），如第一行只有a重复，去重后下标值为1；第二行中a、d重复，下标值为1、2；a3s0行没有重复，所以有下标值1、2、3、4，至于排序为何为4、1、2、3，可参考 awk 'BEGIN{s="a3s0";split(s,a,"");len=asort(a);for(i in a)print i,a[i]}'
4 s
1 0
2 3
3 a）

awk -v n=5 -F '' '{delete a;for(i=1;i<=NF;i++)a[$i]++;len=asort(a)}{print a[len]}' f5
6
3
4
3
2
1
5

（a[len]为每行中某个字符重复出现的次数，所以a[len]<n表示取重复次数少于n的行）

3.

http://bbs.chinaunix.net/forum.php?mod=viewthread&tid=4157298&page=1#pid24298104

df -h
/dev/sda2        49G   21G   26G  45% /
tmpfs            16G     0   16G   0% /dev/shm
/dev/sda1       193M   34M  150M  19% /boot

AB=`df -h`
echo $AB
发现结果是以空格为分隔符
如何实现跟df -h一样的换行显示呢？

AB="$(df -h)"
echo "$AB"

4.

http://bbs.chinaunix.net/forum.php?mod=viewthread&tid=4156330&page=1#pid24293665

有一个文件file1：（tab分隔）
track name=STRINGENT_LT_1KB
chr3    23232   asdbaskjdb
chr3    32434   daffsf
chr5    43131   dkfjkdjgkdjgk
chr6    4574857   wejwe
chr7    11313     sjdjsgd
chr8    2323     lskdkss
track name=STRINGENT_HIGH_SCORE
chr1   1212123      fkekfhd
chr2   2322342     ererer
chr2   43444        sdsdsd
chr3    454545      dkfjdkjfk
chr5    343434     qsadjhdjh
track name=STRINGENT_LT_332KB
track name=STRINGENT_LOW_SCORE
chr7   2323232    sdsdsdaaa
chr10  223232    dssdsds
chr19   677675   dlkslk

统计不同track name下的数目，结果如下：（tab分隔）
track name=STRINGENT_LT_1KB：6
track name=STRINGENT_HIGH_SCORE：5
track name=STRINGENT_LT_332KB：0
track name=STRINGENT_LOW_SCORE：3

awk '{if(/^t/){if(NR>1)print s":"n;n=0;s=$0}else n++}END{print s":"n}' f8

（可以改写成next语句：awk '/^t/{if(NR>1)print s":"n;n=0;s=$0;next}{n++}END{print s":"n}' f8） 

awk '{if(/track/){m=$0}else i++;print m,i}' f8
track name=STRINGENT_LT_1KB
track name=STRINGENT_LT_1KB 1
track name=STRINGENT_LT_1KB 2
track name=STRINGENT_LT_1KB 3
track name=STRINGENT_LT_1KB 4
track name=STRINGENT_LT_1KB 5
track name=STRINGENT_LT_1KB 6
track name=STRINGENT_HIGH_SCORE 6
track name=STRINGENT_HIGH_SCORE 7
track name=STRINGENT_HIGH_SCORE 8

 ……

awk '{if(/track/){m=$0;i=0}else i++;print m,i}' f8
track name=STRINGENT_LT_1KB 0
track name=STRINGENT_LT_1KB 1
track name=STRINGENT_LT_1KB 2
track name=STRINGENT_LT_1KB 3
track name=STRINGENT_LT_1KB 4
track name=STRINGENT_LT_1KB 5
track name=STRINGENT_LT_1KB 6
track name=STRINGENT_HIGH_SCORE 0
track name=STRINGENT_HIGH_SCORE 1
track name=STRINGENT_HIGH_SCORE 2
track name=STRINGENT_HIGH_SCORE 3
track name=STRINGENT_HIGH_SCORE 4
track name=STRINGENT_HIGH_SCORE 5

……

awk '{if(/^t/){m=$0;i=0}else i++}END{print m,i}' f8
track name=STRINGENT_LOW_SCORE 3

awk '{if(/^t/){m=$0;a[m]=0}else a[m]++}END{print m,a[m]}' f8
track name=STRINGENT_LOW_SCORE 3

awk '{if(/^t/){m=$0;a[m]=0}else a[m]++}END{for(i in a){print i":"a[i]}}' f8

(可以改写成next语句：awk '/^t/{m=$0;a[m]=0;next}{a[m]++}END{for(i in a){print i":"a[i]}}' f8)
track name=STRINGENT_LT_1KB:6
track name=STRINGENT_LT_332KB:0
track name=STRINGENT_HIGH_SCORE:5
track name=STRINGENT_LOW_SCORE:3

awk '{if(/^t/){if(NR>1)print s;s=$0}}' f8
track name=STRINGENT_LT_1KB
track name=STRINGENT_HIGH_SCORE
track name=STRINGENT_LT_332KB

awk '{if(/^t/){if(NR>1)print s;s=$0;print s}}' f8
track name=STRINGENT_LT_1KB
track name=STRINGENT_LT_1KB
track name=STRINGENT_HIGH_SCORE
track name=STRINGENT_HIGH_SCORE
track name=STRINGENT_LT_332KB
track name=STRINGENT_LT_332KB
track name=STRINGENT_LOW_SCORE

5.

http://bbs.chinaunix.net/thread-4155608-2-1.html

echo "a b|c"|awk -F' |\\|' '{print NF}'
3

echo "a b|c"|awk -F' |\|' '{print NF}'
awk: 警告: 转义序列“\|”被当作单纯的“|”
2

echo "a b|c"|awk -F'[ |]' '{print NF}'
3

  awk -v RS='...'

这种写法是可以用少写一个，但不"规范"吧。可以少一个的原因是，最
后落单的那个\，经过 awk 的字符串解释后还是\，与\\的解释结果是一样的。

awk 'BEGIN{RS="...";}

写法就必须写够，一个也不能少。

$ echo -E '\\\'
\\\

$ echo|awk -v v='\\\' '{print "["v"]"}'
[\\]

$ echo|awk -v v='\\\\' '{print "["v"]"}'
[\\]

$ echo|awk -v v='\' '{print "["v"]"}'
[\]

$ echo|awk -v v='\\' '{print "["v"]"}'
[\]

$ echo|awk  'BEGIN{v="\\";}{print "["v"]"}'
[\]

$ echo|awk  'BEGIN{v="\\\";}{print "["v"]"}'

出错 

cat file：

123
123
{\

123
123
123
{\
1af
ewfwf
af

怎么才能用awk以{\为行分隔符来分割得到每一段的内容想要得到第一段
123
123

awk -vRS='{\\\\' 'NR==1'

6.

http://bbs.chinaunix.net/thread-3679733-1-1.html

字符串 'aaabcccaaabbbccc'，连续的字母作为一个子字符串，从左往右，去重复后，变为 'aaabcccbbb' ， awk或sed实现，不使用管道。

awk -F '' '{while(i++<=NF){s=s$i;if($i!=$(i+1)){if(!a[s]++)printf s;s=""}}}'

awk -F'ccc' '{sub(/[a]+/,"",$2);print $1FS$2}'

7.

seq 9
1
2
3
4
5
6
7
8
9
如何得到以下结果:
1 2 3
2 3 4
3 4 5
4 5 6
5 6 7
6 7 8
7 8 9
8 9

seq 9|awk '{a[NR]=$0}END{for(i=1;i<NR;i++)print a[i],a[i+1],a[i+2]}'

seq 9 | awk '{b=($1+1<=9)?$1+1:" ";c=($1+2<=9)?$1+2:" "; print $1" "b" "c}'

seq 9|awk 'NR==1{a=$1};NR==2{b=$1};NR>2{print a,b,$1;a=b;b=$1}END{print a,b}'

8.

http://bbs.chinaunix.net/thread-4154751-1-1.html

[root@localhost ~]# a=1
[root@localhost ~]# while read num ; do a=$num ; done < <(seq 5) ; echo $a
5
[root@localhost ~]# for num in $(seq 5) ; do a=$num ; done ; echo $a
5

 seq 5 | while ... 这样的方式是产生一个了shell子进程,自然子进程里的东西不能改变父进程的值

9.

http://bbs.chinaunix.net/thread-4154600-1-1.html

awk '/<frame name="mainFrame" class="lazy" data-src="/{print a[match($0,/<frame name="mainFrame" class="lazy" data-src="\/([^"]*)".*/,a)]}'

grep -Po '(?<=name="mainFrame" class="lazy" data-src=")[^"]+'

awk -F '[=" ]+' -v RS=">" '/"mainFrame" class="lazy" data-src="/{print $6}' 

10.

http://bbs.chinaunix.net/thread-4154603-1-1.html

实现这样
（a=1且b=1）或者（c=1且d=1）成立时
echo pass
这样能用if实现么？
如何来嵌套？

a=1; b=1; c=0; d=0;if [ $a -eq 1 ] && [ $b -eq 1 ];then echo pass;elif [ $c -eq 1 ] && [ $d -eq 1 ];then echo pass;fi

a=1; b=1; c=0; d=0; if (((a==1 && b==1 )||(c==1 && d ==1)));then echo pass;fi

awk 'BEGIN{a=1;b=1;c=0;d=1;if(((a==1&&b==1)||(c==1&&d==1))){print "pass"}else{print "。。"}}'

awk 'BEGIN{a=1; b=1; c=0; d=0;if(a==1&&b==1){print "pass"}else if(c==1&&d==1){print "pass"}else{print "。。"}}'

if [[ ($a = 1 && $b = 1) || ($c = 1 && $d = 1) ]];then
    echo True
else
    echo False
fi

11.

http://bbs.chinaunix.net/thread-4154531-3-1.html

awk 'm~/==/&&/^\s*$/{print m}{m=$0}'

12.

http://bbs.chinaunix.net/thread-4154504-1-1.html

grep -vf B A

awk 'NR==FNR{a[$0];next}{for(i in a){if(match($0,i)>0)next}print}' B A

awk 'NR==FNR{a[$0];next}{for(i in a)if(index($0,i))next}1' B A

awk 'FNR==NR{k=k?k"|"$0:$0;next}$0!~k{print}' B A
(awk '{k=k?k"|"$0:$0}END{print k}' B
Now|We|ment)

13.

http://bbs.chinaunix.net/thread-4154469-1-1.html 

二维数组

awk 'BEGIN{for(i=1;i<=3;i++)for(j=1;j<=4;j++)a[i,j]=i*j;for(x in a){split(x,b,SUBSEP);print b[1]"*"b[2]"="a[x]}}'

找出文件A有文件B没有的行

awk 'BEGIN{for(i=1;i<=3;i++){for(j=1;j<=4;j++){s=s"R"i"C"j;print s}}}'

或者awk 'BEGIN{for(i=1;i<=3;i++)for(j=1;j<=4;j++)print "R"i"C"j}'

awk 'BEGIN{for(i=1;i<=3;i++)for(j=1;j<=4;j++)a["R"i"C"j];for(i in a)print i}'

awk '{for(i=1;i<=3;i++)for(j=1;j<=4;j++)a["R"i"C"j]}END{for(i in a)print i}' file

awk 'BEGIN{for(i=1;i<=3;i++){for(j=1;j<=4;j++){s="R"i"C"j;print s>"file"}}}'

awk 'NR==FNR{a[$2];next}{for(i in a){if($0==i)next}print}’

 14.

http://bbs.chinaunix.net/thread-4153934-1-1.html

awk   '{ORS=NR%2?"\n":" "}1' 

awk 'NR==1{print;next}NR%2==0{lastline=$0;next}{print lastline,$0}'

awk 'NR%2==0{m=$0}NR%2==1{print m,$0}'

awk 'NR==1{print}NR%2==0{x=NR;m=$0}x{getline s;print m,s}'

awk 'NR==1{print}NR%2==0{x=NR;m=$0}x&&NR-x==1{print m,$0}'

awk 'NR==1{print}{a[NR]=$0}END{for(i=1;i<=NR;i++){if(i%2==0)print a[i],a[i+1]}}'

15.

http://bbs.chinaunix.net/thread-4150372-1-1.html

 
\1代表你前面第一个\( \)里面的内容  \2代表第二个，以此例推

awk --re-interval 'NR==1{a=gensub(/.*(.{10})/,"\\1",1);print a+0}'
awk -F '' '{m=substr($0,NF-9,NF);gsub(/0+/,"",m);print m}'

 16.

http://bbs.chinaunix.net/thread-4150043-1-1.html

awk '{a[$1]=$2;b[$1]=$1}END{for(i=1;i<=asort(b,c);i++)print b[c[i]],a[b[c[i]]],i%3==1?++n:n}'

cat file:

1        a
3        s
2        f
5        g
7        j
4        t
9        r
6        w
8        l

根据第一行排序第二行

awk '{a[$1]=$2}END{for(i=1;i<=NR;i++)print i,a[i]}'

awk '{a[$1]=$2}END{for(i=1;i<=asort(a,c);i++)print i,a[i]}'

$ cat file
aaa 125
ddd 123
bbb 128
ccc 120

$ awk '{a[$2]=$0}END{for(i=1;i<=asort(a);i++)print a[i]}' file
aaa 125
bbb 128
ccc 120
ddd 123

$ awk '{a[$2]=$0}END{for(i=1;i<=asorti(a,b);i++)print a[b[i]]}' file
ccc 120
ddd 123
aaa 125
bbb 128

echo "8 11111 9" | awk '{split($0,a," ");for(i=1;i<=asort(a,c);i++)print i,a[i],c[i]}'
1 8 8
2 11111 9
3 9 11111

echo "8 11111 9" | awk '{split($0,a," ");for(i=1;i<=asort(a);i++)print i,a[i],c[i]}'
1 8
2 9
3 11111

echo "8 11111 9" | awk '{split($0,a," ");for(i=1;i<=asort(a,c);i++)print i,a[2],c[2]}'
1 11111 9
2 11111 9
3 11111 9 

17.

http://bbs.chinaunix.net/thread-4149019-1-1.html

var="'(]\\{}\$\""

18.

http://bbs.chinaunix.net/thread-1393874-1-1.html

  #! /bin/sh
    A=B  echo  $A
    echo  $A

19.

http://bbs.chinaunix.net/thread-4148647-1-1.html

awk '/ve/||(sub($2,$2 FS $NF) && NF--)' OFS='\t'

awk '/ap/{for(i=1;i<=NF;i++){if(i==3)printf $NF"\t"$i"\t";else if($i==$NF)print "";else{printf $i"\t"}}next}1' 

20.

http://blog.chinaunix.net/uid-20778583-id-4247874.html

awk 'NR==FNR{a[$1" "$2" "$3]=$1;b[$1]++}NR>FNR{counter=0;for(i in a)if($1==a[i]){split(i,m," ");i || $2>m[3] || (m[2]==$2 && m[3]==$3))counter++}print NR,counter}' f1 f1

awk 'NR==FNR{a[$1" "$2" "$3]=$1;b[$1]++}NR>FNR{counter=0;for(i in a){if($1==a[i]){split(i,m," ");] || $2>m[3] || ( m[2]==$2 && m[3]==$3))counter++;else next;if(counter == b[$1])print $0}}}' f1 f1

 21.

http://bbs.chinaunix.net/thread-3620300-1-1.html

awk '{if($1==x){s=s","$2}else{if(NR>1){print s}s=$1"\t"$2}x=$1}END{print s}'

awk '{x[$1]=length(x[$1])?x[$1]","$2:$2}END{for(i in x)print i"\t"x[i]}'

awk '{x[$1]=length(x[$1])?x[$1]","$2:$2;len=asorti(x,b)}END{for(i=1;i<=len;i++)print b[i],x[b[i]]}' f5

awk '/track/{x=NR;a[x]=$0}x{print x,NR,a[x],NR-x}'

http://bbs.chinaunix.net/forum.php?mod=viewthread&tid=4156330&page=1#pid24396455

7720 98

7720 99

7720 218

7720 219

7720 220

awk '{a[$1]=$2}{printf a[$1]","}'

awk -v RS='7720' '{printf ","$1}'

awk '{x=$1;if($1==x){s=s","$2}}END{print x,s}'

awk '{if($1==x){s=s","$2}else{if(NR>1){print s}s=$1"\t"$2}x=$1}END{print s}'

awk '{if($1==x){if($2==y+1)s=s"-"$2;else s=s","$2}else{if(NR>1){print s}s=$1"\t"$2}x=$1;y=$2}END{gsub(/-[^,]*-/,"-",s);print s}'

22.

http://bbs.chinaunix.net/thread-4119434-1-1.html   练习题（排序合并）

awk '{m=gensub(/([^0-9]+).*/,"\\1",1,$2);n=gensub(/[^0-9]+(.*)/,"\\1",1,$2);t=$1" "sprintf("%s%10[t]=$1;b[t]=m;c[t]=n}END{for(i=0;i++<asorti(c,d);){print d[i],a[d[i]]}}'

apple cat        12 apple
apple cat       106 apple
apple cat       107 apple
apple cat       108 apple
apple cat       109 apple
apple cat       123 apple
apple cat       125 apple
pear dog        11 pear
pear dog       101 pear
pear dog       103 pear
pear dog       104 pear
pear dog       105 pear
pear mouse       106 pear
pear mouse       107 pear
pear mouse       108 pear
pear mouse       109 pear
pear mouse       123 pear
pear mouse       125 pear

awk '{m=gensub(/([^0-9]+).*/,"\\1",1,$2);n=gensub(/[^0-9]+(.*)/,"\\1",1,$2);t=$1" "sprintf("%s%10s",m,n);a[t]=$1;b[t]=m;c[t]=n}END{for(i=0;i++<asorti(c,d);){if(!k)printf "%s: ",a[d[i]]}}'

awk '{m=gensub(/([^0-9]+).*/,"\\1",1,$2);n=gensub(/[^0-9]+(.*)/,"\\1",1,$2);t=$1" "sprintf("%s%10s",m,n);a[t]=$1;b[t]=m;c[t]=n}END{for(i=0;i++<asorti(c,d);){if(!k)printf "%s: ",a[d[i]];if(k&&k!=a[d[i]]){printf "%s\n%s: ",s,a[d[i]];s=""}}}'

23.

http://bbs.chinaunix.net/forum.php?mod=viewthread&tid=4147474

awk '{a[$1];for(i=1;i++<NF;)b[$1,i]=b[$1,i]!=""?b[$1,i]"/"$i:$i}END{for(i in a){printf i;for(j=1;j++<NF;)printf " "b[i,j];print ""}}'

awk '{if(a[$1]){split(a[$1],b," ");a[$1]=$1" "b[2]"/"$2" "b[3]"/"$3" "b[4]"/"$4}else{a[$1]=$0}}END{l=asort(a);for(i=1;i<=l;i++)print a[i]}' file

24.

http://bbs.chinaunix.net/thread-4145403-1-1.html

awk -F '' '{if($3~4)print $0>"a";else print$0>"b"}' f5
awk -F '' '$3~4{print $0>"e"}$3~5{print$0>"f"}' f5
awk '/^..4/{print $0>"g"}/^..5/{print$0>"h"}' f5
awk '{m=substr($0,3,1);if(m==4)print $0>"c";else{print $0>"d"}}' f5
awk '{print >substr($0,3,1)".txt"}'