[bash] How to uniq files in a file list with paths?

Question

Hi folks,
I know I can get rid of duplicate entries in a list by sorting and uniqing:
sort file | uniq
But how can I uniq filenames in a file list with paths?
/foo/abc.bar
/foo/def.bar
/foo/bar/def.bar
/foo/ghi.bar
Is it necessary to write my own comparison routine like “output thisline if basename(thisline) != basename(lastline)” (would require a basename-sorted input list)?

Answer 1

arith wrote:
Hi folks,
I know I can get rid of duplicate entries in a list by sorting and uniqing:
sort file | uniq
Or 'sort -u':
$ cat test
a
e
b
d
c
a
d
$ sort -u test
a
b
c
d
e
arith wrote:
But how can I uniq filenames in a file list with paths?
/foo/abc.bar
/foo/def.bar
/foo/bar/def.bar
/foo/ghi.bar
Is it necessary to write my own comparison routine like “output thisline if basename(thisline) != basename(lastline)” (would require a basename-sorted input list)?
I came up with
$ cat test
/home/karol/test/test0
/home/karol/test/test/test0
/home/karol/test/foo/test00
/home/karol/test/foo/bar/test0
/home/karol/test/foo/bar/test1
/home/karol/test1
$ awk -F/ '{print $F" "$NF}' test | sort -k2 | uniq --skip-fields=1 | awk '{print $1}'
/home/karol/test/foo/bar/test0
/home/karol/test/foo/test00
/home/karol/test/foo/bar/test1
but I think there's a better way to do it ;P