Find duplicate or unique records in unix
sort is essential because uniq find successive identical lines.
Unique records
cat data.txt | sort | uniq
Duplicate records
cat data.txt | sort | uniq -d
Find duplicate or unique records in unix
sort is essential because uniq find successive identical lines.
Unique records
cat data.txt | sort | uniq
Duplicate records
cat data.txt | sort | uniq -d
Leave a Reply