/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote334 views1 answer
Rstudio arch linux rJava/libs/rJava.so
Shell/Bash
0 vote306 views1 answer
Linux edit crontab via script
Shell/Bash
1 vote304 views1 answer
Or in matlab
Shell/Bash
0 vote336 views1 answer
Uepic games github
Shell/Bash
29 votes331 views6 answers
Kill all ports mac
Shell/Bash
0 vote315 views7 answers
Sc windows
Shell/Bash
3 votes345 views1 answer
Write a bash program to print a given number in reverse order
Shell/Bash
2 votes345 views2 answers
String to array bash
Shell/Bash
22 votes307 views3 answers
Ionic capacitor v3 add android
Shell/Bash
0 vote338 views1 answer
Pip install quiet
Shell/Bash