/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

5 votes308 views2 answers
Adonis install
Shell/Bash
0 vote285 views2 answers
Struct main function c in unix
Shell/Bash
0 vote321 views1 answer
INSTALL_FAILED_UPDATE_INCOMPATIBLE: Package com.*.version signatures do not match previously installed version; ignoring!
Shell/Bash
0 vote288 views2 answers
How to remove one file from git history
Shell/Bash
0 vote267 views1 answer
If you are using vm and installing ubuntu vm should we choose try ubuntu or install ubuntu
Shell/Bash
0 vote283 views1 answer
Stop port in use 8000
Shell/Bash
1 vote340 views1 answer
Hapus folder di linux
Shell/Bash
0 vote296 views1 answer
Add more changes to same commit
Shell/Bash
1 vote311 views1 answer
Bash zero padding
Shell/Bash
0 vote277 views1 answer
Attching to milticontainer pod
Shell/Bash