/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote124 views1 answer
Ionic Please check that /Library/Internet Plug-Ins/JavaAppletPlugin.plugin/Contents/Home contains a valid JDK installation.
Shell/Bash
0 vote108 views1 answer
How to setup path using git bash in windows
Shell/Bash
13 votes113 views1 answer
Bitbucket change commit message
Shell/Bash
0 vote147 views1 answer
Sshfs syntax with ssh key
Shell/Bash
0 vote121 views1 answer
How to install clipman for linux
Shell/Bash
0 vote83 views1 answer
Ubuntu apt get without cd rom
Shell/Bash
3 votes113 views4 answers
Symfony
Shell/Bash
0 vote120 views1 answer
Smb cant write to mounted
Shell/Bash
4 votes121 views2 answers
Command running processes linux
Shell/Bash
2 votes119 views2 answers
Make git forget a file
Shell/Bash