/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

21 votes316 views5 answers
How to install vscode in ubuntu using terminal
Shell/Bash
0 vote287 views1 answer
Commit to create a customised image
Shell/Bash
0 vote328 views1 answer
Vs code gith hub credentials aren't keep arch linux
Shell/Bash
0 vote294 views2 answers
Powershell set register this connection's addresses in dns
Shell/Bash
29 votes295 views4 answers
Sublime text download ubuntu
Shell/Bash
0 vote270 views10 answers
What is the different from Git and GitHub
Shell/Bash
61 votes335 views6 answers
Revert last commit
Shell/Bash
3 votes289 views2 answers
Install nest cli
Shell/Bash
2 votes310 views1 answer
Brew reinstall mysql
Shell/Bash
3 votes291 views1 answer
Mkv to mp4 linux
Shell/Bash