/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote334 views1 answer
Nvidia proprietary driver arch linux
Shell/Bash
1 vote364 views1 answer
Gitignore for ue4
Shell/Bash
0 vote352 views1 answer
Bitbucket rename remote tag
Shell/Bash
0 vote349 views1 answer
Ubuntu change night light intensity
Shell/Bash
1 vote328 views1 answer
Grep process id
Shell/Bash
2 votes319 views1 answer
Bash float division
Shell/Bash
0 vote341 views1 answer
Add date to git reflog
Shell/Bash
0 vote366 views1 answer
Usage Error: The nearest package directory
Shell/Bash
7 votes355 views2 answers
Move linux
Shell/Bash
0 vote352 views1 answer
Changer affichage kali linux
Shell/Bash