/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote239 views1 answer
Add python to path zsh
Shell/Bash
0 vote260 views3 answers
FS OFS unix
Shell/Bash
3 votes229 views1 answer
Install telnet mac
Shell/Bash
0 vote288 views1 answer
How do I become the owner of a directory in linux?
Shell/Bash
0 vote253 views1 answer
Quick access in linux terminal
Shell/Bash
0 vote262 views1 answer
Linux calculator
Shell/Bash
8 votes250 views6 answers
Windows 10 install wsl2
Shell/Bash
9 votes265 views3 answers
Change username ubuntu
Shell/Bash
-1 vote272 views2 answers
Git last commit change author
Shell/Bash
8 votes288 views1 answer
Uploading a folder to github
Shell/Bash