/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote343 views1 answer
What is guthub
Shell/Bash
-1 vote386 views1 answer
Install anydesk snap linux mint
Shell/Bash
0 vote345 views1 answer
Open download folder in mac
Shell/Bash
86 votes355 views6 answers
Npm cache remove
Shell/Bash
0 vote322 views1 answer
Gedit linux install suing terminal
Shell/Bash
1 vote309 views1 answer
Serverless invoke local
Shell/Bash
51 votes414 views6 answers
Get all branches git
Shell/Bash
0 vote373 views2 answers
Create a bash script that asks users to change permission
Shell/Bash
19 votes354 views5 answers
Linux add to path
Shell/Bash
1 vote305 views1 answer
Git revert to commit hash
Shell/Bash