/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote367 views1 answer
Is there any method to do clearscreen mongo shell
Shell/Bash
11 votes363 views3 answers
Bash: make: command not found
Shell/Bash
1 vote366 views1 answer
React native permission denied, lstat 'node_modules\.bin\acorn' after installing react-native-paper
Shell/Bash
0 vote331 views1 answer
Inport files to google colab from github
Shell/Bash
0 vote345 views1 answer
Switching between gdm and lightdm
Shell/Bash
5 votes345 views3 answers
Apt-get search package
Shell/Bash
1 vote364 views1 answer
Check which users are part of a group linux
Shell/Bash
0 vote337 views2 answers
Powershell get ip address
Shell/Bash
0 vote398 views1 answer
Where do you install composer
Shell/Bash
0 vote346 views1 answer
Rename folder in linux
Shell/Bash