/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote295 views1 answer
Get battery level via cmd
Shell/Bash
31 votes284 views2 answers
Npm install router
Shell/Bash
5 votes259 views2 answers
Install fira code ubuntu
Shell/Bash
0 vote278 views1 answer
Reset branch to other branch
Shell/Bash
0 vote275 views1 answer
Date last friedy in linux
Shell/Bash
0 vote260 views1 answer
Run prometheus command
Shell/Bash
4 votes279 views1 answer
Jango.core.exceptions.ImproperlyConfigured: Error loading MySQLdb module
Shell/Bash
11 votes265 views1 answer
React-native init directory locked in ubuntu why
Shell/Bash
5 votes273 views1 answer
Git ignore still tracking
Shell/Bash
0 vote265 views1 answer
Make only one digit input box
Shell/Bash