/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

39 votes348 views6 answers
Git reset to remote
Shell/Bash
0 vote263 views1 answer
Linux os update
Shell/Bash
1 vote296 views1 answer
Discord components python install
Shell/Bash
0 vote316 views1 answer
ContainerDS Desktop tool for docker images
Shell/Bash
-2 votes290 views1 answer
Drupal file permissions
Shell/Bash
0 vote285 views2 answers
Udpate node terminal windows
Shell/Bash
2 votes274 views1 answer
Change color of cmd windows 10
Shell/Bash
0 vote299 views1 answer
ImportError: No module named alsaaudio
Shell/Bash
2 votes290 views1 answer
Python install random library
Shell/Bash
0 vote296 views1 answer
Bash list columns
Shell/Bash