/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote233 views1 answer
Fdart string to uri
Shell/Bash
21 votes243 views4 answers
Remove a package ubuntu
Shell/Bash
0 vote225 views1 answer
Whereis alpine
Shell/Bash
6 votes202 views2 answers
How to install node js on chromebook
Shell/Bash
0 vote233 views1 answer
Python convert excel to html table
Shell/Bash
-1 vote210 views1 answer
Read -p linux
Shell/Bash
0 vote235 views1 answer
Install concrete 5 on ec2 instance
Shell/Bash
0 vote230 views1 answer
How to add text to promt in linux
Shell/Bash
0 vote167 views1 answer
Symbolic link wsl mnt
Shell/Bash
1 vote204 views1 answer
Linux screen list
Shell/Bash