/Shell/Bash/Bash remove duplicate lines from a file

Bash remove duplicate lines from a file

# Basic syntax:
sort input_file | uniq --unique
# Sort the file first because uniq requires a sorted file to work. Uniq
# then eliminates all duplicated lines in the file, keeping one instance
# of each duplicated line

# Note, this doesn't return only non-duplicated lines. It returns
# unique instances of all lines, whether or not they are duplicated

# Note, if you want to return only one instance of all lines but see
# the number of repetitions for each line, run:
sort input_file | uniq -c

Source: geek-university.com

Similar codes

0 vote315 views1 answer
Bash set
Shell/Bash
0 vote325 views1 answer
Open podfile in xcode from terminal
Shell/Bash
25 votes332 views3 answers
Apt search installed package
Shell/Bash
8 votes345 views3 answers
Create branch from existing branch
Shell/Bash
0 vote338 views1 answer
How to install rfkill in kali linux
Shell/Bash
0 vote328 views2 answers
Npm package github
Shell/Bash
0 vote337 views2 answers
Skipping acquire of configured file 'multiverse/binary-1386/Packages' as repository 'http://archive.ubuntu.com/ubuntu focal-security InRelease' doesn't support architecture '1386'
Shell/Bash
2 votes315 views1 answer
Vercel cli
Shell/Bash
0 vote386 views2 answers
ERROR: Could not build wheels for numpy which use PEP 517 and cannot be installed directly
Shell/Bash
26 votes326 views1 answer
Rm git init
Shell/Bash