CodeUtility
Making your developer's life easier!
Text tools

Remove Duplicate Lines

Clean up lists by removing repeated lines, with options for case, spaces and sorting.

  • Runs in your browser
  • Instant results
  • Free, no sign-up
Loading the tool…

How to use the Remove Duplicate Lines

  1. Paste your list, one item per line.
  2. Choose which occurrence to keep and other options.
  3. Copy the cleaned list.

Frequently asked questions

Is the original order kept?

Yes, unless you choose a sort option.

Can I find only the duplicates?

Yes. Choose Only the duplicated lines, or Only lines that appear once for unique values.

Can I see how often each line appears?

Yes. Turn on Show counts to put the count before each line.

Line CounterCount total, non-empty, blank, unique and duplicated lines in text or code. Find the longest line and view numbered lines. Comma SeparatorConvert a column or list to comma-separated values and back. Add quotes, wrap in parentheses for SQL IN, remove duplicates and sort. Diff CheckerCompare two texts or code files and highlight the differences line by line and word by word, in split or unified view. Private and instant.

Practice Python with coding challenges

Solve hands-on problems right in this editor: run the sample tests, submit, and get an AI code review.

All Python challenges
Easy

Average of Three

Average three whole numbers.

You'll learn ArithmeticDivision
BeginnerLearning-pathVariables
Python C++ C#
1 solved
View solutions (1)
Easy

Rectangle Perimeter

Compute the perimeter of a rectangle from its sides.

You'll learn ArithmeticReturn values
BeginnerLearning-pathVariables
Python C++ C#
1 solved
View solutions (1)
Medium

One Generation of a Genetic Algorithm

Breed the next generation of bit strings with tournament selection, single-point crossover and mutation.

You'll learn Genetic algorithmsEvolutionary search
OptimizationSimulationai
Python C++ C#
0 solved
No solutions yet
Easy

Epsilon-Greedy Multi-Armed Bandit

Balance exploration and exploitation on a multi-armed bandit with epsilon-greedy action selection.

You'll learn Explore vs exploitBandits
Reinforcement learningaimachine learning
Python C++ C#
0 solved
No solutions yet
Easy

Markov Chain State Distribution

Propagate a probability distribution through a Markov chain's transition matrix for a number of steps.

You'll learn Markov chainsProbability
Simulationaimath
Python C++ C#
0 solved
No solutions yet
Medium

Value Iteration

Compute how valuable each state of a Markov decision process is by repeatedly applying the Bellman optimality update.

You'll learn Bellman equationMDPs
Reinforcement learningaimachine learning
Python C++ C#
0 solved
No solutions yet
Medium

Q-Learning Updates

Apply the Q-learning update to a stream of experiences and watch rewards flow back to earlier states.

You'll learn Q-learningDiscounted rewards
Reinforcement learningaimachine learning
Python C++ C#
0 solved
No solutions yet
Medium

Alpha-Beta Pruning

Evaluate a game tree with minimax and alpha-beta pruning, and count how many leaves the search really looks at.

You'll learn Alpha-beta pruningGame search
RecursionTreesai
Python C++ C#
0 solved
No solutions yet
Medium

Minimax Tic-Tac-Toe

Pick the perfect tic-tac-toe move by searching the whole game tree with minimax.

You'll learn MinimaxGame trees
Recursionai
Python C++ C#
0 solved
No solutions yet
Medium

A* Search on a Weighted Grid

Find the cheapest path across a grid of terrain costs with A*, the search algorithm behind game and robot pathfinding.

You'll learn A* searchHeuristics
GraphsGridsShortest-pathai
Python C++ C#
0 solved
No solutions yet
Medium

Temperature and Top-K Sampling

Choose the next token like a language model does: keep the top k logits, apply temperature, and sample.

You'll learn Text generationSampling
aimachine learning
Python C++ C#
0 solved
No solutions yet
Hard

Multi-Head Self-Attention

Project the input into queries, keys and values, run attention in several heads in parallel, and combine them.

You'll learn Multi-head attentionMatrix projections
aimachine learning
Python C++ C#
0 solved
No solutions yet