I like achievements. Outside the feeling of completion, they allow me:

• to try some challenges I would never have the idea to try (e.g. the great Trine 2 achievements)
• to decide when I am done with a game and can start up another.
• to feel a bit proud when you achieve something only 5% or other players did.