Some people prefer to use the Caps Lock key in order to type capital letters, but on linux there's a delay when the button is pressed. Since there appears to be very few people who prefer to type this way the problem has never been fixed.
This is a short and sweet tutorial on how to fix that.
In most distibutions you can do this by pressing the Win/Super key, type terminal
and press Enter.