This term refers to a collection of written or spoken material stored in a database for linguistic analysis. It is often used in discussions about language studies and research.
It's so easy to write good example sentences, that even if we accidentally delete a few good sentences in the process of getting rid of a whole lot of bad ones, I think we could drastically improve the quality of this corpus by doing a lot of deleting.