The task of grouping or clustering a set of items into similar groups (or clusters) is a fundamental problem in computer science. For example, given a collection of online news articles, one might want to group them by categories. In my dissertation, I have considered different types of clustering problems, and have designed algorithms for solving them. Our main contribution is to prove theoretical guarantees on the quality of the clustering produced by our algorithms.