Over the last decades, genetic factors for rheumatoid diseases like the HLA haplotypes have been studied extensively. However, during the past years of research, it has become more and more evident that the influence of epigenetic processes on the development of rheumatic diseases is probably as strong as the genetic background of a patient. Epigenetic processes are heritable changes in gene expression without alteration of the nucleotide sequence. Such modifications include chromatin methylation and post-translational modification of histones or other chromatin-associated proteins. The latter comprise the addition of methyl, acetyl, and phosphoryl groups or even larger moieties such as binding of ubiquitin or small ubiquitin-like modifier. The combinatory nature of these processes forms a complex network of epigenetic modifications that regulate gene expression through activation or silencing of genes. This review provides insight into the role of epigenetic alterations in the pathogenesis of rheumatoid arthritis and points out how a better understanding of such mechanisms may lead to novel therapeutic strategies.