This projects implements our CS263 report: Discriminative versus Generative Methodologies for Cloze-style Machine Comprehension Evaluation SemEval 2021 Task 4: Reading Comprehension of Abstract Meaning