Recognizing Marginalized Histories