Identifying Physical Object Use in Sentences

The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)
Tianyu Jiang Ellen Riloff
University of Utah

Abstract


Commonsense knowledge about the typical functions of physical objects allows people to make inferences during sentence understanding. For example, we infer that "Sam enjoyed the book" means that Sam enjoyed reading the book, even though the action is implicit. Prior research has focused on learning the prototypical functions of physical objects in order to enable inferences about implicit actions. But many sentences refer to objects even when they are not used (e.g., "The book fell" ). We argue that NLP systems need to recognize whether an object is being used before inferring how the object is used. We define a new task called Object Use Classification that determines whether a physical object mentioned in a sentence was used or likely will be used. We present a new dataset and a classification model for this task that exploits data augmentation methods and FrameNet data when fine-tuning a pre-trained language model. We also show that object use classification combined with knowledge about the prototypical functions of objects has the potential to yield very good inferences about implicit and anticipated actions.

Object Use Dataset


The Object Use Dataset contains 2,123 sentences annotated with one of the Used, Anticipated Use or No Use .

Downloads


Please fill in the following form to request access to the Object Use Dataset. Note that the sentences were extracted from Spinn3r 2009. Use of the sentences must abide by the ICWSM Spinn3r Dataset usage agreement . We do not own the copyright of the text. They are solely provided for researchers and educators who wish to use the dataset for non-commercial research and/or educational purposes.