Elamur Research⌕
☰
home / papers / 2023 / NormBank: A Knowledge Bank of Situational Social Norms

NormBank: A Knowledge Bank of Situational Social Norms

Paper · 2023 · Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang et al.

Summary

AI assistants, dialogue agents and social robots need to know which behaviours are appropriate. Existing norm resources and reasoners such as Delphi judge actions without context and quietly assume a typical scenario. NormBank addresses this by linking every norm to an explicit situation.

The authors build SCENE, a hierarchical taxonomy based on Goffman's dramaturgical view of social life. It has four layers:

  • a setting with environmental conditions (time, crowding, country),
  • agents with roles,
  • personal attributes such as age or gender,
  • the behaviours those agents perform.

Crowdworkers, starting from suggestions bootstrapped from large language models, label behaviours under combinations of constraints as expected, okay or unexpected. Their feedback also refines the taxonomy. The resulting norms are non-monotonic: a small change to the frame can flip a judgment, as with a customer versus an on-shift barista drinking coffee.

Neural models trained on the bank produce plausible new norms for unseen situations, according to human raters. Sequential fine-tuning on NormBank also transfers to moral and social classification tasks. NormBank is the first testbed for context-sensitive, defeasible normative reasoning.

Key points

  • NormBank contains about 155k situational norms built from 63k unique constraints. Data and code are released at github.com/SALT-NLP/normbank.
  • SCENE draws its settings from ConceptNet and MovieGraphs, with 129 distinct settings reported. Crowdsourced refinement expanded it to 404 environmental constraints.
  • Labels are descriptive (expected / okay / unexpected), not prescriptive. Users must sign a Data Use Agreement confirming they will not treat the norms as advice.
  • About 24% of norms involve identity attributes such as country, gender, religion or ethnicity. The ethics section counts this as 40k out of 169k total norms. Some role names were gender-neutralized to reduce bias.
  • Annotators were English-speaking US residents in 2022. No directly comparable benchmark exists, so the main evidence of usefulness is human evaluation of knowledge-completion outputs.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

🎓Stanford UniversityStanford · United States310 works · 284,480 citations

📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 9,086 worksArtificial Intelligence · 8,889 worksArts and Humanities · 9,296 worksLanguage and Linguistics · 9,206 works

Cite

Cite as Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, Alon Halevy and Diyi Yang. 2023. NormBank: A Knowledge Bank of Situational Social Norms. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.18653/v1/2023.acl-long.429

@inproceedings{ziems2023normbank,
  title = {{NormBank: A Knowledge Bank of Situational Social Norms}},
  author = {Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, Alon Halevy and Diyi Yang},
  booktitle = {Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2023},
  doi = {10.18653/v1/2023.acl-long.429},
  url = {https://doi.org/10.18653/v1/2023.acl-long.429}
}

References

97 references, 18 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. 2022. Permanent missions to the united nations, no. 310. Permanent Missions to the United Nations. find
  2. Henk Aarts and Ap Dijksterhuis. 2003. The silence of the library: environment, situational norm, and social behavior. Journal of personality and social psychology, 84(1):18. find
  3. Irwin Altman. 1975. The environment and social behavior: privacy, personal space, territory, and crowding. find
  4. Ashley Amaya, Ruben Bach, Florian Keusch, and Frauke Kreuter. 2021. New data sources in social science research: things to know before working with reddit data. Social science computer review, 39(5):943–960. find
  5. Janna Anderson and Lee Rainie. 2022. The metaverse in 2040. Pew Research Center. find
  6. Rodrigo Bavaresco, Diórgenes Silveira, Eduardo Reis, Jorge Barbosa, Rodrigo Righi, Cristiano Costa, Yonatan Bisk, Rowan Zellers, Jianfeng Gao, Yejin Choi, et al. 2020. Piqa: Reasoning about physical commonsense in natural language. In Proceedings of the AAAI conference on artificial intelligence, vo…
  7. Joseph A Blass and Ian D Horswill. 2015. Implementing injunctive social norms using defeasible reasoning. In Eleventh Artificial Intelligence and Interactive Digital Entertainment Conference. find
  8. Michael Boratko, Xiang Li, Tim O’Gorman, Rajarshi Das, Dan Le, and Andrew McCallum. 2020. Protoqa: A question answering dataset for prototypical common-sense reasoning. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1122–1136. find
  9. Peter R Boyce, Neil H Eklund, Barbara J Hamilton, and Lisa D Bruno. 2000. Perceptions of safety at night in different lighting conditions. International Journal of Lighting Research and Technology, 32(2):79–91. find
  10. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems, 33:1877–1901.
  11. Fabio Maria Carlucci, Lorenzo Nardi, Luca Iocchi, and Daniele Nardi. 2015. Explicit representation of social norms for social robots. In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4191–4196. IEEE. find
  12. Jesse Chandler, Gabriele Paolacci, Eyal Peer, Pam Mueller, and Kate A Ratliff. 2015. Using nonnaive participants can reduce effect sizes. Psychological science, 26(7):1131–1139. find
  13. Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Pei Zhou, and Dilek Hakkani-Tur. 2020. Incorporating commonsense knowledge graph in pretrained models for social commonsense tasks. In Proceedings of Deep Learning Inside Out (DeeLIO): The First Workshop on Knowledge Extraction and… find
  14. Robert B Cialdini, Carl A Kallgren, and Raymond R Reno. 1991. A focus theory of normative conduct: A theoretical refinement and reevaluation of the role of norms in human behavior. In Advances in experimental social psychology, volume 24, pages 201–234. Elsevier. find
  15. Robert B Cialdini, Raymond R Reno, and Carl A Kallgren. 1990. A focus theory of normative conduct: Recycling the concept of norms to reduce littering in public places. Journal of personality and social psychology, 58(6):1015. find
  16. Mark Craven, Dan DiPasquo, Dayne Freitag, Andrew McCallum, Tom Mitchell, Kamal Nigam, and Seán Slattery. 2000. Learning to construct knowledge bases from the world wide web. Artificial intelligence, 118(1-2):69–113. find
  17. Kimberly E Culley and Poornima Madhavan. 2013. A note of caution regarding anthropomorphism in hci agents. Computers in Human Behavior, 29(3):577– 579. find
  18. Michael R Cunningham. 1979. Weather, mood, and helping behavior: Quasi experiments with the sunshine samaritan. Journal of personality and social psychology, 37(11):1947. find
  19. Ken Dempsey and David De Vaus. 2004. Who cohabits in 2001? the significance of age, gender, religion and ethnicity. Journal of Sociology, 40(2):157–178. find
  20. Eric Deng, Bilge Mutlu, Maja J Mataric, et al. 2019. Embodiment in socially interactive robots. Foundations and Trends® in Robotics, 7(4):251–356. find
  21. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
  22. E Durkheim. 1915. The elementary forms of the religious life: A study in religious sociology. find
  23. Hady Elsahar, Pavlos Vougiouklis, Arslen Remaci, Christophe Gravier, Jonathon Hare, Frederique Laforest, and Elena Simperl. 2018. T-rex: A large scale alignment of natural language with knowledge base triples. In Proceedings of the Eleventh International Conference on Language Resources and Evaluati…
  24. Denis Emelin, Ronan Le Bras, Jena D Hwang, Maxwell Forbes, and Yejin Choi. 2021. Moral stories: Situated reasoning about norms, intents, actions, and their consequences. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 698–718. find
  25. Terrence Fong, Illah Nourbakhsh, and Kerstin Dautenhahn. 2003. A survey of socially interactive robots. Robotics and autonomous systems, 42(3-4):143–166. find
  26. Maxwell Forbes, Jena D Hwang, Vered Shwartz, Maarten Sap, and Yejin Choi. 2020. Social chemistry 101: Learning to reason about social and moral norms. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 653–670. find
  27. Yi R Fung, Tuhin Chakraborty, Hao Guo, Owen Rambow, Smaranda Muresan, and Heng Ji. 2022. Normsage: Multi-lingual multi-cultural norm discovery from conversations on-the-fly. arXiv preprint arXiv:2210.08604. find
  28. Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, et al. 2020. Evaluating models’ local decision boundaries via contrast sets. In Findings of the Association for Computational Linguistics: EMNLP 2020, pag…
  29. Ervin Goffman. 1959. The presentation of self in everyday life. Doubleday Anchor Books. find
  30. Joshua Grossman, Zhiyuan Lin, Hao Sheng, Johnny Tian-Zheng Wei, Joseph J Williams, and Sharad Goel. 2019. Mathbot: Transforming online resources for learning math into conversational interactions. find
  31. AAAI 2019 Story-Enabled Intelligence. find
  32. Jonathan Haidt, Silvia Helena Koller, and Maria G Dias. 1993. Affect, culture, and morality, or is it wrong to eat your dog? Journal of personality and social psychology, 65(4):613. find
  33. Vicki S Helgeson. 2016. Psychology of gender. Routledge. find
  34. Dan Hendrycks, Collin Burns, Steven Basart, Andrew Critch Critch, Jerry Li Li, Dawn Song, and Jacob Steinhardt. 2021. Aligning ai with shared human values. In International Conference on Learning Representations.
  35. Michael A Hogg and Scott A Reid. 2006. Social identity, self-categorization, and the communication of group norms. Communication theory, 16(1):7–30. find
  36. Dirk Hovy and Diyi Yang. 2021. The importance of modeling social factors of language: Theory and practice. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 588–602.
  37. Lifu Huang, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. 2019. Cosmos qa: Machine reading comprehension with contextual commonsense reasoning.
  38. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 2391–2401. find
  39. Gregory A Janicik and Caroline A Bartel. 2003. Talking about time: Effects of temporal planning and time awareness norms on group coordination and performance. Group Dynamics: Theory, Research, and Practice, 7(2):122. find
  40. Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei, and Minlie Huang. 2020a. Generating commonsense explanation by extracting bridge concepts from reasoning paths. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joi… find
  41. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 705– 714. find
  42. Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015b. Learning entity and relation embeddings for knowledge graph completion. In Twenty-ninth AAAI conference on artificial intelligence. find
  43. Leib Litman, Jonathan Robinson, and Cheskie Rosenzweig. 2015. The relationship between motivation, monetary compensation, and data quality among us-and india-based workers on mechanical turk. Behavior research methods, 47(2):519–528. find
  44. Hugo Liu and Push Singh. 2004. Conceptnet—a practical commonsense reasoning tool-kit. BT technology journal, 22(4):211–226. find
  45. Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei, Xiaoyan Zhu, and Minlie Huang. 2020b. Language generation with multi-hop reasoning on commonsense knowledge graph. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 725–736. find
  46. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692. find
  47. Liwei Jiang, Jena D Hwang, Chandra Bhagavatula, Ronan Le Bras, Maxwell Forbes, Jon Borchardt, Jenny Liang, Oren Etzioni, Maarten Sap, and Yejin Choi. 2021. Delphi: Towards machine ethics and norms. ArXiv preprint, abs/2110.07574. find
  48. Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net. find
  49. Divyansh Kaushik, Eduard Hovy, and Zachary Lipton. 2019. Learning the difference that makes a difference with counterfactually-augmented data. In International Conference on Learning Representations. find
  50. Nicholas Lourie, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. 2021a. Unicorn on rainbow: A universal commonsense reasoning model on a new multitask benchmark. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 13480–13488. find
  51. Joanna Klimczyk. 2021. Compositional semantics and normative ‘ought’. Axiomathes, 31(3):381–399. find
  52. Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2020. ALBERT: A lite BERT for self-supervised learning of language representations. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenRevi… find
  53. Douglas B Lenat. 1995. Cyc: A large-scale investment in knowledge infrastructure. Communications of the ACM, 38(11):33–38. find
  54. Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In Proceedings of the 58th Annual Meeting of the…
  55. Yankai Lin, Zhiyuan Liu, Huanbo Luan, Maosong Sun, Siwei Rao, and Song Liu. 2015a. Modeling relation paths for representation learning of knowledge bases.
  56. Nicholas Lourie, Ronan Le Bras, and Yejin Choi. 2021b. Scruples: A corpus of community ethical judgments on 32, 000 real-life anecdotes. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 13470–13479. find
  57. Aman Madaan, Dheeraj Rajagopal, Niket Tandon, Yiming Yang, and Eduard Hovy. 2021. Could you give me a hint? generating inference graphs for defeasible reasoning. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 5138–5147. find
  58. Kenneth E Mathews and Lance Kirkpatrick Canon. 1975. Environmental noise level as a determinant of helping behavior. Journal of Personality and Social Psychology, 32(4):571. find
  59. Rachel I McDonald and Christian S Crandall. 2015. Social norms and social influence. Current Opinion in Behavioral Sciences, 3:147–151. find
  60. Erin Meyer. 2014. The culture map: Breaking through the invisible boundaries of global business. Public Affairs. find
  61. Tom Mitchell, William Cohen, Estevam Hruschka, Partha Talukdar, Bishan Yang, Justin Betteridge, Andrew Carlson, Bhavana Dalvi, Matt Gardner, Bryan Kisiel, et al. 2018. Never-ending learning. Communications of the ACM, 61(5):103–115. find
  62. Arindam Mitra, Pratyay Banerjee, Kuntal Kumar Pal, Swaroop Mishra, and Chitta Baral. 2019. How additional knowledge can improve natural language commonsense question answering? arXiv preprint arXiv:1909.08855. — [arXiv:1909.08855](https://arxiv.org/abs/1909.08855) find
  63. György Molnár and Zoltán Szüts. 2018. The role of chatbots in formal education. In 2018 IEEE 16th International Symposium on Intelligent Systems and Informatics (SISY), pages 000197–000202. IEEE. find
  64. Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. 2019. Language models as knowledge bases? In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural…
  65. John L Pollock. 1987. Defeasible reasoning. Cognitive science, 11(4):481–518. find
  66. Lorien Y Pratt, Jack Mostow, Candace A Kamm, Ace A Kamm, et al. 1991. Direct transfer of learned information among neural networks. In Aaai, volume 91, pages 584–589. find
  67. Valentina Pyatkin, Jena D Hwang, Vivek Srikumar, Ximing Lu, Liwei Jiang, Yejin Choi, and Chandra Bhagavatula. 2022. Reinforced clarification question generation with defeasibility rewards for disambiguating social and moral situations. arXiv preprint arXiv:2212.10409. — [arXiv:2212.10409](https://arxiv.org/abs/2212.10409) find
  68. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9. find
  69. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1–67.
  70. Raymond Reiter. 1981. On closed world data bases. In Readings in artificial intelligence, pages 119–140. Elsevier. find
  71. Rachel Rudinger, Vered Shwartz, Jena D Hwang, Chandra Bhagavatula, Maxwell Forbes, Ronan Le Bras, Noah A Smith, and Yejin Choi. 2020. Thinking like a skeptic: Defeasible inference in natural language. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4661–4675. find
  72. James A Russell and Lawrence M Ward. 1982. Environmental psychology. Annual review of psychology, 33(1):651–689. find
  73. Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. 2020. Winogrande: An adversarial winograd schema challenge at scale. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 8732–8740. find
  74. Maarten Sap, Saadia Gabriel, Lianhui Qin, Dan Jurafsky, Noah A Smith, and Yejin Choi. 2020. Social bias frames: Reasoning about social and power implications of language. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5477–5490.
  75. Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A Smith, and Yejin Choi. 2019a. Atomic: An atlas of machine commonsense for if-then reasoning. In Proceedings of the AAAI conference on artificial intelligence, volume 33, pages 3027–3… find
  76. Maarten Sap, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi. 2019b. Social iqa: Commonsense reasoning about social interactions. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Process… find
  77. R. C. Schank and R. P. Abelson. 1977. Scripts, plans, goals, and understanding: An enquiry into human knowledge structures. Erlbaum. find
  78. Alister Scott, Alana Gilbert, and Ayele Gelan. 2007. The urban-rural divide: Myth or reality? Macaulay Institute Aberdeen. find
  79. Kim Bartel Sheehan. 2018. Crowdsourcing research: data collection with amazon’s mechanical turk. Communication Monographs, 85(1):140–156. find
  80. Muzafer Sherif and Carolyn W Sherif. 1953. Groups in harmony and tension; an integration of studies of intergroup relations. find
  81. Baoxu Shi and Tim Weninger. 2018. Open-world knowledge graph completion. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32. find
  82. Richard A Shweder. 1990. In defense of moral realism: Reply to gabennesch. Child Development, 61(6):2060–2067. find
  83. Richard Socher, Danqi Chen, Christopher D Manning, and Andrew Ng. 2013. Reasoning with neural tensor networks for knowledge base completion. Advances in neural information processing systems, 26.
  84. Robyn Speer, Joshua Chin, and Catherine Havasi. 2017. Conceptnet 5.5: An open multilingual graph of general knowledge. In Thirty-first AAAI conference on artificial intelligence. find
  85. Cass R Sunstein. 1996. Social norms and social roles. Colum. L. Rev., 96:903. find
  86. Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, and Adina Williams. 2022. On the machine learning of ethical judgments from natural language. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Langu… find
  87. Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. 2019. Commonsenseqa: A question answering challenge targeting commonsense knowledge. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
  88. Sheng Zhang, Xiaodong Liu, Jingjing Liu, Jianfeng Gao, Kevin Duh, and Benjamin Van Durme. 2018. Record: Bridging the gap between human and machine commonsense reading comprehension.
  89. Caleb Ziems, Jane A. Yu, Yi-Chia Wang, Alon Y. Halevy, and Diyi Yang. 2022. The moral integrity corpus: A benchmark for ethical dialogue systems. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language…
  90. Edward H Thompson Jr and Joseph H Pleck. 1986. The structure of male role norms. American Behavioral Scientist, 29(5):531–543. find
  91. Trieu H Trinh and Quoc V Le. 2018. A simple method for commonsense reasoning. arXiv preprint arXiv:1806.02847. find
  92. Aditya Nrusimha Vaidyam, Hannah Wisniewski, John David Halamka, Matcheri S Kashavan, and John Blake Torous. 2019. Chatbots and conversational agents in mental health: a review of the psychiatric landscape. The Canadian Journal of Psychiatry, 64(7):456–464. find
  93. Leon van Rijswijk and Antal Haans. 2018. Illuminating for safety: Investigating the role of lighting appraisals on the perception of safety in the urban environment. Environment and behavior, 50(8):889–912. find
  94. Paul Vicol, Makarand Tapaswi, Lluis Castrejon, and Sanja Fidler. 2018. Moviegraphs: Towards understanding human-centric situations from videos. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8581–8590. find
  95. Iris Vilnai-Yavetz and Shaked Gilboa. 2010. The effect of servicescape cleanliness on customer reactions. Services Marketing Quarterly, 31(2):213–234. find
  96. Cunxiang Wang, Shuailong Liang, Yue Zhang, Xiaonan Li, and Tian Gao. 2019. Does it make sense? and why? a pilot study for sense making and explanation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4020–4026, Florence, Italy. Association for Comput…
  97. Jason Weston, Antoine Bordes, Oksana Yakhnenko, and Nicolas Usunier. 2013. Connecting language and knowledge bases with embedding models for relation extraction. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1366–1371. find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/ziems-2023-normbank-knowledge-bank-situational-social/