Elamur Research⌕
☰
home / papers / 2026 / RelEx-PT: A Portuguese Sentence-Level Relation Extraction Dataset

RelEx-PT: A Portuguese Sentence-Level Relation Extraction Dataset

Summary

Portuguese relation extraction lacks clean, controlled benchmarks. Existing resources tend to cover narrow domains, are skewed toward a few relations, target multi-sentence contexts, or depend on costly manual annotation. The authors address this with RelEx-PT, a natively Portuguese dataset in which each sentence has two marked entities and one relation, so every item corresponds to a single <subject, relation, object> triple. Instances are collected automatically by matching Wikidata facts to Portuguese Wikipedia sentences (distant supervision). An NLI model then discards matches where the sentence does not actually support the relation. The authors establish baselines with both prompted and fine-tuned LLMs on three tasks: Open Information Extraction (OpenIE), the extraction of relation triples (RTE), and the classification of relations (RC). For OpenIE, freely generated relations are mapped back to the schema for scoring. Models perform strongly on RC and reasonably on structured triple generation, but open-ended extraction remains hard. The resource gives Portuguese a counterpart to English sentence-level benchmarks such as CoNLL04, and the released pipeline lets others extend it or build new datasets.

Key points

  • RelEx-PT covers 18 Wikidata relation types with perfect class balance. Examples include author (P50), place of birth (P19), instance of (P31) and headquarters location (P159).
  • It contains 1,800 instances in total: 1,260 for training (70 per relation) and 540 for testing (30 per relation).
  • The construction pipeline combines Wikidata–Wikipedia distant supervision with NLI-based noise filtering, a filtering idea adopted from SRED FM. Both the dataset and the pipeline are on GitHub (TomasCCPinto/RelEx-PT).
  • Prior Portuguese resources differ in scope. SMiLER has 22 relations and an uneven distribution, while SRED FM has 400 relations, is cross-sentence and is highly unbalanced. DBpediaRelations-PT is sentence-level with 10 relations, and Bete is limited to the diabetes domain.
  • The dataset is released under CC BY-SA 4.0, inherited from Wikipedia text; Wikidata itself is CC0.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: Linguistics & languages

Cite

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.63317/473a5ncxrap4

@inproceedings{pinto2026relex,
  title = {{RelEx-PT: A Portuguese Sentence-Level Relation Extraction Dataset}},
  author = {Pinto, Tomás and Silva, Catarina and Oliveira, Hugo Goncalo},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/473a5ncxrap4},
  url = {https://doi.org/10.63317/473a5ncxrap4}
}

References

37 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. David Soares Batista, David Forte, Rui Silva, Bruno Martins, and Mário Silva. 2013. Extracção de relações semânticas de textos em Português explorando a Dbpédia e a Wikipédia. Linguamatica, 5(1):41–57. find
  2. Pere-Lluís Huguet Cabot, Simone Tedeschi, Axel-Cyrille Ngonga Ngomo, and Roberto Navigli. 2023. RED FM: a filtered and multilingual relation extraction dataset. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4326–4343, Toront… find
  3. Bruno Cabral, Marlo Souza, and Daniela Barreiro Claro. 2022. PortNOIE: A neural framework for open information extraction for the Portuguese language. In International Conference on Computational Processing of the Portuguese Language, pages 243–255. Springer. find
  4. Diedre Carmo, Marcos Piau, Israel Campiotti, Rodrigo Nogueira, and Roberto Lotufo. 2020. PTT5: Pretraining and validating the T5 model on Brazilian Portuguese data. arXiv preprint arXiv:2008.09144. — [arXiv:2008.09144](https://arxiv.org/abs/2008.09144) find
  5. Ruan Chaves Rodrigues. 2023. Lessons learned from the evaluation of portuguese language models. Master’s thesis, University of Malta. find
  6. Kartik Detroja, CK Bhensdadia, and Brijesh S Bhatt. 2023. A survey on relation extraction. Intelligent Systems with Applications, 19:200244. find
  7. Jose A Diaz-Garcia and Julio Amador Diaz Lopez. 2025. A survey on cutting-edge relation extraction techniques based on language models. Artificial Intelligence Review, 58(9):287. find
  8. Cláudia Freitas, Diana Santos, Cristina Mota, Hugo Gonçalo Oliveira, and Paula Carvalho. 2009. Detection of relations between named entities: report of a shared task. In Proceedings of NAACL-HLT, Semantic Evaluations: Recent Achievements and Future Directions Workshop, SEW 2009, Boulder, Colorado. A… find
  9. Luís Gomes, António Branco, João Silva, João Rodrigues, and Rodrigo Santos. 2024. Open sentence embeddings for portuguese with the Serafim PT* encoders family. In Proceedings of 23rd EPIA Conference on Artificial Intelligence, EPIA 2024, pages 267–279. Springer. find
  10. Michael A Hedderich, Lukas Lange, Heike Adel, Jannik Strötgen, and Dietrich Klakow. 2021. A survey on recent approaches for natural language processing in low-resource scenarios. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Hum… find our card
  11. Iris Hendrickx, Su Nam Kim, Zornitsa Kozareva, Preslav Nakov, Diarmuid Ó Séaghdha, Sebastian Padó, Marco Pennacchiotti, Lorenza Romano, and Stan Szpakowicz. 2010. SemEval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals. In Proceedings of the 5th International Wo… find our card
  12. Daniel Hewlett, Alexandre Lacoste, Llion Jones, Illia Polosukhin, Andrew Fandrianto, Jay Han, Matthew Kelcey, and David Berthelot. 2016. Wikireading: A novel large-scale language understanding task over wikipedia. arXiv preprint arXiv:1608.03542. find
  13. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et al. 2024. GPT-4o system card. arXiv preprint arXiv:2410.21276. find our card
  14. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix,… find
  15. Yizhi Jiang, Jinlong Li, and Huanhuan Chen. 2024. Relation classification via bidirectional prompt learning with data augmentation by large language model. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pa… find
  16. Nora Kassner, Philipp Dufter, and Hinrich Schütze. 2021. Multilingual LAMA: Investigating knowledge in multilingual pretrained language models. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 3250– 3258, Online. Assoc… find our card
  17. Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, et al. 2024. DeepSeek-V3 technical report. arXiv preprint arXiv:2412.19437. find
  18. Meta. 2024. Llama 3.3 Model Card. https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/MODEL_CARD.md. ↗
  19. Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. 2009. Distant supervision for relation extraction without labeled data. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 10… find
  20. OpenAI. 2025. Introducing GPT-4.1 in the API. find
  21. Pranshu Pandya, Mahek Bhavesh Vora, Soumya Bharadwaj, Ashish Anand, et al. 2024. Amalrec: A dataset for relation extraction and classification leveraging amalgamation of large language models. arXiv preprint arXiv:2412.20427. — [arXiv:2412.20427](https://arxiv.org/abs/2412.20427) find
  22. Lucas Pavanelli, Yohan Bonescki Gumiel, Thiago Ferreira, Adriana Pagano, and Eduardo Laber. 2023. Bete: A brazilian portuguese dataset for named entity recognition and relation extraction in the diabetes healthcare domain. In Brazilian Conference on Intelligent Systems, pages 256– 267. Springer. find
  23. Tomás Pinto, Bruno Ferreira, Catarina Silva, and Hugo Gonçalo Oliveira. 2025. Prompting LLMs for relation classification in portuguese: Is it worth it? In Proceedings of 24th EPIA Conference on Artificial Intelligence, EPIA 2025, pages 249–261, Cham. Springer Nature Switzerland. find
  24. Alan Rios, Bruno Cabral, Daniela Claro, Rerisson Cavalcante, and Marlo Souza. 2024. TransAlign: An automated corpus generation through cross-linguistic data alignment for open information extraction. In Proceedings of the 16th International Conference on Computational Processing of Portuguese, pages… find
  25. Dan Roth and Wen-tau Yih. 2004. A linear programming formulation for global inference in natural language tasks. In Proceedings of the eighth conference on computational natural language learning (CoNLL-2004) at HLT-NAACL 2004, pages 1–8. find our card
  26. Rodrigo Santos, João Rodrigues, Luís Gomes, João Silva, António Branco, Henrique Lopes Cardoso, Tomás Freitas Osório, and Bernardo Leite. 2024. Fostering the ecosystem of open neural encoders for portuguese with Albertina PT* family. In Proceedings of the 3rd Annual Meeting of the Special Interest G… find
  27. Alessandro Seganti, Klaudia Firląg, Helena Skowronska, Michał Satława, and Piotr Andruszkiewicz. 2021. Multilingual entity and relation extraction dataset and model. In Proceedings of the 16th conference of the european chapter of the association for computational linguistics: Main volume, pages 194… find
  28. Cleiton Fernando Lima Sena and Daniela Barreiro Claro. 2020. PragmaticOIE: a pragmatic open information extraction for Portuguese language. Knowledge and Information Systems, 62(9):3811–3836. find
  29. Fábio Souza, Rodrigo Nogueira, and Roberto Lotufo. 2020. BERTimbau: pretrained BERT models for Brazilian Portuguese. In Intelligent Systems: 9th Brazilian Conference, BRACIS 2020, Rio Grande, Brazil, October 20–23, 2020, Proceedings, Part I 9, pages 403–417. Springer. find
  30. Gemma Team, Aishwarya Kamath, Johan Ferret, Shreya Pathak, Nino Vieillard, Ramona Merhej, Sarah Perrin, Tatiana Matejovicova, Alexandre Ramé, Morgane Rivière, et al. 2025. Gemma 3 technical report. arXiv preprint arXiv:2503.19786. find
  31. Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, et al. 2024. Gemma 2: Improving open language models at a practical size. arXiv preprint arXiv:2408.00118. find
  32. Xiang Wei, Xingyu Cui, Ning Cheng, Xiaobin Wang, Xin Zhang, Shen Huang, Pengjun Xie, Jinan Xu, Yufeng Chen, Meishan Zhang, Yong Jiang, and Wenjuan Han. 2024. Chatie: Zero-shot information extraction via chatting with chatgpt. find our card
  33. Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, and Maosong Sun. 2019a. DocRED: A large-scale document-level relation extraction dataset. arXiv preprint arXiv:1906.06127. find
  34. Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, and Maosong Sun. 2019b. DocRED: A large-scale document-level relation extraction dataset. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 764–777, Flo… find
  35. Kai Zhang, Bernal Jiménez Gutiérrez, and Yu Su. 2023. Aligning instruction tasks unlocks large language models as zero-shot relation extractors. arXiv preprint arXiv:2305.11159. find
  36. Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, and Christopher D Manning. 2017. Position-aware attention and supervised data improve slot filling. In Proceedings of the 2017 conference on empirical methods in natural language processing, pages 35–45. find
  37. Xiaoyan Zhao, Yang Deng, Min Yang, Lingzhi Wang, Rui Zhang, Hong Cheng, Wai Lam, Ying Shen, and Ruifeng Xu. 2024. A comprehensive survey on relation extraction: Recent advances and new frontiers. ACM Computing Surveys, 56(11):1–39. find

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/pinto-2026-relex-pt-portuguese-sentence-level/