Elamur Research⌕
☰
home / papers / 2018 / Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context

Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context

Paper · 2018 · Moritz Schubotz, Andre Greiner-Petter, Philipp Scharpf et al.

Summary

Mathematical notation is highly ambiguous. The same symbol can mean different things in different documents: E might be energy or expected value, and [a, b] might be an interval or a commutator. Presentation formats such as LaTeX record only layout, while computer algebra systems need explicit semantics, so converting between them is error-prone. The authors make three contributions. First, they release MathMLben, an open benchmark containing:

  • formulae drawn from NTCIR tasks and the DLMF;
  • a manually curated MathML gold standard covering both presentation and content, with formula components linked to Wikidata;
  • annotation-support tools;
  • tree-based evaluation metrics.

Second, they systematically evaluate common LaTeX-to-MathML converters. Many tools cannot produce content MathML at all, and those that can often yield mathematically wrong trees even for simple input. LaTeXML performs best but is slow. Third, they enrich LaTeXML conversion with textual context. A mathematical language processing (MLP) pipeline extracts identifier-definiens pairs from the surrounding text, and rule-based tree refinements are then applied. In a small pilot, these refinements fully repaired several content trees. The work matters as a reusable resource for format conversion and math information retrieval.

Key points

  • MathMLben benchmark: a gold standard with presentation and content MathML. Identifiers, operators and other entities are linked to Wikidata, so the data can also support formula concept discovery.
  • Converter evaluation:
    • The authors evaluated state-of-the-art LaTeX-to-MathML and CAS import tools with an automated, rerunnable framework.
    • LaTeXML had the lowest error rate and was the most extensible, but it was also slow.
  • Context-aware method:
    • The MLP software was extended beyond Wikipedia to parse XHTML (NTCIR, DLMF) and to identify general symbols, not only identifiers.
    • It was combined with semantic macros and a custom LaTeXML style sheet. The style sheet handles superscripts versus powers, subscripts as parameters, and function application versus multiplication.
  • Pilot result: out of 10 test functions, MLP ranked "function" as the top definiens in 4 cases. In those 4 cases, the content-tree distance to the gold standard dropped to zero.
  • Limitations and future work:
    • The rule-based selection has a long tail of special cases, and automatic learning of notation did not succeed.
    • Planned work covers automated notation detection and "notational name spaces".

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

 Fields, topics and concepts

Cite

Cite as Moritz Schubotz, Andre Greiner-Petter, Philipp Scharpf, Norman Meuschke, Howard Cohl and Bela Gipp. 2018. Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context. arXiv:1804.04956 (Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), Jun. 2018, Fort Worth, USA).

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.1145/3197026.3197058 · arXiv 1804.04956

@misc{schubotz2018improving,
  title = {{Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context}},
  author = {Moritz Schubotz, Andre Greiner-Petter, Philipp Scharpf, Norman Meuschke, Howard Cohl and Bela Gipp},
  year = {2018},
  doi = {10.1145/3197026.3197058},
  eprint = {1804.04956},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.1145/3197026.3197058}
}

References

28 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. A. Aizawa et al. NTCIR-11 Math-2 Task Overview. In: Proc. 11th NTCIR Conf. on Evaluation of Information Access Technologies, Tokyo, Japan. 2014.
  2. F. Cajori. A history of mathematical notations. Courier Corporation, 1928. find
  3. H. S. Cohl et al. Digital Repository of Mathematical Formulae. In: Conference on Intelligent Computer Mathematics (CICM), Coimbra, Portugal. 2014, pp. 419–422. doi: 10.1007/978-3-319-08434-3_30. — [doi:10.1007/978-3-319-08434-3_30](https://doi.org/10.1007/978-3-319-08434-3_30) find
  4. H. S. Cohl et al. Growing the Digital Repository of Mathematical Formulae with Generic Sources. In: CICM, Washington, DC, USA. 2015, pp. 280–287. doi: 10.1007/978-3-319-20615-8_18. — [doi:10.1007/978-3-319-20615-8_18](https://doi.org/10.1007/978-3-319-20615-8_18) find
  5. H. S. Cohl et al. Semantic Preserving Bijective Mappings of Mathematical Formulae between Document Preparation Systems and Computer Algebra Systems. In: CICM, Edinburgh, UK. 2017. doi: 10.1007/978-3-319-62075-6_9. — [doi:10.1007/978-3-319-62075-6_9](https://doi.org/10.1007/978-3-319-62075-6_9) find
  6. P. Dehaye et al. Interoperability in the OpenDreamKit Project: The Math-in-the-Middle Approach. In: CICM, Bialystok, Poland. 2016, pp. 117–131. doi: 10.1007/978-3-319-42547-4_9. — [doi:10.1007/978-3-319-42547-4_9](https://doi.org/10.1007/978-3-319-42547-4_9) find
  7. NIST Digital Library of Mathematical Functions. http://dlmf.nist.gov/, Release 1.0.17 of 2017-12-22. F. W. J. Olver, et al. eds. ↗
  8. M. England et al. Branch cuts in Maple 17. In: ACM Comm. Comp. Algebra (2014), pp. 24–27. doi: 10.1145/2644288.2644293. — [doi:10.1145/2644288.2644293](https://doi.org/10.1145/2644288.2644293) find
  9. D. Ginev, H. Stamerjohanns, and M. Kohlhase. The LaTeXML Daemon: Editable Math on the Collaborative Web. In: LWA 2011, Magdeburg, Germany. 2011, pp. 255–256. find
  10. P. D. F. Ion and S. M. Watt. The Global Digital Mathematical Library and the International Mathematical Knowledge Trust. In: CICM, Edinburgh, UK. 2017, pp. 56–69. find
  11. N. Meuschke et al. Analyzing Mathematical Content to Detect Academic Plagiarism. In: Proc. CIKM. 2017. find
  12. B. Miller. LaTeXML: A L A TEX to XML Converter. http://dlmf.nist.gov/LaTeXML/. Accessed: 2018-01-18. ↗
  13. B. R. Miller and A. Youssef. Technical Aspects of the Digital Library of Mathematical Functions. In: Ann. Math. Artif. Intell. (2003), pp. 121– 136. doi: 10.1023/A:1022967814992. — [doi:10.1023/a:1022967814992](https://doi.org/10.1023/a:1022967814992) find
  14. M.-Q. Nghiem et al. Automatic approach to understanding mathematical expressions using mathml parallel markup corpora. In: 26th Annu. Conf. Jap. Society for Artificial Intell. 2012. find
  15. L. Padovani. On the Roles of L A TEX and MathML in Encoding and Processing Mathematical Expressions. In: Mathematical Knowledge Management (MKM), Bertinoro, Italy. 2003, pp. 66–79. doi: 10.1007/3-540-36469-2_6. — [doi:10.1007/3-540-36469-2_6](https://doi.org/10.1007/3-540-36469-2_6) find
  16. M. Pawlik and N. Augsten. RTED: A Robust Algorithm for the Tree Edit Distance. In: CoRR (2012). arXiv: 1201.0230. find
  17. M. Schubotz. Augmenting Mathematical Formulae for More Effective Querying & Efficient Presentation. PhD thesis. TU Berlin, Germany, 2017. find
  18. M. Schubotz. Implicit Content Dictionaries in the NIST Digital Repository of Mathematical Formulae. English. Talk presented at the Open-Math workshop CICM. Bialystok, Poland, 2016. find
  19. M. Schubotz, D. Veenhuis, and H. S. Cohl. Getting the units right. In: Workshop and Work in Progress Papers at CICM 2016, Bialystok, Poland. 2016, pp. 146–156. find
  20. M. Schubotz and G. Wicke. Mathoid: Robust, Scalable, Fast and Accessible Math Rendering for Wikipedia. In: CICM, Coimbra, Portugal. 2014, pp. 224–235. doi: 10.1007/978-3-319-08434-3_17. — [doi:10.1007/978-3-319-08434-3_17](https://doi.org/10.1007/978-3-319-08434-3_17) find
  21. M. Schubotz et al. Challenges of Mathematical Information Retrieval in the NTCIR-11 Math Wikipedia Task. In: Special Interest Group on Information Retrieval (SIGIR), Santiago, Chile. 2015, pp. 951–954. doi: 10.1145/2766462.2767787. — [doi:10.1145/2766462.2767787](https://doi.org/10.1145/2766462.2767787) find
  22. M. Schubotz et al. Evaluating and Improving the Extraction of Mathematical Identifier Definitions. In: Conference and Labs of the Evaluation Forum (CLEF), Dublin, Ireland. 2017, pp. 82–94. doi: 10.1007/978-3-319-65813-1_7. — [doi:10.1007/978-3-319-65813-1_7](https://doi.org/10.1007/978-3-319-65813-1_7) find
  23. M. Schubotz et al. Evaluation of Similarity-Measure Factors for Formulae Based on the NTCIR-11 Math Task. In: 11th NTCIR, Tokyo, Japan. 2014. find
  24. M. Schubotz et al. Semantification of Identifiers in Mathematics for Better Math Information Retrieval. In: SIGIR, Pisa, Italy. 2016, pp. 135–144. doi: 10.1145/2911451.2911503. — [doi:10.1145/2911451.2911503](https://doi.org/10.1145/2911451.2911503) find
  25. M. Schubotz et al. VMEXT: A Visualization Tool for Mathematical Expression Trees. In: CICM, Edinburgh, UK. 2017, pp. 340–355. doi: 10.1007/978-3-319-62075-6_24. — [doi:10.1007/978-3-319-62075-6_24](https://doi.org/10.1007/978-3-319-62075-6_24) find
  26. H. Stamerjohanns et al. MathML-aware Article Conversion from La-TeX. In: Towards a Digital Mathematics Library. Grand Bend, Ontario, Canada. 2009, pp. 109–120. find
  27. S. M. Watt. Exploiting implicit mathematical semantics in conversion between TeX and MathML. In: Proc. Internet Accessible Math. Commun. (IAMC) (2002). find
  28. A. Youssef. Part-of-Math Tagging and Applications. In: CICM, Edinburgh, UK. 2017, pp. 356–374. doi: 10.1007/978-3-319-62075-6_25. Listing 2: Use the following BibTeX code to cite this article @InProceedings{Schubotz2018, author = {Schubotz, Moritz and Greiner-Petter, Andre and Scharpf, Philipp and M… — [doi:10.1007/978-3-319-62075-6_25](https://doi.org/10.1007/978-3-319-62075-6_25) find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/schubotz-2018-improving-representation-conversion-mathematical-formulae/