Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context
Paper · 2018 · Moritz Schubotz, Andre Greiner-Petter, Philipp Scharpf et al.
Summary
Mathematical notation is highly ambiguous. The same symbol can mean different things in different documents: E might be energy or expected value, and [a, b] might be an interval or a commutator. Presentation formats such as LaTeX record only layout, while computer algebra systems need explicit semantics, so converting between them is error-prone. The authors make three contributions. First, they release MathMLben, an open benchmark containing:
- formulae drawn from NTCIR tasks and the DLMF;
- a manually curated MathML gold standard covering both presentation and content, with formula components linked to Wikidata;
- annotation-support tools;
- tree-based evaluation metrics.
Second, they systematically evaluate common LaTeX-to-MathML converters. Many tools cannot produce content MathML at all, and those that can often yield mathematically wrong trees even for simple input. LaTeXML performs best but is slow. Third, they enrich LaTeXML conversion with textual context. A mathematical language processing (MLP) pipeline extracts identifier-definiens pairs from the surrounding text, and rule-based tree refinements are then applied. In a small pilot, these refinements fully repaired several content trees. The work matters as a reusable resource for format conversion and math information retrieval.
Key points
- MathMLben benchmark: a gold standard with presentation and content MathML. Identifiers, operators and other entities are linked to Wikidata, so the data can also support formula concept discovery.
- Converter evaluation:
- The authors evaluated state-of-the-art LaTeX-to-MathML and CAS import tools with an automated, rerunnable framework.
- LaTeXML had the lowest error rate and was the most extensible, but it was also slow.
- Context-aware method:
- The MLP software was extended beyond Wikipedia to parse XHTML (NTCIR, DLMF) and to identify general symbols, not only identifiers.
- It was combined with semantic macros and a custom LaTeXML style sheet. The style sheet handles superscripts versus powers, subscripts as parameters, and function application versus multiplication.
- Pilot result: out of 10 test functions, MLP ranked "function" as the top definiens in 4 cases. In those 4 cases, the content-tree distance to the gold standard dropped to zero.
- Limitations and future work:
- The rule-based selection has a long tail of special cases, and automatic learning of notation did not succeed.
- Planned work covers automated notation detection and "notational name spaces".
Institutions
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 19,503 worksComputer Vision and Pattern Recognition · 3,621 worksMathematics · 233 worksComputational Theory and Mathematics · 496 worksModeling and Simulation · 12 works
🧭 Topics 1Research subjects and languages the work is about.Reasoning · 1,948 works
Cite
Cite as Moritz Schubotz, Andre Greiner-Petter, Philipp Scharpf, Norman Meuschke, Howard Cohl and Bela Gipp. 2018. Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context. arXiv:1804.04956 (Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), Jun. 2018, Fort Worth, USA).
@misc{schubotz2018improving,
title = {{Improving the Representation and Conversion of Mathematical Formulae by Considering their Textual Context}},
author = {Moritz Schubotz, Andre Greiner-Petter, Philipp Scharpf, Norman Meuschke, Howard Cohl and Bela Gipp},
year = {2018},
doi = {10.1145/3197026.3197058},
eprint = {1804.04956},
archivePrefix = {arXiv},
url = {https://doi.org/10.1145/3197026.3197058}
}References
- A. Aizawa et al. NTCIR-11 Math-2 Task Overview. In: Proc. 11th NTCIR Conf. on Evaluation of Information Access Technologies, Tokyo, Japan. 2014.
- F. Cajori. A history of mathematical notations. Courier Corporation, 1928. find
- H. S. Cohl et al. Digital Repository of Mathematical Formulae. In: Conference on Intelligent Computer Mathematics (CICM), Coimbra, Portugal. 2014, pp. 419–422. doi: 10.1007/978-3-319-08434-3_30. — [doi:10.1007/978-3-319-08434-3_30](https://doi.org/10.1007/978-3-319-08434-3_30) find
- H. S. Cohl et al. Growing the Digital Repository of Mathematical Formulae with Generic Sources. In: CICM, Washington, DC, USA. 2015, pp. 280–287. doi: 10.1007/978-3-319-20615-8_18. — [doi:10.1007/978-3-319-20615-8_18](https://doi.org/10.1007/978-3-319-20615-8_18) find
- H. S. Cohl et al. Semantic Preserving Bijective Mappings of Mathematical Formulae between Document Preparation Systems and Computer Algebra Systems. In: CICM, Edinburgh, UK. 2017. doi: 10.1007/978-3-319-62075-6_9. — [doi:10.1007/978-3-319-62075-6_9](https://doi.org/10.1007/978-3-319-62075-6_9) find
- P. Dehaye et al. Interoperability in the OpenDreamKit Project: The Math-in-the-Middle Approach. In: CICM, Bialystok, Poland. 2016, pp. 117–131. doi: 10.1007/978-3-319-42547-4_9. — [doi:10.1007/978-3-319-42547-4_9](https://doi.org/10.1007/978-3-319-42547-4_9) find
- NIST Digital Library of Mathematical Functions. http://dlmf.nist.gov/, Release 1.0.17 of 2017-12-22. F. W. J. Olver, et al. eds. ↗
- M. England et al. Branch cuts in Maple 17. In: ACM Comm. Comp. Algebra (2014), pp. 24–27. doi: 10.1145/2644288.2644293. — [doi:10.1145/2644288.2644293](https://doi.org/10.1145/2644288.2644293) find
- D. Ginev, H. Stamerjohanns, and M. Kohlhase. The LaTeXML Daemon: Editable Math on the Collaborative Web. In: LWA 2011, Magdeburg, Germany. 2011, pp. 255–256. find
- P. D. F. Ion and S. M. Watt. The Global Digital Mathematical Library and the International Mathematical Knowledge Trust. In: CICM, Edinburgh, UK. 2017, pp. 56–69. find
- N. Meuschke et al. Analyzing Mathematical Content to Detect Academic Plagiarism. In: Proc. CIKM. 2017. find
- B. Miller. LaTeXML: A L A TEX to XML Converter. http://dlmf.nist.gov/LaTeXML/. Accessed: 2018-01-18. ↗
- B. R. Miller and A. Youssef. Technical Aspects of the Digital Library of Mathematical Functions. In: Ann. Math. Artif. Intell. (2003), pp. 121– 136. doi: 10.1023/A:1022967814992. — [doi:10.1023/a:1022967814992](https://doi.org/10.1023/a:1022967814992) find
- M.-Q. Nghiem et al. Automatic approach to understanding mathematical expressions using mathml parallel markup corpora. In: 26th Annu. Conf. Jap. Society for Artificial Intell. 2012. find
- L. Padovani. On the Roles of L A TEX and MathML in Encoding and Processing Mathematical Expressions. In: Mathematical Knowledge Management (MKM), Bertinoro, Italy. 2003, pp. 66–79. doi: 10.1007/3-540-36469-2_6. — [doi:10.1007/3-540-36469-2_6](https://doi.org/10.1007/3-540-36469-2_6) find
- M. Pawlik and N. Augsten. RTED: A Robust Algorithm for the Tree Edit Distance. In: CoRR (2012). arXiv: 1201.0230. find
- M. Schubotz. Augmenting Mathematical Formulae for More Effective Querying & Efficient Presentation. PhD thesis. TU Berlin, Germany, 2017. find
- M. Schubotz. Implicit Content Dictionaries in the NIST Digital Repository of Mathematical Formulae. English. Talk presented at the Open-Math workshop CICM. Bialystok, Poland, 2016. find
- M. Schubotz, D. Veenhuis, and H. S. Cohl. Getting the units right. In: Workshop and Work in Progress Papers at CICM 2016, Bialystok, Poland. 2016, pp. 146–156. find
- M. Schubotz and G. Wicke. Mathoid: Robust, Scalable, Fast and Accessible Math Rendering for Wikipedia. In: CICM, Coimbra, Portugal. 2014, pp. 224–235. doi: 10.1007/978-3-319-08434-3_17. — [doi:10.1007/978-3-319-08434-3_17](https://doi.org/10.1007/978-3-319-08434-3_17) find
- M. Schubotz et al. Challenges of Mathematical Information Retrieval in the NTCIR-11 Math Wikipedia Task. In: Special Interest Group on Information Retrieval (SIGIR), Santiago, Chile. 2015, pp. 951–954. doi: 10.1145/2766462.2767787. — [doi:10.1145/2766462.2767787](https://doi.org/10.1145/2766462.2767787) find
- M. Schubotz et al. Evaluating and Improving the Extraction of Mathematical Identifier Definitions. In: Conference and Labs of the Evaluation Forum (CLEF), Dublin, Ireland. 2017, pp. 82–94. doi: 10.1007/978-3-319-65813-1_7. — [doi:10.1007/978-3-319-65813-1_7](https://doi.org/10.1007/978-3-319-65813-1_7) find
- M. Schubotz et al. Evaluation of Similarity-Measure Factors for Formulae Based on the NTCIR-11 Math Task. In: 11th NTCIR, Tokyo, Japan. 2014. find
- M. Schubotz et al. Semantification of Identifiers in Mathematics for Better Math Information Retrieval. In: SIGIR, Pisa, Italy. 2016, pp. 135–144. doi: 10.1145/2911451.2911503. — [doi:10.1145/2911451.2911503](https://doi.org/10.1145/2911451.2911503) find
- M. Schubotz et al. VMEXT: A Visualization Tool for Mathematical Expression Trees. In: CICM, Edinburgh, UK. 2017, pp. 340–355. doi: 10.1007/978-3-319-62075-6_24. — [doi:10.1007/978-3-319-62075-6_24](https://doi.org/10.1007/978-3-319-62075-6_24) find
- H. Stamerjohanns et al. MathML-aware Article Conversion from La-TeX. In: Towards a Digital Mathematics Library. Grand Bend, Ontario, Canada. 2009, pp. 109–120. find
- S. M. Watt. Exploiting implicit mathematical semantics in conversion between TeX and MathML. In: Proc. Internet Accessible Math. Commun. (IAMC) (2002). find
- A. Youssef. Part-of-Math Tagging and Applications. In: CICM, Edinburgh, UK. 2017, pp. 356–374. doi: 10.1007/978-3-319-62075-6_25. Listing 2: Use the following BibTeX code to cite this article @InProceedings{Schubotz2018, author = {Schubotz, Moritz and Greiner-Petter, Andre and Scharpf, Philipp and M… — [doi:10.1007/978-3-319-62075-6_25](https://doi.org/10.1007/978-3-319-62075-6_25) find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/schubotz-2018-improving-representation-conversion-mathematical-formulae/