Add XQuery support

[apb2006]

Is there an existing issue for this?

• I have searched the existing issues

What is the missing lexer?

XQuery ideally supporting 3.1 https://www.w3.org/TR/xquery-31/

Links to existing syntax definitions

Server side

• Pygments (Python) Website: https://pygments.org/ XQuery Lexer: Built-in
• Rouge (Ruby) GitHub: https://github.com/rouge-ruby/rouge XQuery Support: https://github.com/rouge-ruby/rouge/blob/master/lib/rouge/lexers/xquery.rb
• Go https://github.com/d4l3k/go-highlight/blob/master/languages/xquery.go

Javascript

• highlighter.js
• Textmate
• PrismJS

[apb2006]

The Pygments lexer supports XQuery 3.0 only, but is better than nothing. I hope to see how the convert tool does.

(From https://pygments.org/demo/)

[apb2006]

Running the conversion tool generates a number of warnings

python3 _tools/pygments2chroma_xml.py  pygments.lexers.webmisc.XQueryLexer > lexers/embedded/xquery.xml    
warning: unsupported emitter function <function XQueryLexer.popstate_callback at 0x0000023CDDA9F740>
warning: unsupported emitter function <function XQueryLexer.pushstate_root_callback at 0x0000023CDDAB04A0>
warning: unsupported emitter function <function XQueryLexer.operator_root_callback at 0x0000023CDDA9F4C0>
warning: unsupported emitter function <function XQueryLexer.punctuation_root_callback at 0x0000023CDDA9F420>
.... more like this

The generated xml file is xquery.xml
The issues seem to be

• these unsupported emitter function warnings
• The XML is invalid by virtue of repeated <push @State attributes for instance. I notice the existingautohotkey.xml also has this.

I am somewhat hampered in making sense of this by having no knowledge of go and not a lot of python knowledge.

I suspect

• The unsupported emitter function messages mean a go coded solution is required.
• This is not a trival task.

Any advice?