Update legacy lexers

[orbitalquark]

Scintillua 6.0 considers lexers from Scintillua 5.x to be legacy lexers. While legacy lexers should still function properly, they ought to be migrated using this migration guide.

In addition to the steps outlined in the migration guide, programming language lexers should ideally distinguish between functions, builtin functions, and methods. They should also distinguish between constants and builtin constants, and variables and builtin variables. For example, the Lua lexer does so here and here. The Makefile lexer does so here.

Lexers that use custom tokens should try and pick from the updated list of tags. If that is not possible/reasonable, it may be worth considering adding to that list. Otherwise, it should remain a custom tag name and a style should be set for it for all themes in themes/. That will signal that applications will need to add styling for it.

The following unchecked Scintillua lexers still need to be migrated:

• Actionscript
• Ada
• ANTLR
• APDL
• APL
• Applescript
• ASM (NASM)
• ASP
• AutoIt
• AWK
• Batch
• BibTeX
• Boo
• C
• C++
• C#
• ChucK
• Clojure
• CMake
• Coffeescript
• ConTeXt
• CSS
• CUDA
• D
• Dart
• Desktop Entry
• Diff
• Django
• Dockerfile
• Dot
• Eiffel
• Elixir
• Elm
• Erlang
• F#
• Fantom
• Faust
• Fennel
• Fish
• Forth
• Fortran
• fstab
• GAP
• Gemini
• gettext
• Gherkin
• git-rebase
• Gleam
• GLSL
• Gnuplot
• Go
• Groovy
• Gtkrc
• Hare
• Haskell
• HTML
• Icon
• IDL
• Inform
• ini
• Io
• Java
• Javascript
• jq
• JSON
• JSP
• Julia
• LaTeX
• Ledger
• LESS
• LilyPond
• Lisp
• Literate Coffeescript
• Logtalk
• Lua
• Makefile
• Man Page
• Markdown
• MATLAB
• MediaWiki
• Meson
• MoonScript
• Myrddin
• Nemerle
• Networkd
• Nim
• NSIS
• Objective-C
• OCaml
• Pascal
• Perl
• PHP
• PICO-8
• Pike
• PKGBUILD
• Pony
• Postscript
• PowerShell
• Prolog
• Properties
• Pure
• Python
• R
• rc
• Reason
• REBOL
• ReStructuredText
• Rexx
• RHTML
• RouterOS
• RPM Spec
• Ruby
• Ruby on Rails
• Rust
• Sass
• Scala
• Scheme
• Shell
• Smalltalk
• strace
• Standard ML
• SNOBOL4
• Spin
• SQL
• Systemd
• TaskPaper
• Tcl
• TeX
• Texinfo
• TOML
• txt2tags
• TypeScript
• Vala
• vCard
• Verilog
• VHDL
• Visual Basic
• Windows Script File
• XML
• Xs
• Xtend
• YAML
• Zig

[mcepl]

Is this check list kept up-to-date?

[orbitalquark]

Yes, I try to keep it up to date.

[samuelmarquis]

Hit the Haskell lexer in #123

[mcepl]

It seems to me that many of them have been modernized already:

• actionscript (1de5d33 and more modifications later)
• ada (309e377)
• antlr (1b658cf)
• apdl (b98dcfe)
• apl (38d8ac9)
• applescript (132b63d)
• batch (83d49dc)
• csharp (681004c)
• clojure (seems like it has been modern since the initial commit)
• coffeescript (b99fa3e)
• and many others, now just randomly
• dart (f66edfe)
• fennel (seems it was modern since the initial commit as well)
• fish (69701f3)
• ini (b5ee314)
• jq (5b90f44)
• lisp (7878b11)
• man (aka troff, seems like it was modern from the start as well, 369ee2b)

So, to be exact, when trying to find a lexer, where I could help with fixing this bug, I haven’t found a one, which wouldn’t be modern, and grep -l '\bM\.' lexers/*.lua also didn’t gave me anything else than lexers/lexer.lua.

[orbitalquark]

The lexers you link have not been migrated according to the migration guide in this issue's original post (https://orbitalquark.github.io/scintillua/api.html#migrating-legacy-lexers). For example, consider the actionscript.lua lexer you linked to.

It starts with

local lex = lexer.new('actionscript')

-- Whitespace.
lex:add_rule('whitespace', token(lexer.WHITESPACE, lexer.space^1))

but applying the migration steps would yield

local lex = lexer.new(...)

(note the lack of whitespace rule, which is now implicit).

There may be some confusion regarding object-oriented lexers vs. migrated lexers. For that I am sorry. I hope the migration guide I linked to makes it clear though.