Does not work on very large projects

[WanderFrank]

Errors in log like this:

2024-12-04T11:40:40.451 helix_lsp::client [WARN] language server failed to terminate gracefully - server closed the stream
2024-12-04T11:40:40.451 helix_lsp::transport [ERROR] ctags-lsp err <- "2024/12/04 11:40:40 Error reading message: error reading header: EOF\n"
2024-12-04T11:40:40.452 helix_lsp::transport [ERROR] ctags-lsp err: <- StreamClosed

2024-12-04T11:40:48.696 helix_lsp::transport [ERROR] ctags-lsp <- InternalError: Internal error
2024-12-04T11:40:48.696 helix_lsp [ERROR] failed to initialize language server: protocol error: InternalError: Internal error

[netmute]

Can show me your ~/.config/helix/languages.toml?

[WanderFrank]

[language-server.ctags-lsp]
timeout = 1000
command = "ctags-lsp"

[[language]]
name = "make"
language-servers = ["ctags-lsp"]

[netmute]

Can you try if this build works for you?
ctags-lsp.tar.gz

[WanderFrank]

2024-12-06T13:32:31.768 helix_lsp::transport [ERROR] ctags-lsp <- InternalError: Internal error
2024-12-06T13:32:31.769 helix_lsp [ERROR] failed to initialize language server: protocol error: InternalError: Internal error
2024-12-06T13:32:40.867 helix_lsp::client [WARN] language server failed to terminate gracefully - server closed the stream
2024-12-06T13:32:40.868 helix_lsp::transport [ERROR] ctags-lsp <- InvalidRequest: Malformed request
2024-12-06T13:32:40.868 helix_lsp::transport [ERROR] Discarding Language Server response without a request (id=Null) Err(Rpc(Error { code: InvalidRequest, message: "Malformed request", data: Some(String("error reading header: EOF")) }))
2024-12-06T13:32:40.868 helix_lsp::transport [ERROR] ctags-lsp <- InvalidRequest: Malformed request
2024-12-06T13:32:40.868 helix_lsp::transport [ERROR] Discarding Language Server response without a request (id=Null) Err(Rpc(Error { code: InvalidRequest, message: "Malformed request", data: Some(String("error reading header: EOF")) }))

[WanderFrank]

I was running it on too big a project.
lsp create /tmp/tags.fbNo2K file 2,2Gb
It works on a smaller project.

[netmute]

Can you run this command in your project directory and see if it works and how long it takes?

ctags --output-format=json --fields=+n -R

[WanderFrank]

It works and execute 3m59,455s. Maybe you need to consider .gitignore file for best perfomansce.

[netmute]

Supporting .gitignore is a good idea.
Can I ask you to try how much that will improve performance in your project?

git ls-files | ctags --output-format=json --fields=+n -L -

[WanderFrank]

0m30,009s

[netmute]

Better, but still way slower than I'd like it to be. Let me try and think of something to speed this up.
Thank you for your input so far!

[tbehner]

I have a project where git ls-files | ctags --output-format=json --fields=+n -L - takes about 1min. Do you have any updates on this?
Maybe store the previous results (or even make it pre-computable) and update the cache from results from loaded buffers.
I would be open to help.

[netmute]

I have started working on parallel calls to ctags, which should speed this up a lot.

[netmute]

I just released v0.7.0 with parallel ctags processing.
I benchmarked it, and startup time in my test project went from 1.42s to 389ms.

Curious to see the effects in your projects.