On-Device Zeta

[chrisvander]

Putting Zeta on servers and relying on data center compute, plus network transfer speed, is expensive in both latency and literal server cost. Why not, for the hardware that can reasonably support it, put Zeta on-device? This would potentially allow for more reliable latency and offline use, in addition to being better for privacy.

Either that, or an option to do completions on-device through Ollama.

It's baffling to me that companies continue to not utilize local compute. I don't want to pay yet another subscription to access tools like this. I paid for a powerful local system - use it!

[baldwindavid]

I don't really disagree though this is an OS model (as is Zed itself) and Zed does interface with Ollama and LM Studio so maybe that's coming. Other than that, I would very much like to see Zed continue on its own. Presumably at a certain point they'll need to monetize somehow or the logical conclusion is getting acquired by a large company with varied motivations and priorities.

[chrisvander]

Monetization via charging for collaboration features makes the most sense to me. On device completion as part of the open source solution just improves the product experience for a individual developers, who in turn will bring Zed to their teams. Maybe remote completion models are more powerful - that makes sense to charge for.

[baldwindavid]

Yep, I believe they've publicly stated collaboration and AI being the focus in terms of profitability. I think they've done a good job with transparency and interoperability thus far and have no reason to think that won't continue within the constraints of, uh, survivability.