LIFEHUBBER
Choose theme

AI Resources

Project Maya

GitHub stars: 920 GitHub forks: 113 Declared license: MIT: MIT Last pushed October 16, 2026: Pushed today
Stats from GitHub

Project Maya is a local inference engine, server, and browser interface built around GLM-5.3-Flash.

It distributes the model's expert weights across GPU memory, system RAM, and storage, with OpenAI- and Anthropic-compatible APIs for connected applications. Running it still calls for a capable machine and a large model download. Use this as a first read, not a recommendation. Open the original project before trusting details like terms, limits, privacy, cost, setup, or safety.

What it is

A runtime for one model family

Maya supplies the engine and serving interface for GLM-5.3-Flash, with project-provided quantized weights. The repository includes setup tools, browser chat, and a hardware monitor.

Why it stands out

Expert weights move between memory tiers

The engine keeps frequently used experts in GPU memory, another tier in RAM, and the remaining weights on disk. This makes the balance of GPU memory, RAM, and storage part of the serving setup.

Availability

Public code and substantial local setup

The repository declares MIT and documents Linux with NVIDIA GPUs as its main path. Windows and AMD support are experimental. Model files and optional components have their own source pages and declared terms.

Why it matters

What makes it useful

A developer exploring local coding assistance can use Maya's browser chat to try the model, then connect a compatible coding client to the local server. The documented endpoints accept chat and tool-call requests, so the same serving setup can sit behind an application that already knows how to work with those interfaces.

Notable points

What stands out

A mixture-of-experts model uses only some experts for each token, but its other expert weights still need somewhere to live. Maya follows which experts a conversation uses and changes which ones occupy the GPU tier. This explains why a model download can be much larger than the graphics card's memory, and why available RAM and transfers from storage still affect the experience.

Before using

What to review

The README lists 32 GB of RAM as a starting requirement and roughly 100 GB of model space for Maya-S, rising to around 160 GB for Maya-L. It calls for a fast NVMe SSD and a supported GPU. More room is needed for other components and working files; a GPU alone does not establish that a machine is ready.

The project says its RAM tier pins most free memory, leaving about 6 GB for other programs. Its Windows guide also flags page-file capacity and GPU-memory oversubscription as practical setup concerns.

Check the current platform guide for the exact GPU and toolkit combination. AMD support is experimental and defaults to text-only; its Linux guide also documents a manual CPU image-encoder option. The native Windows route is experimental, and the project directs Windows users away from WSL2.

The setup guide documents --check for inspecting prerequisites before downloading weights or building the engine. The README's speed and quantization-quality tables are project and contributor reports, rather than results from LifeHubber testing.

Local inference does not describe every network connection: setup downloads files, and the dashboard checks GitHub for releases unless that check is disabled. For access from another device, the project pairs its network-listening option with an API key; review those instructions before changing the default local address.

The optional DFlash2 drafter declares CC BY-NC-ND 4.0. Review its source page and the selected model's current terms separately from the engine repository.

Reader fit

Who may find it relevant

Relevant to technical readers who want to run GLM-5.3-Flash on their own supported hardware and can manage compilers, drivers, model storage, and a server. Readers can inspect the setup and platform guides before considering a download. Someone seeking a small desktop installation or a hosted chat service will need a different starting point.

Editorial note

Why LifeHubber lists it

We list Maya because it brings the serving engine, chat interface, and hardware monitor into one model-specific project. For someone investigating whether a large model belongs in their local coding setup, that combination connects the model's answers with the machine doing the work. The monitor shows how GPU memory is divided among weights, context, and other uses, giving the reader something concrete to examine alongside a trial conversation. That is a useful way to understand the setup burden before treating local serving as an everyday workflow.

Source links

Source materials

Reader note

Before relying on this entry

LifeHubber lists entries to help readers inspect AI projects, not to endorse them or prove they are safe, suitable, accurate, maintained, or right for a specific use. We do not verify every entry in depth. Before relying on anything listed, review the original materials, terms, privacy practices, limits, and risks that matter for your situation.

What to explore next

Understand the model behind the runtime.

Maya supplies the serving setup. The model overview explains the GLM-5.3-Flash capabilities that a connected application can draw on.

Advertisements

Advertisements

For project maintainers

Listed here? You can use the badge.

If you maintain a project with a current LifeHubber listing, you may add the optional “Listed on LifeHubber AI Resources” badge to its README, docs, or website. No introduction or permission request is needed.

See what’s moving