Skip to content
View NidAll's full-sized avatar
💭
Shipping…
💭
Shipping…

Highlights

  • Pro

Block or report NidAll

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
NidAll/README.md
NidAll. Big models. Finite memory. Local AI and systems engineering.

Computer engineer building local AI tools, native model runtimes, and Linux software.
I work where model architecture meets quantization, kernels, and memory limits.

Selected projects  ·  More to explore  ·  All repositories

Selected projects

01 / MODEL COMPRESSION

Convert diffusion checkpoints and text encoders into native ComfyUI formats. Architecture-aware tensor selection, bounded conversion memory, optional MSE optimization, and output validation.

Python INT8 / INT4 / FP8

Quick start · Releases

02 / LINUX SYSTEMS

A native Linux boot-media writer with a desktop app and CLI. Reviewed write plans, explicit device confirmation, a separate privilege helper, and full source-byte read-back.

Rust Iced Polkit

Screenshots · Compatibility & release limits

03 / IMAGE UNDERSTANDING

Turn a reference image into Anima prompts locally. PixAI tagging and native MiniCPM INT8 inference produce positive and negative prompts, structured analysis, and tag probabilities.

ComfyUI Vision + language

Setup & example workflow · Releases

04 / SPEECH INFERENCE

Voice design, voice cloning, and named-speaker generation for the Qwen3-TTS 1.7B family. Packed W8A8 ConvRot inference, static KV caches, and CUDA graph support with runtime diagnostics.

Python Comfy Kitchen CUDA

Example workflows · Runtime details

More to explore

Earlier quantization work & an upstream contribution

How I work

I like following an inference problem through the whole stack: tensor layout, kernel dispatch, attention, memory residency, and the runtime that ties them together. I care about reproducible conversions, useful diagnostics, and benchmarks that explain their limits.

Tools I work with: Python, Rust, C/C++, PyTorch, CUDA, ComfyUI, llama.cpp, and Linux.

Away from code: philosophy, mathematics, anime and manga, storytelling, penguins, and cats.

If a model technically shouldn't fit, that usually makes it more interesting.

Pinned Loading

  1. ComfyUI-Qwen3-TTS-Quant ComfyUI-Qwen3-TTS-Quant Public

    Production-focused ComfyUI nodes and a streaming quantization toolkit for fast, memory-efficient Qwen3-TTS VoiceDesign inference with W8A8 ConvRot, CUDA kernels, static KV caching, and runtime diag…

    Python 1

  2. ComfyUI_PromptStyler ComfyUI_PromptStyler Public

    Custom ComfyUI node that applies curated style prefix/suffix templates to your positive prompt and outputs CONDITIONING for KSampler.

    Python 18 2

  3. TranslateGemma-Studio TranslateGemma-Studio Public

    Local TranslateGemma UI with a thin llama.cpp adapter, streaming translations, long-text chunking, and a clean light/dark interface all running offline on your PC.

    JavaScript 17 1

  4. LLaDa-Image_ComfyUI LLaDa-Image_ComfyUI Public

    Forked from RealRebelAI/LLaDa-Image_ComfyUI

    a custom node set to run LLaDa-Image in ComfyUI

    Python

  5. comfyui-native-quantizer comfyui-native-quantizer Public

    Native mixed-precision quantization for ComfyUI models and text encoders W4A8, W4A4, INT8, FP8, streaming conversion, architecture-aware policies, and validation.

    Python 2

  6. ComfyUI-PromptStyler-Next ComfyUI-PromptStyler-Next Public

    Model-aware prompt styling engine for ComfyUI and HEISS Studio

    Python 1