Measuring Performance Loss

[TomLucidor]

Found this graph recently saying quants > REAP > REAM and it is sad to see the first iteration of REAM to be this bad for agentic work. If Hestia or ByteShape can also be tested along those lines, it would be sweet https://www.reddit.com/r/LocalLLaMA/comments/1rabg6o/comment/o6j03a5/

[magiccodingman]

Thanks for introducing me to this! I looiked into it and it's very cool, but it seems MagicQuant is attacking this topic from a different angle. Version 2 will be released very soon and the performance loss and speed increase is dramatic compared to V1.

[TomLucidor]

Please compare more deeply later on https://github.com/SamsungSAILMontreal/ream