Compact Weight storage To be improved to SAIA needs and RTEiS both are separate projects
Technically you could store a 1M parameter model with this system. But who would want that? Basically how this works is that: Each weight is routed to a character in the codebook. This saves space for double digits, as JSON internally stores data as strings, instead of integers or floats. JSON also increases the amount of bits for special characters like: ⱡ, stuff that's only in Unicode. So no Unicode only characters are used here to save even more space.