Skip to content
View metaSATOKEN's full-sized avatar

Block or report metaSATOKEN

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
metaSATOKEN/README.md

Kentaro Sato | Independent Research

Independent researcher working across AI alignment, multi-agent systems, efficient model computation, and measurement theory.

My research focuses on a recurring question:

When information or system states are transformed, compressed, updated, or passed between components, what remains reliable, what can fail, and how can we verify the difference?

The projects below address this question in different technical domains. They are independent research efforts, not claims of a single unified theory.

Independent Research: Three Research Tracks

1. AI Systems & Alignment

How can long-horizon AI systems preserve information integrity, authority boundaries, and reliable coordination?

2. Efficient Model Computation

How can we reduce the computational cost of language models while understanding and controlling the resulting errors?

  • NSN: Norm-Separated KV Cache Quantization
    Training-free low-bit KV-cache compression, including evaluations across model architectures, packed 3-bit caches for looped Transformers, and fused Triton execution.

  • Norm-Separated Quantization
    Investigation of catastrophic INT4 quantization failures, separating magnitude and direction to identify and mitigate distinct failure mechanisms.

  • LAB: Lyapunov-Aware Bit Allocation
    State-space model quantization using error persistence, output sensitivity, and dynamic range to allocate precision across recurrent states.

3. Measurement & Auditable Decisions

When a measurement, calibration, or model-derived score changes, under what conditions can its conclusions still be trusted?

  • First-Order Probes
    Auditable sensor consistency checks and calibration updates under source shifts and contamination. Separates false-alarm evidence, fault-detection sensitivity, and decision coverage. Includes simulation code, Lean proofs, and original experimental data.

  • Transformer Representation Geometry
    Empirical analysis of hidden-state geometry, principal-component concentration, and transferable feature readouts, including controls that challenge misleading geometric interpretations.


Where to Start

Interested in… Recommended starting point
AI alignment and agent governance Boundary-Preserving Alignment
Multi-agent memory, provenance, and coordination MRSI
Efficient LLM inference and quantization NSN
Statistical auditing and calibration reliability First-Order Probes
Transformer internal representations Representation Geometry

Research Approach

My work combines theoretical analysis, controlled experiments, implementation, and reproducible evaluation.

I aim to distinguish:

  • Observed results from theoretical guarantees
  • Task success from system-level correctness
  • Model capability from operational authority
  • Detection performance from the reliability of the resulting decisions
  • Supported findings from unresolved or exploratory results

Where available, repositories include manuscripts, code, saved results, experimental protocols, and reproducibility instructions.

Negative results, limitations, and unresolved comparisons are part of the research record.


Independent Research | Japan · 2026

Pinned Loading

  1. Boundary-Preserving-Alignment Boundary-Preserving-Alignment Public

    A position paper on AI safety through bounded authority and governed artifact promotion. Includes English/Japanese manuscripts, LaTeX sources, and the published PDF.

    TeX

  2. First-Order-Probes First-Order-Probes Public

    Readout and calibration-update audits for paired first-order sensor probes under source shifts and contamination. Combines moment (M) and cross-relation (CR) checks with linear fusion, 50-replicate…

    Python

  3. lab-ssm lab-ssm Public

    Lyapunov-Aware Bit Allocation (LAB) for Mamba/SSM recurrent state quantisation. Allocates per-group bit widths from persistence, output coupling, and range calibrated on 1,024 tokens. Ranked 1st in…

    Python

  4. manifold_topology_experiment manifold_topology_experiment Public

    Principal component geometry and feature readout in Transformer hidden states (GPT-2, OPT, Qwen2.5). Shows 96–98% PC1 variance concentration is driven by the first token, while PC2–PC8 preserve tra…

    Python

  5. MRSI MRSI Public

    Memory, approval, and collaboration audits in two- and three-role LLM systems (4 papers + synthesis). Traces how correct answers can coexist with damaged provenance, masked local repairs, or poor s…

    Python

  6. nsn nsn Public

    Asymmetric NSN: training-free KV cache quantization by separating vector norm and direction. Covers 3-bit/5-bit evaluations across 8 models, bit-packed 3-bit caches for looped Transformers (Ouro, N…

    Python