Skip to content

Research

Research records bind a claim to an exact revision, protocol, and measurement. They are evidence, not API promises. This page is the current decision ledger; experiments.CATALOG owns the runnable inventory.

Current decisions

Question Current evidence Decision
Can sparse graph learning stay native to tinygrad? Unit, scalar-weighted, and edge-vector aggregation, endpoint projection, target softmax, and first-order gradients remain sparse on CPU and Metal. Yes, for fixed topology. Keep the CSR backend private while Tensor.custom_kernel remains alpha.
How does the current runtime compare with PyG on this Mac? Exact mappings agree within 4.8e-7. Tinymesh TGCN JIT is about 2.4x faster than eager PyG Temporal on Metal, but compiled PyG Temporal and a compiled one-propagation PyTorch control both beat it in two repetitions; the factored control also wins clearly on CPU. Require JIT for repeated Tinymesh execution. Keep the one-propagation algebra; reject a framework speed claim and expand shapes, skew, backward, and memory before optimizing the private CSR backend.
Does metric geometry require a geo dependency? Position tensors compose into displacement, distance, radial weights, and sparse messages. No. Data adapters own coordinate frames and units; add a type only when it must own a new invariant.
Can the models use spatial structure? True-topology diffusion wins controlled transport and transfers to unseen graph sizes. Yes under an identifiable local law. Preserve false-topology and node-local controls.
Does graph structure improve the real forecasts tested so far? Chickenpox is tied with a node-local model and Montevideo geometry loses to persistence. On METR-LA, factorized true transport beats both topology controls on MAE and RMSE in two seeds, but the earlier self-only model still dominates it. Graph structure measurably affects METR-LA forecasts; it has not improved the best model. Compare bounded convergence before changing architecture or API.
Can tinygrad express JEPA learning over graph patches? Aligned latent loss falls 90.9%; reversed and positionless controls lose on CPU and Metal while the EMA target receives zero gradient. Yes. Keep the mechanism research-only until a real representation task justifies a reusable owner.
Can variable-size graph collections stay dependency-free and sparse? MUTAG lowers 188 graphs and 7,442 labeled directed edges identically on CPU and Metal from one bounded, pinned archive. Yes. Keep source labels canonical and derive model features with tinygrad operations.
Are the dataset topologies connected and locally shallow? Exact sparse measurement finds Chickenpox fully reachable, Montevideo weakly connected but only 17.0% directionally reachable, METR-LA split into two weak components with one non-self isolate, and every MUTAG graph connected. Record topology assumptions with the data evidence. Add no graph-analytics API without a learning caller.
Does temporal messaging exhibit triadic closure? In CollegeMsg, 5,609 prior-wedge contacts form at 107.655 per million pair-days versus 6,403 non-wedge contacts at 31.635, a 3.403x descriptive rate ratio. The public carrier reproduces every count. Promote ordered temporal edges and checksum-pinned source lowering; retain closure, tie semantics, and prediction policy as research. Call messages communication, not friendship or causality.
Do stronger observed CollegeMsg contacts occupy more embedded positions? Mean overlap rises monotonically from 0.023454 for one-message contacts to 0.043325 for 128-255 messages; reciprocal contacts overlap more than one-way contacts. Removing the weakest 50% by message count leaves 1,292 nodes in the giant component versus 1,785 strong-first and 1,611 for the seeded random baseline. Retain the descriptive weak-tie result and all projection policies as research. Add no graph-analytics API or friendship claim.
Does Graph-JEPA improve MUTAG representations? Positionless patch prediction gains 2.48 probe points over its paired random encoder in all three seeds, but exact cosine search regresses every trained arm and every learned arm trails the fixed graph summary. Continue the minimal positionless mechanism only as representation research. Claim no searchable geometry; keep JEPA, retrieval, and indexing research-only.
Can one sparse graph represent a bounded node-time mesh? Cartesian products, batched endpoint gathers, and batched GINE pass 30 focused tests on CPU and Metal without dense adjacency. Yes when joint message passing needs explicit node-time vertices. Keep long fixed-topology sequences factorized.
Does causal JEPA learn a useful node-time representation? The true-mesh encoder improves over its paired random initialization in all three seeds and test agrees, but spatial-only features beat the joint product in two of three. Continue the objective as research; reject explicit temporal edges as the incumbent on this task. Promote no JEPA API.
Does real traffic support factorized causal JEPA? Latent loss falls 75.6%, but the trained factorized encoder regresses its paired random encoder in all three seeds and loses every simpler control on mean validation RMSE. Reject this encoder, mask, objective, and budget. Keep test closed and promote no JEPA API.
Which LAMP field can support an operational forecast? Arrival, travel time, and dwell inherit mixed stop provenance. Movement-derived trunk headway reproduces exactly for all 4,274 full-day Blue Line labels and 26,558 physical departures across a seven-day audit. Retain MBTA and extend the headway replay before specifying a task. Add no public adapter or model yet.
Can a regular clock provide a matched carrier for frozen MBTA headway targets? Across 947,489 departures and 940,551 targets, 30/60/300-second clocks merge 1,459/3,823/120,752 predecessor-target pairs. Even 30 seconds is 93.4% empty within active lane-day spans. No. Close the snapshot branch and retain reversible departure events as source truth.
Does the public LAMP export support a forecast-sufficient population? A capped 28-day acquisition lowers 947,489 physical departures and reproduces 940,776 movement-headway labels. It measures 201 mismatches, 1,007 boundary labels, 384 ambiguous-order rows, and 78.2% exact Schedule identity. Advance to a retrospective event-time task. Keep the full source population, make carrier and Schedule masks explicit, and make no online claim.
What is the retrospective MBTA next-headway floor? The frozen task retains 940,551 physical targets. Public plan leads validation at 152.648 s MAE, but the train-only temporal median leads the single test open at 159.788 s versus plan at 166.062 s and persistence at 229.802 s. Carry both strong controls into Stage 4 and require improvement over each. Keep the claim retrospective.
Does directed MBTA topology add next-headway signal? On the single test opening, the true upstream arm reaches 149.398 s mean MAE versus 155.042 self-only, 155.241 reversed, and 154.771 degree-preserving permuted controls. It wins every seed, route-macro MAE, p90 error, and both Schedule-provenance slices. Yes, within the frozen retrospective MBTA task. Retain the bounded directional signal; make no universal, online, or every-route claim.
Does event-native memory improve the MBTA topology model? True-topology memory beats every matched memory control in every validation seed, but its 147.726 s mean MAE loses to the frozen 145.793 s topology MLP in every seed. No for this bounded design and budget. Stop at validation, keep test closed, and add no runtime memory abstraction.

Sparse core

  • Mac framework benchmark — exact component mappings against PyG and pinned PyG Temporal source, with synchronized CPU and Metal wall time.
  • Sparse aggregation — destination CSR, transpose backward, scaling evidence, and the alpha-kernel boundary.
  • Mean GraphSAGE — the first trainable caller of sparse mean.
  • GCN — degree normalization composed around the same sum.
  • GINE — learned edge-vector messages over sparse COO-to-CSR reduction.
  • Weighted aggregation — COO edge identity through forward, node gradients, and scalar edge gradients.
  • Sparse attention — endpoint projection, target softmax, and independently trainable heads.

Space and direction

Time and recurrence

  • Sparse Cartesian products — explicit product lowering, edge order, batched edge messages, and the factorized alternative.
  • T-GCN — fixed-graph recurrence through one spatial and temporal transition.
  • GConvGRU — Chebyshev graph mixing inside recurrent gates.

Representation

  • JEPA mechanics — asymmetric latent prediction over graph patches with an EMA target and shortcut controls.
  • MUTAG masked JEPA — frozen graph representations against random-encoder and non-neural controls.
  • MUTAG Graph-JEPA ablation — graph patches, structural position, and latent objective under one frozen probe protocol.
  • Controlled node-time JEPA — causal latent prediction over sparse product meshes with matched space and time controls.
  • METR-LA factorized JEPA — real causal traffic blocks with sparse space, bounded time, and paired representation controls.

Data boundaries

  • Network measurement — components, direction, degree, reachability, and exact hop distance across the public datasets.
  • CollegeMsg temporal closure — first contacts, prior wedges, exact pair-time exposure, and the communication boundary.
  • CollegeMsg tie structure — separate communication strength views, neighborhood overlap, local bridges, and edge-removal curves.
  • Chickenpox — weekly node fields over one pinned graph.
  • Montevideo bus — hourly fields, projected positions, and road distance.
  • METR-LA — five-minute speed, timestamps, missingness, and directed affinity.
  • MUTAG — variable-size molecular graphs with aligned atom, bond, and graph labels.
  • GTFS semantic boundary — Schedule and Realtime facts lowered into deterministic sparse views without a public transport API.
  • MBTA Blue Line replay — version-aligned operations, rejected mixed-stop targets, and validated movement-derived headway.
  • MBTA departure-event mesh — reversible physical departures, typed causal relations, strict prefixes, and measured clock alternatives.
  • MBTA event population — bounded 28-day acquisition, event lowering, and explicit Schedule-identity limits.
  • MBTA clock boundary — full-population identity, causal collision, and empty-work audit for 30/60/300-second projections.

Forecast evidence