Implement the next tracker tranche around a recursive articulated state rather than per-frame ad hoc updates.
Track state now propagates full pose/velocity/shape covariance, uses process noise during prediction, and drives active-to-lost transitions from both miss counts and recursive score thresholds. The multiview update path replaces the generic SciPy least_squares call with a bounded LM/GN loop that returns parameter and beta covariance blocks, accepted-joint counts, mean reprojection error, and iteration diagnostics.
Lost-track handling is stricter and safer: proposal-based reacquisition now requires same-frame 2D support and articulated refinement before a track can return to active. Proposal clusters retain contributing detection indices, the tracker searches broadly within contributing views, and proposal-compatible lost frames are surfaced explicitly instead of silently reviving a track. Old scene JSONs with imgpaths now default to the RPT camera-pose convention so proposal reprojection gating works on the sample scenes.
Add ActualTest support diagnostics that summarize event counts, accepted support, reprojection quality, and tracker diagnostics, plus focused regressions for camera conventions, score-driven demotion, covariance behavior, proposal-compatible lost handling, and broader proposal-backed matching.
Regenerate uv.lock after the recent environment sync so the lockfile matches the current Linux-only CUDA markers and the editable RapidPoseTriangulation dependency metadata.
The refreshed lock captures the upstream RPT extras now exposed to this repo and removes stale win32 marker branches from CUDA optional dependencies for this environment.
Switch the triangulation adapter from ad hoc Python dictionaries to rpt.make_camera so the tracker passes the exact typed camera objects expected by the current RPT bindings.
The camera convention test now asserts against the bound camera object's numeric fields instead of raw dict payloads, which keeps the test aligned with the compiled interface.
Add a reusable video alignment module for offline multiview workflows. The helper scans per-frame timestamps, builds nearest-timestamp bundle matches under a configurable skew threshold, and rewrites synchronized per-camera videos for downstream detection and tracking runs.
The detection package now exports the alignment primitives, and a test-support CLI is included so dataset-specific experiments can generate aligned clips without expanding the public application surface.
Regression tests cover both bundle matching and frame selection during rewritten video generation.
Add an explicit source delivery policy to the detection pipeline so offline and realtime sources can be handled differently without splitting the runner.
Blocking sources now backpressure ingestion until their pending frame is drained, which preserves every offline video frame even when inference is slower than decode. Latest-only sources keep the previous overwrite behavior for realtime feeds such as cvmmap.
The tests now cover both policies: offline sources retain ordered frame delivery under slow inference, while latest-only sources still drop intermediate frames as intended.
Add an idempotent patch-mmdet-version-gate entrypoint that rewrites the installed mmdet mmcv compatibility assert into a warning so the local rebuilt mmcv wheel can be reused after uv sync.
Cover the source rewrite with focused tests and document the post-sync command in the README so the local environment patch is reproducible instead of being a one-off manual edit inside .venv.
Pin the detection stack to torch 2.11.0 and torchvision 0.26.0 and route both packages through the explicit PyTorch cu130 index for Linux and Windows installs.
Move the remaining uv project configuration into pyproject.toml, set PyPI as the default index, and remove the redundant repo-local uv.toml so uv no longer emits split-configuration warnings.
Refresh the lockfile against the new index configuration so the project resolves from pypi.org for general packages and download.pytorch.org/cu130 for the CUDA-specific torch artifacts.
Refactor the package into common, schema, detection, and tracking namespaces and move dataset-specific ActualTest utilities into tests/support.
Add a pluggable detection stack with typed protocols, pydantic-settings config, loguru-based runner logging, cvmmap and headless video sources, NATS and parquet sinks, and a structured coco-wholebody133 payload path.
Teach tracking replay loading to consume parquet detection directories directly, preserve empty frames, and keep the video-to-parquet-to-tracking workflow usable for offline E2E runs.
Vendor the local mmcv and xtcocotools wheels under Git LFS, update uv sources/lock state, and refresh the mmcv build so mmcv.ops loads successfully with the current torch+cu130 environment.
Set up pose_tracking_exp as a uv-managed Python package for offline multiview body tracking experiments.
This initial commit includes:
- the typed package scaffold, CLI entrypoints, and repo-local uv configuration
- scene and replay loaders for generic JSON replays and ActualTest parquet inputs
- ParaJumping payload conversion and RTMPose-to-body20 normalization
- a custom articulated tracker with tentative, active, and lost lifecycle handling
- RPT-backed proposal generation, camera convention handling, and multiview reprojection updates
- regression tests for normalization, camera conventions, ActualTest ingestion, seeding, and tracker smoke flows
- project documentation covering extrinsic formats and the ActualTest calibration caveat
crosstyan