add new metric results for various methods

This commit is contained in:
darkliang
2022-11-30 13:08:30 +08:00
parent 59c8a8505c
commit f79997bf8d
+41 -39
View File
@@ -1,52 +1,54 @@
# Model Zoo # Model Zoo
## [CASIA-B](http://www.cbsr.ia.ac.cn/english/Gait%20Databases.asp) ## [CASIA-B](http://www.cbsr.ia.ac.cn/english/Gait%20Databases.asp)
| Model | NM | BG | CL | Configuration | Input Size | Inference Time | Model Size |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :--------: | :--------: | :--------: | :-------------------------------------------------------------------------------------------: | :--------: | :------------: | :------------: | | Model | `Rank@1.NM` | `Rank@1.BG` | `Rank@1.CL` | `mAP.NM` | `mAP.BG` | `mAP.CL` | Configuration | Input Size |
| Baseline | 96.3 | 92.2 | 77.6 | [baseline.yaml](../configs/baseline/baseline.yaml) | 64x44 | 12s | 3.78M | | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :---------: | :---------: | :---------: | :------: | :------: | :------: | :--------------------------------------------------------------------------------------------------: | :--------: |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 95.8(95.0) | 90.0(87.2) | 75.4(70.4) | [gaitset.yaml](../configs/gaitset/gaitset.yaml) | 64x44 | 13s | 2.59M | | Baseline | 96.3 | 92.2 | 77.6 | 87.3 | 83.4 | 78.5 | baseline.yaml | 64x44 |
| [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 96.1(96.2) | 90.7(91.5) | 78.7(78.7) | [gaitpart.yaml](../configs/gaitpart/gaitpart.yaml) | 64x44 | 56s | 1.20M | | [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 95.8(95.0) | 90.0(87.2) | 75.4(70.4) | 85.9 | 81.4 | 77.0 | [gaitset.yaml](../configs/gaitset/gaitset.yaml) | 64x44 |
| [GLN*(ECCV2020)](http://home.ustc.edu.cn/~saihui/papers/eccv2020_gln.pdf) | 96.4(95.6) | 93.1(92.0) | 81.0(77.2) | [gln_phase1.yaml](../configs/gln/gln_phase1.yaml), [gln_phase2.yaml](../configs/gln/gln_phase2.yaml) | 128x88 | 47s/46s | 8.54M / 14.70M | | [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 96.1(96.2) | 90.7(91.5) | 78.7(78.7) | 84.8 | 81.1 | 75.5 | [gaitpart.yaml](../configs/gaitpart/gaitpart.yaml) | 64x44 |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 97.4(97.4) | 94.5(94.5) | 83.8(83.6) | [gaitgl.yaml](../configs/gaitgl/gaitgl.yaml) | 64x44 | 38s | 3.10M | | [GLN*(ECCV2020)](http://home.ustc.edu.cn/~saihui/papers/eccv2020_gln.pdf) | 96.4(95.6) | 93.1(92.0) | 81.0(77.2) | 89.3 | 87.0 | 82.6 | [gln_phase1.yaml](../configs/gln/gln_phase1.yaml), [gln_phase2.yaml](../configs/gln/gln_phase2.yaml) | 128x88 |
| [GaitBase](https://arxiv.org/abs/2211.06597) | 97.6 | 94.0 | 77.4 | - | 64x44 | - | - | | [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 97.4(97.4) | 94.5(94.5) | 83.8(83.6) | 86.2 | 84.4 | 79.8 | [gaitgl.yaml](../configs/gaitgl/gaitgl.yaml) | 64x44 |
| [GaitBase](https://arxiv.org/abs/2211.06597) | 97.6 | 94.0 | 77.4 | - | - | - | - | 64x44 |
## [CASIA-B*](http://www.cbsr.ia.ac.cn/english/Gait%20Databases.asp) ## [CASIA-B*](http://www.cbsr.ia.ac.cn/english/Gait%20Databases.asp)
| Model | NM | BG | CL | Input modality | Configuration | | Model | `Rank@1.NM` | `Rank@1.BG` | `Rank@1.CL` | Input modality | Configuration |
|:----------:|:----:|:----:|:-----:|:--------------:|:----------------------------------------------------------------:| | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :---------: | :---------: | :---------: | :-------------: | :--------------------------------------------------------------: |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 92.3 | 86.1 | 73.36 | Silhouette | [gaitset.yaml](../configs/gaitset/gaitset.yaml) | | [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 92.3 | 86.1 | 73.36 | Silhouette | [gaitset.yaml](../configs/gaitset/gaitset.yaml) |
| [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 93.1 | 86.0 | 75.1 | Silhouette | [gaitpart.yaml](../configs/gaitpart/gaitpart.yaml) | | [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 93.1 | 86.0 | 75.1 | Silhouette | [gaitpart.yaml](../configs/gaitpart/gaitpart.yaml) |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 94.2 | 90.0 | 81.4 | Silhouette | [gaitgl.yaml](../configs/gaitgl/gaitgl.yaml) | | [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 94.2 | 90.0 | 81.4 | Silhouette | [gaitgl.yaml](../configs/gaitgl/gaitgl.yaml) |
| [GaitEdge(ECCV2022)](https://arxiv.org/abs/2203.03972) | 97.9 | 96.1 | 86.4 | RGB | [phase2_gaitedge.yaml](../configs/gaitedge/phase2_gaitedge.yaml) | | [GaitEdge(ECCV2022)](https://arxiv.org/abs/2203.03972) | 97.9 | 96.1 | 86.4 | RGB, Silhouette | [phase2_gaitedge.yaml](../configs/gaitedge/phase2_gaitedge.yaml) |
| [GaitBase](https://arxiv.org/abs/2211.06597) | 96.5 | 91.5 | 78.0 | Silhouette | - | | [GaitBase](https://arxiv.org/abs/2211.06597) | 96.5 | 91.5 | 78.0 | Silhouette | - |
## [OUMVLP](http://www.am.sanken.osaka-u.ac.jp/BiometricDB/GaitMVLP.html) ## [OUMVLP](http://www.am.sanken.osaka-u.ac.jp/BiometricDB/GaitMVLP.html)
| Model | Rank@1 | Configuration | Input Size | Inference Time | Model Size | | Model | `Rank@1` | `mAP` | Configuration | Input Size | Inference Time | Model Size |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :--------: | :------------------------------------------: | :--------: | :-------------: | :--------: | | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :--------: | :---: | :-------------------------------------------------------: | :--------: | :------------: | :--------: |
| Baseline | 86.7 | [baseline.yaml](../configs/baseline/baseline_OUMVLP.yaml) | 64x44 | 1m13s | 44.11M | | Baseline | 86.7 | 91.8 | [baseline.yaml](../configs/baseline/baseline_OUMVLP.yaml) | 64x44 | 1m13s | 44.11M |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 87.2(87.1) | [gaitset.yaml](../configs/gaitset/gaitset_OUMVLP.yaml) | 64x44 | 1m26s | 6.31M | | [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 87.2(87.1) | 92.2 | [gaitset.yaml](../configs/gaitset/gaitset_OUMVLP.yaml) | 64x44 | 1m26s | 6.31M |
| [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 88.6(88.7) | [gaitpart.yaml](../configs/gaitpart/gaitpart_OUMVLP.yaml) | 64x44 | 8m04s | 3.78M | | [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 88.6(88.7) | 93.3 | [gaitpart.yaml](../configs/gaitpart/gaitpart_OUMVLP.yaml) | 64x44 | 8m04s | 3.78M |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 89.9(89.7) | [gaitgl.yaml](../configs/gaitgl/gaitgl_OUMVLP.yaml) | 64x44 | 5m23s | 95.62M | | [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 89.9(89.7) | 93.3 | [gaitgl.yaml](../configs/gaitgl/gaitgl_OUMVLP.yaml) | 64x44 | 5m23s | 95.62M |
| [GaitBase](https://arxiv.org/abs/2211.06597) | 90.8 | - | 64x44 | - | - | | [GaitBase](https://arxiv.org/abs/2211.06597) | 90.8 | - | - | 64x44 | - | - |
## [GREW](https://www.grew-benchmark.org) ## [GREW](https://www.grew-benchmark.org)
| Model | Rank@1 | Configuration | Input Size | Inference Time | Model Size | | Model | `Rank@1` | Configuration | Input Size | Inference Time | Model Size |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :--------: | :------------------------------------------: | :--------: | :-------------: | :--------: | | :---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :------: | :------------------------------------------------------: | :--------: | :------------: | :--------: |
| Baseline | 48.5 | [baseline.yaml](../configs/baseline/baseline_GREW.yaml) | 64x44 | 2m23s | 84.12M | | Baseline | 48.5 | [baseline.yaml](../configs/baseFline/baseline_GREW.yaml) | 64x44 | 2m23s | 84.12M |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 48.4 | [gaitset.yaml](../configs/gaitset/gaitset_GREW.yaml) | 64x44 | - | - | | [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 48.4 | [gaitset.yaml](../configs/gaitset/gaitset_GREW.yaml) | 64x44 | - | - |
| [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 47.6 | [gaitpart.yaml](../configs/gaitpart/gaitpart_GREW.yaml) | 64x44 | - | - | | [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 47.6 | [gaitpart.yaml](../configs/gaitpart/gaitpart_GREW.yaml) | 64x44 | - | - |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 41.5 | [gaitgl.yaml](../configs/gaitgl/gaitgl_GREW.yaml) | 64x44 | - | - | | [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 41.5 | [gaitgl.yaml](../configs/gaitgl/gaitgl_GREW.yaml) | 64x44 | - | - |
| [GaitGL(BNNeck)(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 51.7 | [gaitgl.yaml](../configs/gaitgl/gaitgl_GREW_BNNeck.yaml) | 64x44 | - | - | | [GaitGL(BNNeck)(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 51.7 | [gaitgl.yaml](../configs/gaitgl/gaitgl_GREW_BNNeck.yaml) | 64x44 | - | - |
| [GaitBase](https://arxiv.org/abs/2211.06597)| 60.1 | 64x44 | - | - | - | | [GaitBase](https://arxiv.org/abs/2211.06597) | 60.1 | -| 64x44 | - | - |
## [Gait3D](https://github.com/Gait3D/Gait3D-Benchmark) ## [Gait3D](https://github.com/Gait3D/Gait3D-Benchmark)
| Model | Rank@1 | Configuration | Input Size | Inference Time | Model Size | | Model | `Rank@1` | Configuration | Input Size | Inference Time | Model Size |
| :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :--------: | :------------------------------------------: | :--------: | :-------------: | :--------: | | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :------: | :-----------: | :--------: | :------------: | :--------: |
| [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 36.7 | - | 64x44 | - | - | | [GaitSet(AAAI2019)](https://arxiv.org/pdf/1811.06186.pdf) | 36.7 | - | 64x44 | - | - |
| [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 28.2 | - | 64x44 | - | - | | [GaitPart(CVPR2020)](http://home.ustc.edu.cn/~saihui/papers/cvpr2020_gaitpart.pdf) | 28.2 | - | 64x44 | - | - |
| [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 29.7 | - | 64x44 | - | - | | [GaitGL(ICCV2021)](https://openaccess.thecvf.com/content/ICCV2021/papers/Lin_Gait_Recognition_via_Effective_Global-Local_Feature_Representation_and_Local_Temporal_ICCV_2021_paper.pdf) | 29.7 | - | 64x44 | - | - |
| [GaitBase](https://arxiv.org/abs/2211.06597)| 65.6 | - | 64x44 | - | - | | [GaitBase](https://arxiv.org/abs/2211.06597) | 65.6 | - | 64x44 | - | - |
------------------------------------------ ------------------------------------------
@@ -54,6 +56,6 @@
The results in the parentheses are mentioned in the papers. The results in the parentheses are mentioned in the papers.
**Note**: **Note**:
- All results are Rank@1, excluding identical-view cases. - All results exclude identical-view cases in CASIA-B(*) and OUMVLP.
- The shown result of GLN is implemented without compact block. - The shown result of GLN is implemented without compact block.
- Only two RTX3090 are used for infering CASIA-B, and eight are used for infering OUMVLP. - The mAP is calculated by the new evaluation protocol proposed in [A Comprehensive Study on the Evaluation of Silhouette-based Gait Recognition](https://ieeexplore.ieee.org/document/9928336).