Junhao Liang
bb6cd5149a
* fix bug in fix_BN * gaitgl OUMVLP support. * update ./doc/3.advance_usage.md Cross-Dataset Evalution & Data Agumentation * update config * update docs.3 * update docs.3 * add loss doc and gather input decorator * refine the create model doc * support rearrange directory of unzipped OUMVLP * fix some bugs in loss_aggregator.py * refine docs and little fix * add oumvlp pretreatment description * pretreatment dataset fix oumvlp description * add gaitgl oumvlp result * assert gaitgl input size * add pipeline * update the readme. * update pipeline and readme * Corrigendum. * add logo and remove path * update new logo * Update README.md * modify logo size Co-authored-by: 12131100 <12131100@mail.sustech.edu.cn> Co-authored-by: noahshen98 <77523610+noahshen98@users.noreply.github.com> Co-authored-by: Noah <595311942@qq.com>
101 lines
2.8 KiB
Markdown
101 lines
2.8 KiB
Markdown
# Prepare dataset
|
|
Suppose you have downloaded the original dataset, we need to preprocess the data and save it as pickle file. Remember to set your path to the root of processed dataset in [config/*.yaml](config/).
|
|
|
|
## Preprocess
|
|
**CASIA-B**
|
|
|
|
Download URL: http://www.cbsr.ia.ac.cn/GaitDatasetB-silh.zip
|
|
- Original
|
|
```
|
|
CASIA-B
|
|
001 (subject)
|
|
bg-01 (type)
|
|
000 (view)
|
|
001-bg-01-000-001.png (frame)
|
|
001-bg-01-000-002.png (frame)
|
|
......
|
|
......
|
|
......
|
|
......
|
|
```
|
|
- Run `python misc/pretreatment.py --input_path CASIA-B --output_path CASIA-B-pkl`
|
|
- Processed
|
|
```
|
|
CASIA-B-pkl
|
|
001 (subject)
|
|
bg-01 (type)
|
|
000 (view)
|
|
000.pkl (contains all frames)
|
|
......
|
|
......
|
|
......
|
|
```
|
|
**OUMVLP**
|
|
|
|
Step1: Download URL: http://www.am.sanken.osaka-u.ac.jp/BiometricDB/GaitMVLP.html
|
|
|
|
Step2: Unzip the dataset, you will get a structure directory like:
|
|
|
|
- Original
|
|
```
|
|
OUMVLP-raw
|
|
Silhouette_000-00 (view-sequence)
|
|
00001 (subject)
|
|
0001.png (frame)
|
|
0002.png (frame)
|
|
......
|
|
00002
|
|
0001.png (frame)
|
|
0002.png (frame)
|
|
......
|
|
......
|
|
Silhouette_000-01
|
|
00001
|
|
0001.png (frame)
|
|
0002.png (frame)
|
|
......
|
|
00002
|
|
0001.png (frame)
|
|
0002.png (frame)
|
|
......
|
|
......
|
|
Silhouette_015-00
|
|
......
|
|
Silhouette_015-01
|
|
......
|
|
......
|
|
```
|
|
Step3 : To rearrange directory of OUMVLP dataset, turning to id-type-view structure, Run
|
|
```
|
|
python misc/rearrange_OUMVLP.py --input_path OUMVLP-raw --output_path OUMVLP-rearrange
|
|
```
|
|
|
|
Step4: Transforming images to pickle file, run
|
|
```
|
|
python misc/pretreatment.py --input_path OUMVLP-rearrange --output_path OUMVLP-pkl
|
|
```
|
|
|
|
- Processed
|
|
```
|
|
OUMVLP-pkl
|
|
00001 (subject)
|
|
00 (sequence)
|
|
000 (view)
|
|
000.pkl (contains all frames)
|
|
015 (view)
|
|
015.pkl (contains all frames)
|
|
...
|
|
01 (sequence)
|
|
000 (view)
|
|
000.pkl (contains all frames)
|
|
015 (view)
|
|
015.pkl (contains all frames)
|
|
......
|
|
00002 (subject)
|
|
......
|
|
......
|
|
```
|
|
|
|
|
|
## Split dataset
|
|
You can use the partition file in [misc/partitions](misc/partitions/) directly, or you can create yours. Remember to set your path to the partition file in [config/*.yaml](config/). |