Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
261 commits
Select commit Hold shift + click to select a range
79c72a1
revert to /app
yzbx Jun 15, 2022
3f40dac
Revert "update for non-root user, git clone to /workspace/app instead…
yzbx Jun 15, 2022
059ac5d
update yolov5 dockerfile
yzbx Jun 15, 2022
62056ea
add dockerfile for cuda11
yzbx Jun 15, 2022
fec9ca8
remove loguru
yzbx Jun 15, 2022
e56ea6e
update mxnet docker file
yzbx Jun 16, 2022
f9ed595
change miniconda link
yzbx Jun 16, 2022
9972b9c
remove cuda111-dev, add empty line
yzbx Jun 17, 2022
bbab716
Merge branch 'IndustryEssentials:master' into live
yzbx Jun 18, 2022
0bd8922
Merge branch 'IndustryEssentials:master' into mmdet
yzbx Jun 18, 2022
ba8a738
support ymir cfg-option and args-option
yzbx Jun 18, 2022
748a522
support extend dataset format
yzbx Jun 19, 2022
b148307
Merge branch 'mmdet' of github.com:yzbx/ymir-executor-fork into mmdet
yzbx Jun 19, 2022
ea6a52e
update config
yzbx Jun 19, 2022
533fef1
update mmdet
yzbx Jun 20, 2022
9d0ef65
add gcc and make git clone faster
yzbx Jun 20, 2022
ac06c0f
add training ability
yzbx Jun 20, 2022
5402b3f
mmdet training model
yzbx Jun 21, 2022
1aed247
add infer
yzbx Jun 21, 2022
0ba4479
update readme
yzbx Jun 21, 2022
a8a8edd
update evaluation
yzbx Jun 22, 2022
1bff027
udpate
yzbx Jun 24, 2022
5f435e9
fix training bug
yzbx Jun 24, 2022
02e7e2c
Merge branch 'IndustryEssentials:master' into yolov4
yzbx Jun 24, 2022
6f1e49a
add README.MD
yzbx Jun 24, 2022
2f4ed3e
add README.MD
yzbx Jun 24, 2022
f13606c
Merge branch 'IndustryEssentials:master' into master
yzbx Jun 24, 2022
bbf824b
fix yolov5 nptyping problem
yzbx Jun 24, 2022
6d2baf2
Merge branch 'master' of github.com:yzbx/ymir-executor-fork
yzbx Jun 24, 2022
d5114a8
Merge branch 'IndustryEssentials:master' into yolov5
yzbx Jun 24, 2022
3bbb37b
modify requirements.txt
yzbx Jun 24, 2022
ab31501
Merge branch 'yolov5' of github.com:yzbx/ymir-executor-fork into yolov5
yzbx Jun 24, 2022
5f5bcb5
Merge branch 'IndustryEssentials:master' into yolov5
yzbx Jun 27, 2022
8882e60
fix extra tag
yzbx Jun 27, 2022
ab36579
Merge branch 'yolov5' of github.com:yzbx/ymir-executor-fork into yolov5
yzbx Jun 27, 2022
78c06ed
no merge, support for ymir1.2.0
yzbx Jun 28, 2022
8a01ee0
fix spell error
yzbx Jun 30, 2022
9b825ac
fix spell error
yzbx Jun 30, 2022
22f3e45
fix abs_path file not found error
yzbx Jun 30, 2022
a596917
Merge branch 'IndustryEssentials:master' into mmdet
yzbx Jul 1, 2022
9ebc439
infer && mining
yzbx Jul 4, 2022
94cefe7
training or mining && infer
yzbx Jul 4, 2022
035fb31
write file from /in to /out
yzbx Jul 4, 2022
dba2d4c
update docker file and c
yzbx Jul 4, 2022
7a5dd79
update readme
yzbx Jul 5, 2022
41fef8c
Revert "fix yolov5 nptyping problem"
yzbx Jul 5, 2022
12635f9
Merge branch 'yolov5'
yzbx Jul 5, 2022
cd5fa4f
Merge branch 'IndustryEssentials:master' into master
yzbx Jul 5, 2022
1a4af5e
revert and redo
yzbx Jul 5, 2022
bd7dde6
Merge branch 'master' of github.com:yzbx/ymir-executor-fork
yzbx Jul 5, 2022
3b3e978
update readme
yzbx Jul 6, 2022
7b201d1
add cuda112 dockerfile for yolov4
yzbx Jul 6, 2022
750a33c
Merge branch 'mmdet' of github.com:yzbx/ymir-executor-fork into mmdet
yzbx Jul 6, 2022
4c99d81
update mmdet for ymir1.2.0
yzbx Jul 6, 2022
588a16a
Merge branch 'IndustryEssentials:master' into mmdet
yzbx Jul 6, 2022
2cbb95e
update training
yzbx Jul 7, 2022
a312ed9
Merge branch 'mmdet' of github.com:yzbx/ymir-executor-fork into mmdet
yzbx Jul 7, 2022
9bdc59f
fix py3.7 and ymir_exc problem
yzbx Jul 7, 2022
5d14372
add mining and infer
yzbx Jul 7, 2022
8cbf2e9
update dockerfile
yzbx Jul 7, 2022
0daa2cd
empty mining template
yzbx Jul 7, 2022
9b346f2
model_path --> model_params
yzbx Jul 7, 2022
311f161
Merge branch 'IndustryEssentials:master' into live
yzbx Jul 7, 2022
84eb49f
add opencv
yzbx Jul 7, 2022
0b2b5cf
merge
yzbx Jul 7, 2022
61554ae
add opencv
yzbx Jul 7, 2022
f1dd6c6
udpate opencv version
yzbx Jul 7, 2022
50e6864
Update torch.dockerfile
yzbx Jul 7, 2022
6a164ca
Update mxnet.dockerfile
yzbx Jul 7, 2022
3ef0d43
add opencv and numpy arg
yzbx Jul 7, 2022
cffc5d0
add cuda112 dockerfile for yolov4
yzbx Jul 6, 2022
8aef24b
Merge branch 'yolov4' of github.com:yzbx/ymir-executor-fork into yolov4
yzbx Jul 7, 2022
0a27d88
Merge branch 'IndustryEssentials:master' into master
yzbx Jul 8, 2022
80084c6
update master
yzbx Jul 8, 2022
6bdd3e5
update dockerfile
yzbx Jul 11, 2022
5c1a6f5
format doc
yzbx Jul 11, 2022
0a6f11c
update .gitignore
yzbx Jul 11, 2022
49906e3
DDP training
yzbx Jul 11, 2022
a1177dc
remove *.pt in dockerignore file
yzbx Jul 11, 2022
3d342d0
add conf_threshold for infer
yzbx Jul 11, 2022
ba3b7f3
update dockerfile and commit id
yzbx Jul 13, 2022
8856b12
merge
yzbx Jul 13, 2022
c3e55a4
fix bug
yzbx Jul 15, 2022
9f8c1ac
swap config and add export_format
yzbx Jul 16, 2022
a3ffc83
update mmdet
yzbx Jul 16, 2022
4bfe8c3
fix none error
yzbx Jul 16, 2022
6326d07
add comment
yzbx Jul 16, 2022
e87e7ce
update git clone for live code
yzbx Jul 18, 2022
a701af6
support ymir1.0.0+
yzbx Jul 19, 2022
d2beb29
update
yzbx Jul 19, 2022
298637d
update doc
yzbx Jul 19, 2022
9ee903d
fix monitor process for multiple task
yzbx Jul 19, 2022
f7af1fc
Merge branch 'yolov5'
yzbx Jul 19, 2022
691bed7
update dockerfile
yzbx Jul 19, 2022
95fac1e
add system config into training-template
yzbx Jul 19, 2022
d59e323
update comment
yzbx Jul 19, 2022
685f2c7
add default value
yzbx Jul 19, 2022
0c134ec
update runtime
yzbx Jul 20, 2022
384c75e
fix asnumpy error
yzbx Jul 20, 2022
e903573
update result writer
yzbx Jul 22, 2022
4e36ca5
remove s
yzbx Jul 22, 2022
7410409
use _ to help coder
yzbx Jul 22, 2022
7c667d5
use _ to help user
yzbx Jul 22, 2022
5776d6d
Merge branch 'live'
yzbx Jul 27, 2022
4cb3f7b
Merge branch 'mmdet'
yzbx Jul 27, 2022
9e80668
Merge branch 'yolov4'
yzbx Jul 27, 2022
9a2c544
update master
yzbx Jul 27, 2022
e333e58
Merge branch 'IndustryEssentials:master' into master
yzbx Jul 27, 2022
87e18b3
update
yzbx Jul 28, 2022
3576e84
Merge branch 'master' of github.com:yzbx/ymir-executor-fork
yzbx Jul 28, 2022
b13264e
update readme
yzbx Aug 2, 2022
aa6e445
merge yolov4 training and mining
yzbx Aug 2, 2022
88a66e8
update readme
yzbx Aug 3, 2022
769be08
update readme and dockerfile
yzbx Aug 3, 2022
8c6b3dc
remove redundant
yzbx Aug 8, 2022
19b40d1
sort imports
yzbx Aug 8, 2022
bf4e4ad
update train.py
yzbx Aug 8, 2022
17ee0ed
update readme
yzbx Aug 9, 2022
e28dfbc
remove ddp destroy_process_group() on train end, https://github.com/u…
yzbx Aug 16, 2022
fb66ee9
add multi-gpu data loader
yzbx Aug 22, 2022
a5d81c8
add multi-gpu infer and mining
yzbx Aug 25, 2022
946a04f
change mining result save directory
yzbx Aug 25, 2022
3242af3
use data.yaml for onnx model
yzbx Aug 26, 2022
8573696
fix mining bug for multi-gpu
yzbx Aug 26, 2022
01989ae
support mutli-gpu mining
yzbx Aug 30, 2022
45d57c7
update mmdetection to ymir-executor-sdk 1.1.0
yzbx Aug 31, 2022
5cc425d
yzbx to modelai, add vidt
yzbx Aug 31, 2022
a7d65a6
add minig algorithm reference
yzbx Aug 31, 2022
4d3c869
add other reference
yzbx Aug 31, 2022
152105a
Merge pull request #2 from modelai/ymir-dev
yzbx Aug 31, 2022
8a30f5a
update doc
yzbx Aug 31, 2022
322892d
Merge pull request #3 from modelai/ymir-dev
yzbx Aug 31, 2022
09522d4
zzz
yzbx Aug 31, 2022
a5f5d77
Merge pull request #4 from modelai/ymir-dev
yzbx Aug 31, 2022
7544900
update readme
yzbx Sep 2, 2022
53bc0f5
fix mining entropy bug
yzbx Sep 2, 2022
f920f48
fix mining bug
yzbx Sep 2, 2022
e89ef68
Merge pull request #5 from modelai/ymir-dev
yzbx Sep 2, 2022
70817f8
zzz|
yzbx Sep 2, 2022
ec58f3c
zzz
yzbx Sep 2, 2022
0c8b49f
add nanodet benchmark
yzbx Sep 2, 2022
197fa09
fix mmdet ddp bug
yzbx Sep 6, 2022
5edd390
fix link change
yzbx Sep 6, 2022
3c8da7b
Merge pull request #6 from modelai/ymir-dev
yzbx Sep 6, 2022
958d121
add yolov5 mining code
LuciferZap Sep 8, 2022
8816fd8
del .idea directory
LuciferZap Sep 8, 2022
927429b
Merge pull request #7 from modelai/fzp/add_yolov5_aldd_mining
yzbx Sep 8, 2022
b6e25f9
update mmdet and readme
yzbx Sep 8, 2022
4fdb0ea
Merge branch 'ymir-dev' of github.com:yzbx/ymir-executor-fork into ym…
yzbx Sep 8, 2022
30194eb
add new mining algorithm for yolov5
yzbx Sep 8, 2022
953fc9a
add new mining algorith aldd for yolov5
yzbx Sep 8, 2022
2e03292
support long scores
yzbx Sep 8, 2022
9abe0c9
support change num_workers_per_gpu
yzbx Sep 14, 2022
a3079e5
assign before used
yzbx Sep 15, 2022
f11acb4
update aldd mining algorithm
yzbx Sep 16, 2022
4affb29
fix code-review conversation
yzbx Sep 16, 2022
680147b
use imagesize to get img w and h instead of read img
LuciferZap Sep 16, 2022
6b49b40
Merge pull request #9 from modelai/fzp/update_convertlabel_code
yzbx Sep 16, 2022
512194c
save topk checkpoint weight files
yzbx Sep 16, 2022
ef09dcf
fix 30min dist.barrier() time-out errors
yzbx Sep 21, 2022
20491af
update readme
yzbx Sep 22, 2022
b294d3b
Merge pull request #8 from modelai/ymir-dev
yzbx Sep 22, 2022
ebc3f24
update readme
yzbx Sep 26, 2022
92f4c4b
update infer process
yzbx Sep 28, 2022
122862f
fix barrier
yzbx Oct 12, 2022
bb0b572
Add files via upload
yzbx Oct 13, 2022
c969eea
Merge branch 'ymir-dev' of github.com:modelai/ymir-executor-fork into…
yzbx Oct 13, 2022
3b808de
add det-demo-tmi.md and docs
yzbx Oct 13, 2022
81a2019
update doc
yzbx Oct 13, 2022
424cd4e
add verifier to doc, add ymir_saved_file_patterns to training-templat…
yzbx Oct 17, 2022
c0d64ba
add random and aldd mining algorithm
yzbx Oct 18, 2022
3230af1
fix training class_number bug
yzbx Oct 19, 2022
cfd2d3b
change hyper-parameter
yzbx Oct 19, 2022
59420c2
add entropy,random for yolov5
Oct 19, 2022
46a2439
Merge pull request #11 from modelai/nanfei
yzbx Oct 19, 2022
d760d8d
update readme
yzbx Oct 19, 2022
6191066
add mining overview
yzbx Oct 20, 2022
6559078
Merge branch 'master' into ymir-dev
yzbx Oct 20, 2022
5e605ec
merge multi-gpu and single gpu mining mode
yzbx Oct 20, 2022
35a000e
mv files
yzbx Oct 20, 2022
2f36c1c
mv folder
yzbx Oct 20, 2022
8980e0a
merge single-gpu and mutiple gpu infer
yzbx Oct 20, 2022
3f0847b
Merge pull request #10 from modelai/ymir-dev
LuciferZap Oct 20, 2022
180a8fe
update monitor process
yzbx Oct 20, 2022
e554076
update ymir1.3.0 to ymir2.0.0
yzbx Oct 20, 2022
0f5e843
update dockerfile
yzbx Oct 21, 2022
4520d90
update ymir2.0.0 docker hyper-parameters doc
yzbx Oct 27, 2022
c1db964
Merge pull request #12 from modelai/ymir-dev
yzbx Oct 27, 2022
ff580ad
update docker file
yzbx Nov 1, 2022
a3959cc
update doc
yzbx Nov 1, 2022
cf4cdd7
update yolov5
yzbx Nov 2, 2022
5ccc402
add dataset convert ad
yzbx Nov 2, 2022
2ff6f57
add entropy mining
yzbx Nov 4, 2022
76d6076
Merge pull request #14 from modelai/ymir-dev
yzbx Nov 4, 2022
6619220
add yolov5 training doc
yzbx Nov 8, 2022
f823f84
update doc
yzbx Nov 10, 2022
0bf09fe
update doc
yzbx Nov 10, 2022
161c77d
Merge pull request #16 from modelai/ymir-dev
yzbx Nov 10, 2022
90887b2
udpate doc
yzbx Nov 10, 2022
c2b74e1
add yolov5 custom demo
yzbx Nov 10, 2022
1fef519
Merge pull request #17 from modelai/ymir-dev
yzbx Nov 10, 2022
b115cc0
update mining algorithm
yzbx Nov 11, 2022
8c5c6ac
Merge pull request #18 from modelai/ymir-dev
yzbx Nov 11, 2022
f23a33d
update doc
yzbx Nov 11, 2022
961d922
update doc
yzbx Nov 11, 2022
d4df6b9
zzz
yzbx Nov 11, 2022
d02744c
udpate yolov5 activation
yzbx Nov 11, 2022
d7cb1e9
update doc and activation
yzbx Nov 21, 2022
e022839
format and rerank
yzbx Nov 21, 2022
3dec7b8
update yolov5 image doc
yzbx Nov 23, 2022
ba9f083
speed up
yzbx Nov 24, 2022
3319199
update docker ignore for model-store
yzbx Nov 30, 2022
3cf7936
update yolov5 version
yzbx Nov 30, 2022
f074680
update readme for yolov5
yzbx Jan 3, 2023
645fe9b
add empty doc
yzbx Jan 3, 2023
517a71c
Merge branch 'ymir-dev' of github.com:modelai/ymir-executor-fork into…
yzbx Jan 3, 2023
8de25b9
update doc
yzbx Jan 3, 2023
3464c51
update mmdet
yzbx Jan 4, 2023
f32e66a
update for ddp infer support
yzbx Jan 4, 2023
d1f719c
update dock
yzbx Jan 4, 2023
bcf172f
Merge pull request #21 from modelai/ymir-dev
yzbx Jan 4, 2023
d4eccca
update for det-demo-tmi
yzbx Jan 10, 2023
377f9a1
add read the docs
yzbx Jan 11, 2023
2fbcfa8
first read the docs
yzbx Jan 11, 2023
1d1527f
add mkdocs
yzbx Jan 13, 2023
b614e8b
add readthedocs
yzbx Jan 13, 2023
2d26458
add simple det doc
yzbx Jan 28, 2023
fa3d1b4
reorder nav
yzbx Jan 28, 2023
9b22f01
update requirements.txt
yzbx Jan 28, 2023
63f6dd6
Merge pull request #22 from modelai/ymir-dev
yzbx Feb 1, 2023
7624b83
update doc
yzbx Feb 1, 2023
c9382e1
Merge pull request #23 from modelai/ymir-dev
yzbx Feb 1, 2023
7bd54f9
udpate readme
yzbx Feb 1, 2023
67b87be
Merge pull request #24 from modelai/ymir-dev
yzbx Feb 1, 2023
4317f16
add instance seg demo
yzbx Feb 3, 2023
b413d1a
zzz
yzbx Feb 3, 2023
f6cd017
add confidence for instance segmentation
yzbx Feb 3, 2023
4135523
update instance seg-demo-tmi
yzbx Feb 6, 2023
85e8978
update doc for instance segmentation and image community
yzbx Feb 6, 2023
e10c818
udpate doc
yzbx Feb 8, 2023
0c59919
add mmseg doc
yzbx Feb 10, 2023
8bafa99
update seg-mmseg-tmi.md
yzbx Feb 10, 2023
b3638cc
add doc
yzbx Feb 10, 2023
d86a1ee
update doc by chatgpt
yzbx Feb 24, 2023
5bb5b03
update demo readme
yzbx Mar 2, 2023
6a91c6d
update sdk to ymir2.1.0
yzbx Mar 2, 2023
7c94744
update doc
yzbx Mar 2, 2023
d6c676e
Merge pull request #25 from modelai/ymir-dev
yzbx Mar 2, 2023
077896d
fix docker build error
yzbx Mar 3, 2023
422f1e4
Merge pull request #26 from modelai/ymir-dev
yzbx Mar 3, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -27,3 +27,5 @@ yolov4_training/yolov4.conv.137
yolov4_training/build_docker.sh
yolov4_training/dockerfile_tmp
yolov4_training/yolov4.conv.137
det-demo-tmi/voc_dog
site/
20 changes: 20 additions & 0 deletions .readthedocs.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
# .readthedocs.yaml
# Read the Docs configuration file
# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details

# Required
version: 2

# Set the version of Python and other tools you might need
build:
os: ubuntu-22.04
tools:
python: "3.11"

mkdocs:
configuration: mkdocs.yml

# Optionally declare the Python requirements required to build your docs
python:
install:
- requirements: docs/requirements.txt
105 changes: 0 additions & 105 deletions README.MD

This file was deleted.

80 changes: 80 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
# ymir-executor documentation [English](./README.md) | [简体中文](./README_zh-CN.md)

- 🏠 [ymir](https://github.com/IndustryEssentials/ymir)

- 📺 [video tutorial](https://b23.tv/KS5b5oF)

- 👨‍👩‍👧‍👧 [Image Community](http://pubimg.vesionbook.com:8110/img) search and share open source.

- 📘 [Documence](https://ymir-executor-fork.readthedocs.io/zh/latest/#)

## overview

| docker image | [finetune](https://github.com/modelai/ymir-executor-fork/wiki/use-yolov5-to-finetune-or-training-model) | tensorboard | args/cfg options | framework | onnx | pretrained weights |
| - | - | - | - | - | - | - |
| yolov4 | ? | ✔️ | ❌ | darknet + mxnet | ❌ | local |
| yolov5 | ✔️ | ✔️ | ✔️ | pytorch | ✔️ | local+online |
| yolov7 | ✔️ | ✔️ | ✔️ | pytorch | ❌ | local+online |
| mmdetection | ✔️ | ✔️ | ✔️ | pytorch | ❌ | local+online |
| detectron2 | ✔️ | ✔️ | ✔️ | pytorch | ❌ | online |
| vidt | ? | ✔️ | ✔️ | pytorch | ❌ | online |
| nanodet | ✔️ | ✔️ | ❌ | pytorch_lightning | ❌ | local+online |

- `online` pretrained weights may download through network

- `local` pretrained weights have copied to docker images when building image

### benchmark

- training dataset: voc2012-train 5717 images
- validation dataset: voc2012-val 5823 images
- image size: 640

gpu: single Tesla P4

| docker image | batch size | epoch number | model | voc2012 val map50 | training time | note |
| - | - | - | - | - | - | - |
| yolov5 | 16 | 100 | yolov5s | 70.05% | 9h | coco-pretrained |
| vidt | 2 | 100 | swin-nano | 54.13% | 2d | imagenet-pretrained |
| yolov4 | 4 | 20000 steps | yolov4 | 66.18% | 2d | imagenet-pretrained |
| yolov7 | 16 | 100 | yolov7-tiny | 70% | 8h | coco-pretrained |

gpu: single GeForce GTX 1080 Ti

| docker image | image size | batch size | epoch number | model | voc2012 val map50 | training time | note |
| - | - | - | - | - | - | - | - |
| yolov4 | 608 | 64/32 | 20000 steps | yolov4 | 72.73% | 6h | imagenet-pretrained |
| yolov5 | 640 | 16 | 100 | yolov5s | 70.35% | 2h | coco-pretrained |
| yolov7 | 640 | 16 | 100 | yolov7-tiny | 70.4% | 5h | coco-pretrained |
| mmdetection | 640 | 16 | 100 | yolox_tiny | 66.2% | 5h | coco-pretrained |
| detectron2 | 640 | 2 | 20000 steps | retinanet_R_50_FPN_1x | 53.54% | 2h | imagenet-pretrained |
| nanodet | 416 | 16 | 100 | nanodet-plus-m_416 | 58.63% | 5h | imagenet-pretrained |

---

## how to import pretrained model weights

- [import and finetune model](https://github.com/modelai/ymir-executor-fork/wiki/import-and-finetune-model)

- [import pretainted model weights](https://github.com/IndustryEssentials/ymir/blob/master/dev_docs/import-extra-models.md)

## reference

### object detection
- [ymir-yolov5](https://github.com/modelai/ymir-yolov5)
- [ymir-yolov7](https://github.com/modelai/ymir-yolov7)
- [ymir-nanodet](https://github.com/modelai/ymir-nanodet)
- [ymir-mmyolo](https://github.com/modelai/ymir-mmyolo)
- [ymir-vidt](https://github.com/modelai/ymir-vidt)
- [ymir-detectron2](https://github.com/modelai/ymir-detectron2)

### semantic segmenation
- [ymir-mmsegmentation](https://github.com/modelai/ymir-mmsegmentation)

### instance segmentation
- [ymir-yolov5-seg](https://github.com/modelai/ymir-yolov5-seg)

### resource
- [ymir-executor-sdk](https://github.com/modelai/ymir-executor-sdk) ymir_exc package, help to develop your image
- [ymir-executor-verifier](https://github.com/modelai/ymir-executor-verifier) test your ymir image
- [ymir-flask](https://github.com/modelai/ymir-flask) deploy your model on website
84 changes: 84 additions & 0 deletions README_zh-CN.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@
# ymir-executor 使用文档 [English](./README.md) | [简体中文](./README_zh-CN.md)

- 🏠 [ymir](https://github.com/IndustryEssentials/ymir)

- 📺 [视频教程](https://b23.tv/KS5b5oF)

- 👨‍👩‍👧‍👧 [镜像社区](http://pubimg.vesionbook.com:8110/img) 可搜索到所有公开的ymir算法镜像, 同时可共享其他人发布的镜像。

- 📘 [文档](https://ymir-executor-fork.readthedocs.io/zh/latest/#)

## 比较

| docker image | [finetune](https://github.com/modelai/ymir-executor-fork/wiki/use-yolov5-to-finetune-or-training-model) | tensorboard | args/cfg options | framework | onnx | pretrained weight |
| - | - | - | - | - | - | - |
| yolov4 | ? | ✔️ | ❌ | darknet + mxnet | ❌ | local |
| yolov5 | ✔️ | ✔️ | ✔️ | pytorch | ✔️ | local+online |
| yolov7 | ✔️ | ✔️ | ✔️ | pytorch | ❌ | local+online |
| mmdetection | ✔️ | ✔️ | ✔️ | pytorch | ❌ | local+online |
| detectron2 | ✔️ | ✔️ | ✔️ | pytorch | ❌ | online |
| vidt | ? | ✔️ | ✔️ | pytorch | ❌ | online |
| nanodet | ✔️ | ✔️ | ❌ | pytorch_lightning | ❌ | local+online |

- `online` 预训练权重可能在训练时通过网络下载

- `local` 预训练权重在构建镜像时复制到了镜像

### benchmark

- 训练集: voc2012-train 5717 images
- 测试集: voc2012-val 5823 images
- 图像大小: 640 (nanodet为416, yolov4为608)

**由于 coco 数据集包含 voc 数据集中的类, 因此这个对比并不公平, 仅供参考**

gpu: single Tesla P4

| docker image | batch size | epoch number | model | voc2012 val map50 | training time | note |
| - | - | - | - | - | - | - |
| yolov5 | 16 | 100 | yolov5s | 70.05% | 9h | coco-pretrained |
| vidt | 2 | 100 | swin-nano | 54.13% | 2d | imagenet-pretrained |
| yolov4 | 4 | 20000 steps | yolov4 | 66.18% | 2d | imagenet-pretrained |
| yolov7 | 16 | 100 | yolov7-tiny | 70% | 8h | coco-pretrained |

gpu: single GeForce GTX 1080 Ti

| docker image | image size | batch size | epoch number | model | voc2012 val map50 | training time | note |
| - | - | - | - | - | - | - | - |
| yolov4 | 608 | 64/32 | 20000 steps | yolov4 | 72.73% | 6h | imagenet-pretrained |
| yolov5 | 640 | 16 | 100 | yolov5s | 70.35% | 2h | coco-pretrained |
| yolov7 | 640 | 16 | 100 | yolov7-tiny | 70.4% | 5h | coco-pretrained |
| mmdetection | 640 | 16 | 100 | yolox_tiny | 66.2% | 5h | coco-pretrained |
| detectron2 | 640 | 2 | 20000 steps | retinanet_R_50_FPN_1x | 53.54% | 2h | imagenet-pretrained |
| nanodet | 416 | 16 | 100 | nanodet-plus-m_416 | 58.63% | 5h | imagenet-pretrained |

---

## 如何导入预训练模型

- [如何导入并精调外部模型](https://github.com/modelai/ymir-executor-fork/wiki/import-and-finetune-model)

- [如何导入外部模型](https://github.com/IndustryEssentials/ymir/blob/master/dev_docs/import-extra-models.md)

- 通过ymir网页端的 `模型管理/模型列表/导入模型` 同样可以导入模型

## 参考

### 目标检测
- [ymir-yolov5](https://github.com/modelai/ymir-yolov5)
- [ymir-yolov7](https://github.com/modelai/ymir-yolov7)
- [ymir-nanodet](https://github.com/modelai/ymir-nanodet)
- [ymir-mmyolo](https://github.com/modelai/ymir-mmyolo)
- [ymir-vidt](https://github.com/modelai/ymir-vidt)
- [ymir-detectron2](https://github.com/modelai/ymir-detectron2)

### 语义分割
- [ymir-mmsegmentation](https://github.com/modelai/ymir-mmsegmentation)

### 实例分割
- [ymir-yolov5-seg](https://github.com/modelai/ymir-yolov5-seg)

### 资源
- [ymir-executor-sdk](https://github.com/modelai/ymir-executor-sdk) ymir_exc 包,辅助开发镜像
- [ymir-executor-verifier](https://github.com/modelai/ymir-executor-verifier) 测试镜像工具
- [ymir-flask](https://github.com/modelai/ymir-flask) 云端部署示例
30 changes: 30 additions & 0 deletions det-demo-tmi/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
# a docker file for an sample training / mining / infer executor

FROM python:3.8.13-alpine

RUN sed -i 's/dl-cdn.alpinelinux.org/mirrors.tuna.tsinghua.edu.cn/g' /etc/apk/repositories
# Add bash
RUN apk add bash
# Required to build numpy wheel
RUN apk add g++ git make

COPY requirements.txt ./
RUN pip3 install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple

WORKDIR /app
# copy user code to WORKDIR
COPY ./app/start.py /app/

# copy user config template and manifest.yaml to /img-man
RUN mkdir -p /img-man
COPY img-man/*.yaml /img-man/

# view https://github.com/protocolbuffers/protobuf/issues/10051 for detail
ENV PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python

# entry point for your app
# the whole docker image will be started with `nvidia-docker run <other options> <docker-image-name>`
# and this command will run automatically

RUN echo "python /app/start.py" > /usr/bin/start.sh
CMD bash /usr/bin/start.sh
Loading