相关文章推荐
豪爽的西装  ·  南通市司法局关于全市律师和律师事务所2019 ...·  2 月前    · 
俊逸的卡布奇诺  ·  2021年全市道路交通管理工作总结-规划计划 ...·  3 月前    · 
酒量大的烈酒  ·  【古剑三】古剑奇谭三岑缨支线「久远之阵」_哔 ...·  7 月前    · 
失恋的面包  ·  2023辽博壁纸 | ...·  1 年前    · 
魁梧的水龙头  ·  东风EV新能源纳米BOX上市 ...·  1 年前    · 
Code  ›  【vision transformer】DETR原理及代码详解（三）-阿里云开发者社区
lib文件 num main函数 coco
http://developer.aliyun.com:443/article/1293871
好帅的苦咖啡
1 年前
本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《 阿里云开发者社区用户服务协议 》和 《 阿里云开发者社区知识产权保护指引 》。如果您发现本社区中有涉嫌抄袭的内容，填写 侵权投诉表单 进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。

transformer 端到端目标检测DETR项目实践及代码详解：

Paddle Detr： git ： PaddleViT/object_detection/DETR at develop · BR-IDL/PaddleViT · GitHub

数据集及backbone model 百度网盘资源：

COCO数据集：

解压后放在DETR/dataset/coco文件夹下。

d71ce23ca62b475b8deb3e1b21b51ca7.png

Resnet50_model_weights:

https://pan.baidu.com/share/init?surl=GX_znZUgKe4f6Fjhga3TnQ&pwd=uamk

Resnet101_model_weights：

https://pan.baidu.com/s/1kfimY0-ebmgs42phlhwUWA?pwd=2veg

放在DETR/config 文件夹下

441e94c6e27b42dca4548b1e5aef5e73.png

环境部署：

  • Python>=3.6
  • yaml>=0.2.5
  • PaddlePaddle>=2.1.0
  • yacs>=0.1.8

COCO数据集训练/测试：

单gpu 训练： 

sh run_eval.sh

或者： 

CUDA_VISIBLE_DEVICES=2 python main_single_gpu.py -cfg='./configs/detr_resnet50.yaml' -dataset='coco' -batch_size=2 -data_path='./dataset/coco'

若 error： 

wsx@hello:~/0A_DATA/DETR$ python main_single_gpu.py -cfg='./configs/detr_resnet50.yaml' -dataset='coco' -batch_size=2 -data_path='./dataset/coco'
Traceback (most recent call last):
  File "main_single_gpu.py", line 412, in <module>
    main()
  File "main_single_gpu.py", line 234, in main
    config = update_config(config, arguments)
  File "/home/wsx/0A_DATA/DETR/config.py", line 123, in update_config
    _update_config_from_file(config, args.cfg)
  File "/home/wsx/0A_DATA/DETR/config.py", line 104, in _update_config_from_file
    yaml_cfg = yaml.load(infile, Loader=yaml.FullLoader)
AttributeError: module 'yaml' has no attribute 'FullLoader'

solution： 

python -m pip install --ignore-installed PyYAML

多GPU训练 

sh run_train_multi.sh

或者 

CUDA_VISIBLE_DEVICES=0,1,2,3 \
python main_multi_gpu.py \
    -cfg=./configs/detr_resnet50.yaml \
    -dataset=coco \
    -batch_size=2 \
    -data_path='./dataset/coco/'

单gpu 测试： 

sh run_eval.sh

或 

CUDA_VISIBLE_DEVICES=0 \
python main_single_gpu.py \
-cfg='./configs/detr_resnet50.yaml' \
-dataset='coco' \
-batch_size=2 \
-data_path='./dataset/coco' \
-eval \
-pretrained=./configs/detr_resnet50

多gpu 测试 

sh run_eval_multi.sh

或 

CUDA_VISIBLE_DEVICES=0,1,2,3 \
python main_multi_gpu.py \
    -cfg=./configs/detr_resnet50.yaml \
    -dataset=coco \
    -batch_size=4 \
    -data_path=/path/to/dataset/coco/val \
    -eval \
    -pretrained=/path/to/pretrained/model/detr_resnet50  # .pdparams is NOT needed

训练过程： 

(wireframe) wsx@hello:~/0A_DATA/DETR$ python main_single_gpu.py -cfg='./configs/detr_resnet50.yaml' -dataset='coco' -batch_size=2 -data_path='./dataset/coco'
merging config from ./configs/detr_resnet50.yaml
0413 07:14:33 PM 
BASE: ['']
DATA:
  BATCH_SIZE: 2
  BATCH_SIZE_EVAL: 8
  DATASET: coco
  DATA_PATH: ./dataset/coco
  IMAGENET_MEAN: [0.485, 0.456, 0.406]
  IMAGENET_STD: [0.229, 0.224, 0.225]
  NUM_WORKERS: 2
EVAL: False
LOCAL_RANK: 0
MODEL:
  ATTENTION_DROPOUT: 0.0
  BACKBONE: resnet50
  BACKBONE_LR: 0.1
  DROPOUT: 0.1
  NAME: DETR
  NUM_CLASSES: 91
  NUM_QUERIES: 100
  PRETRAINED: None
  RESUME: None
  TRANS:
    EMBED_DIM: 256
    MLP_RATIO: 8.0
    NUM_DECODERS: 6
    NUM_ENCODERS: 6
    NUM_HEADS: 8
    PRE_NORM: False
    RETURN_INTERMEDIATE_DEC: True
  TYPE: DETR
NGPUS: -1
REPORT_FREQ: 10
SAVE: ./output/train-20220413-19-14-33
SAVE_FREQ: 1
SEED: 0
TAG: default
TRAIN:
  ACCUM_ITER: 1
  BASE_LR: 0.0001
  END_LR: 1e-05
  GRAD_CLIP: 0.1
  LAST_EPOCH: 0
  LR_SCHEDULER:
    DECAY_EPOCHS: 200
    DECAY_RATE: 0.1
    MILESTONES: 30, 60, 90
    NAME: step
  NUM_EPOCHS: 300
  OPTIMIZER:
    BETAS: (0.9, 0.999)
    EPS: 1e-08
    MOMENTUM: 0.9
    NAME: AdamW
  WARMUP_EPOCHS: 3
  WARMUP_START_LR: 1e-06
  WEIGHT_DECAY: 0.0001
VALIDATE_FREQ: 20
W0413 19:14:33.715436 27246 device_context.cc:447] Please NOTE: device: 0, GPU Compute Capability: 7.5, Driver API Version: 10.1, Runtime API Version: 10.1
W0413 19:14:33.717669 27246 device_context.cc:465] device: 0, cuDNN Version: 7.6.
0413 07:14:36 PM unique_endpoints {''}
0413 07:14:36 PM Downloading resnet50.pdparams from https://paddle-hapi.bj.bcebos.com/models/resnet50.pdparams
  0%|▌                                                                                                                                                      | 595/151272 [00:01<03:45, 669.42it/s]  0%|▋                                                                                                                                                      | 674/151272 [00:01<05:37, 446.26it/s]

测试 过程：

error1： 

TypeError: 'numpy.float64' object cannot be interpreted as an integer
solution：
python -m pip install numpy==1.15.0

error2： 

AssertionError: We only support 'to_tensor()' in dynamic graph mode, please call 'paddle.disable_static()' to enter dynamic graph mode.

解决方案1 

import paddle 后面加入
paddle.enable_static()

又出错 

TypeError: The registered buffer should be a core.VarBase, but received Variable.

回到上一步，删去paddle.enable_static()，再运行sh run_eval.sh，查看全部报错内容如下： 

loading coco data, 48 imgs without annos are removed
0413 10:50:27 PM ----- Pretrained: Load model state from ./configs/detr_resnet50
0413 10:50:27 PM ----- Start Validating
/home/wsx/anaconda3/lib/python3.6/site-packages/pycocotools/cocoeval.py:507: DeprecationWarning: object of type <class 'numpy.float64'> cannot be safely interpreted as an integer.
  self.iouThrs = np.linspace(.5, 0.95, np.round((0.95 - .5) / .05) + 1, endpoint=True)
/home/wsx/anaconda3/lib/python3.6/site-packages/pycocotools/cocoeval.py:508: DeprecationWarning: object of type <class 'numpy.float64'> cannot be safely interpreted as an integer.
  self.recThrs = np.linspace(.0, 1.00, np.round((1.00 - .0) / .01) + 1, endpoint=True)
/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/fluid/dygraph/math_op_patch.py:253: UserWarning: The dtype of left and right variables are not the same, left dtype is paddle.float32, but right dtype is paddle.bool, the right dtype will convert to paddle.float32
  format(lhs_dtype, rhs_dtype, lhs_dtype))
Traceback (most recent call last):
  File "main_single_gpu.py", line 413, in <module>
    main()
  File "main_single_gpu.py", line 355, in main
    debug_steps=config.REPORT_FREQ)
  File "main_single_gpu.py", line 219, in validate
    coco_evaluator.update(res)
  File "/home/wsx/0A_DATA/DETR/coco_eval.py", line 34, in update
    coco_dt = COCO.loadRes(self.coco_gt, results) if results else COCO()
  File "/home/wsx/anaconda3/lib/python3.6/site-packages/pycocotools/coco.py", line 308, in loadRes
    if type(resFile) == str or type(resFile) == unicode:
NameError: name 'unicode' is not defined
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/home/wsx/anaconda3/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/home/wsx/anaconda3/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 213, in _thread_loop
    self._thread_done_event)
  File "/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/fluid/dataloader/fetcher.py", line 121, in fetch
    data.append(self.dataset[idx])
  File "/home/wsx/0A_DATA/DETR/coco.py", line 92, in __getitem__
    image, target = self._transforms(image, target)
  File "/home/wsx/0A_DATA/DETR/transforms.py", line 349, in __call__
    image, target = t(image, target)
  File "/home/wsx/0A_DATA/DETR/transforms.py", line 349, in __call__
    image, target = t(image, target)
  File "/home/wsx/0A_DATA/DETR/transforms.py", line 304, in __call__
    return T.to_tensor(image), target
  File "/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/vision/transforms/functional.py", line 82, in to_tensor
    return F_pil.to_tensor(pic, data_format)
  File "/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/vision/transforms/functional_pil.py", line 77, in to_tensor
    img = paddle.to_tensor(np.array(pic, copy=False))
  File "<decorator-gen-134>", line 2, in to_tensor
  File "/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/fluid/wrapped_decorator.py", line 25, in __impl__
    return wrapped_func(*args, **kwargs)
  File "/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/fluid/framework.py", line 228, in __impl__
    ), "We only support '%s()' in dynamic graph mode, please call 'paddle.disable_static()' to enter dynamic graph mode." % func.__name__
AssertionError: We only support 'to_tensor()' in dynamic graph mode, please call 'paddle.disable_static()' to enter dynamic graph mode.

针对 

NameError: name 'unicode' is not defined

将下面文件中的 

File "/home/wsx/anaconda3/lib/python3.6/site-packages/pycocotools/coco.py", line 308, in loadRes
    if type(resFile) == str or type(resFile) == unicode:

改为： 

if type(resFile) == str:

因为 python2中的unicode()函数在python3中会报错。再运行，

测试结果如下： 

(wireframe) wsx@hello:~/0A_DATA/DETR$ sh run_eval.sh
merging config from ./configs/detr_resnet50.yaml
0413 10:58:49 PM 
BASE: ['']
DATA:
  BATCH_SIZE: 2
  BATCH_SIZE_EVAL: 2
  DATASET: coco
  DATA_PATH: ./dataset/coco
  IMAGENET_MEAN: [0.485, 0.456, 0.406]
  IMAGENET_STD: [0.229, 0.224, 0.225]
  NUM_WORKERS: 2
EVAL: True
LOCAL_RANK: 0
MODEL:
  ATTENTION_DROPOUT: 0.0
  BACKBONE: resnet50
  BACKBONE_LR: 0.1
  DROPOUT: 0.1
  NAME: DETR
  NUM_CLASSES: 91
  NUM_QUERIES: 100
  PRETRAINED: ./configs/detr_resnet50
  RESUME: None
  TRANS:
    EMBED_DIM: 256
    MLP_RATIO: 8.0
    NUM_DECODERS: 6
    NUM_ENCODERS: 6
    NUM_HEADS: 8
    PRE_NORM: False
    RETURN_INTERMEDIATE_DEC: True
  TYPE: DETR
NGPUS: -1
REPORT_FREQ: 10
SAVE: ./output/eval-20220413-22-58-49
SAVE_FREQ: 1
SEED: 0
TAG: default
TRAIN:
  ACCUM_ITER: 1
  BASE_LR: 0.0001
  END_LR: 1e-05
  GRAD_CLIP: 0.1
  LAST_EPOCH: 0
  LR_SCHEDULER:
    DECAY_EPOCHS: 200
    DECAY_RATE: 0.1
    MILESTONES: 30, 60, 90
    NAME: step
  NUM_EPOCHS: 300
  OPTIMIZER:
    BETAS: (0.9, 0.999)
    EPS: 1e-08
    MOMENTUM: 0.9
    NAME: AdamW
  WARMUP_EPOCHS: 3
  WARMUP_START_LR: 1e-06
  WEIGHT_DECAY: 0.0001
VALIDATE_FREQ: 20
W0413 22:58:49.250936 26141 device_context.cc:447] Please NOTE: device: 0, GPU Compute Capability: 7.5, Driver API Version: 10.1, Runtime API Version: 10.1
W0413 22:58:49.253305 26141 device_context.cc:465] device: 0, cuDNN Version: 7.6.
0413 10:58:51 PM unique_endpoints {''}
0413 10:58:51 PM File /home/wsx/.cache/paddle/hapi/weights/resnet50.pdparams md5 checking...
0413 10:58:52 PM Found /home/wsx/.cache/paddle/hapi/weights/resnet50.pdparams
loading annotations into memory...
Done (t=0.34s)
creating index...
index created!
loading coco data, 48 imgs without annos are removed
0413 10:58:53 PM ----- Pretrained: Load model state from ./configs/detr_resnet50
0413 10:58:53 PM ----- Start Validating
/home/wsx/anaconda3/lib/python3.6/site-packages/pycocotools/cocoeval.py:507: DeprecationWarning: object of type <class 'numpy.float64'> cannot be safely interpreted as an integer.
  self.iouThrs = np.linspace(.5, 0.95, np.round((0.95 - .5) / .05) + 1, endpoint=True)
/home/wsx/anaconda3/lib/python3.6/site-packages/pycocotools/cocoeval.py:508: DeprecationWarning: object of type <class 'numpy.float64'> cannot be safely interpreted as an integer.
  self.recThrs = np.linspace(.0, 1.00, np.round((1.00 - .0) / .01) + 1, endpoint=True)
/home/wsx/anaconda3/lib/python3.6/site-packages/paddle/fluid/dygraph/math_op_patch.py:253: UserWarning: The dtype of left and right variables are not the same, left dtype is paddle.float32, but right dtype is paddle.bool, the right dtype will convert to paddle.float32
  format(lhs_dtype, rhs_dtype, lhs_dtype))

单GPU（rtx2060）Validating 要很久，算了，不等了，回头服务器测。


深度学习应用篇-计算机视觉-图像分类[3]：ResNeXt、Res2Net、Swin Transformer、Vision Transformer等模型结构、实现、模型特点详细介绍
深度学习应用篇-计算机视觉-图像分类[3]：ResNeXt、Res2Net、Swin Transformer、Vision Transformer等模型结构、实现、模型特点详细介绍
汀丶人工智能 10263
 
推荐文章
豪爽的西装  ·  南通市司法局关于全市律师和律师事务所2019年度检查考核结果的公示 - 公告公示
2 月前
俊逸的卡布奇诺  ·  2021年全市道路交通管理工作总结-规划计划-衡阳市公安局交警支队
3 月前
酒量大的烈酒  ·  【古剑三】古剑奇谭三岑缨支线「久远之阵」_哔哩哔哩_bilibili
7 月前
失恋的面包  ·  2023辽博壁纸 | 送上三月份的壁纸，和大家共赴好春光！_兔子_手机_电脑
1 年前
魁梧的水龙头  ·  东风EV新能源纳米BOX上市 售6.57万元-7.17万元-满电-新能源汽车
1 年前
今天看啥   ·   Py中国   ·   codingpro   ·   藏经阁   ·   小百科   ·   link之家   ·   卧龙AI搜索
删除内容请联系邮箱 2879853325@qq.com
Code - 代码工具平台
© 2024 ~ 沪ICP备11025650号