踩坑記錄2

pycharm remote interpreter: cannot find declaration

現象:

調試debug 帶來不少不便.

解決:

1. 在 project interpreter中的路徑修改一下: /bin/python3---> /bin/python.小細節坑爹.

2. 重啓 pycharm,下載遠程環境的代碼,時間視網絡環境和數量量決定.由於是遠程環境,網絡較差,坑爹地大概須要30多分鐘,須要耐心等等:

evalue coco dataset error

Traceback (most recent call last):
  File "/root/dxq/question-split-mask-rcnn/doc/evaluater.py", line 15, in <module>
    from pycocotools.coco import COCO
  File "/root/anaconda3/lib/python3.7/site-packages/pycocotools-2.0-py3.7-linux-x86_64.egg/pycocotools/coco.py", line 55, in <module>
    from . import mask as maskUtils
  File "/root/anaconda3/lib/python3.7/site-packages/pycocotools-2.0-py3.7-linux-x86_64.egg/pycocotools/mask.py", line 3, in <module>
    import pycocotools._mask as _mask
  File "__init__.pxd", line 918, in init pycocotools._mask
ValueError: numpy.ufunc size changed, may indicate binary incompatibility. Expected 216 from C header, got 192 from PyObject

複製代碼

環境設置錯誤了...

pip uninstall numpy
pip install numpy==1.16.2
複製代碼

pycocotools 和numpy的兼容問題. 降級處理. 坑爹玩意,除此以外,還有好多坑,都心塞踩過來了...要不是對 coco格式還算了解,真不是那麼容易.

pycocotools evaluate 數據解讀.

-----------------------------------------------------------------------------------
-----------------------------------------------------------------------------------

DETECTION_MIN_CONFIDENCE = 0.5
-----------------------------------------------------------------------------------
20200522T1052_0601.h5
100%|█████████████████████████████████████| 2346/2346 [3:12:10<00:00,  4.57s/it]

 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.384
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.626
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.420
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.148
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.291
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.386
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.184
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.436
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.452
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.183
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.364
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.449
Prediction time: 3965.8749873638153. Average 1.6904837968302708/image
Total time:  11549.180015802383
-----------------------------------------------------------------------------------

20200522T1052_0656.h5
100%|█████████████████████████████████████| 2346/2346 [3:34:07<00:00,  5.06s/it]

 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.381
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.621
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.415
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.154
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.290
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.382
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.183
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.432
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.448
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.187
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.368
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.443
Prediction time: 4758.105183124542. Average 2.028177827418816/image

-----------------------------------------------------------------------------------
20200211T1100_0789.h5

100%|██████████| 2346/2346 [3:58:21<00:00,  6.23s/it]
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.288
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.494
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.302
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.132
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.215
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.288
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.144
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.351
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.364
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.149
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.284
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.361
Prediction time: 5515.610037565231. Average 2.351069922235819/image
Total time:  14321.094527959824

-----------------------------------------------------------------------------------
-----------------------------------------------------------------------------------

DETECTION_MIN_CONFIDENCE = 0
-----------------------------------------------------------------------------------
20200522T1052_0601.h5
100%|██████████| 2346/2346 [4:04:43<00:00,  5.23s/it]
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.397
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.653
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.430
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.156
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.302
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.399
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.191
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.454
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.471
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.192
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.381
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.468
Prediction time: 5827.201899766922. Average 2.4838882778205122/image
Total time:  14703.1005589962

複製代碼

• evaluate 上一次的模型, 本次訓練的模型.挑選出上線模型.挑選標準:train loss,val loss, AP,AP50,AP75--->視覺檢驗
• confidence= 0.5狀況: 601, 565, 上一次 789
• confidence= 0 狀況: 601, 789. (之後主要用於不一樣網絡架構的比較. 這個標準比較統一)
• 對比不一樣 confidence,相同模型 AP 等狀況
  • confidence = 0 > confidence= 0.5
• 對比相同confidence, 不一樣模型表現, 本次表現是否好於以前的模型.
  • confidence=0.5. 601 > 656 > 上一次訓練的789.
• train loss 比 val loss 更有參考意義.下次訓練保存 train loss 最佳便可.