Troubleshooting

crYOLO freezes

Note

Since crYOLO 1.7.4 this problem is solved. Multithreading replaced multiprocessing.

On some machines crYOLO freezes during or at the end of training. The problem comes together with multiprocessing and is deeply in one of the libraries we use. You can solve it by using multithreading instead of multiprocessing. There for you can either use the option --use_multithreading or make it a permanent change by changing the environment variables in your crYOLO environment:

>>> conda activate cryolo
>>> conda env config vars set CRYOLO_MP_START="fork"
>>> conda env config vars set CRYOLO_USE_MULTITHREADING="True"

You need to reactivate your environment to make the changes working by

>>> conda activate cryolo

Now you use multithreading instead of multiprocessing.

crYOLO has memory problems

crYOLO can crash during training because of memory problems. In those cases you can try the following:

  • Reduce the batch_size. I recommend to reduce it by 1 stepwise. I would not choose a value below 3. You find the batch_size in your configuration file or in the Training options tab of the config Action
  • Reduce the input_size. Instead of 1024 you can choose any multiple of 32. Therefore 31*32=992 would next smaller input size. Don’t go too low (< 768) as you might become problem with very small particles. You find the input_size in your configuration file or in the Model options tab of the config Action.

I need more help

Find help at our mailing list!