CodeProject.AI Discussions

12-Apr-24 9:54

I recently picked up a Rockpi 5b and wanted to experiment with Object Detection (YOLOv5 RKNN). I've tried on two different versions of Ubuntu server and can not get it to run. I went down a rabbit hole and updated the module to py 3.10 from 3.9 to get Python dependencies to install successfully but still can not get a successful self-test or image analysis. I gave up on that, removed, reformatted and started over and the current output is below; python 3.9 missing Pillow.

15:28:57:objectdetection_fd_rknn_adapter.py: Traceback (most recent call last):
15:28:57:objectdetection_fd_rknn_adapter.py:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/objectdetection_fd_rknn_adapter.py", line 9, in 
15:28:57:objectdetection_fd_rknn_adapter.py:     from request_data import RequestData
15:28:57:objectdetection_fd_rknn_adapter.py:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/../../SDK/Python/request_data.py", line 8, in 
15:28:57:objectdetection_fd_rknn_adapter.py:     from PIL import Image
15:28:57:objectdetection_fd_rknn_adapter.py: ModuleNotFoundError: No module named 'PIL'
15:28:57:Module ObjectDetectionYoloRKNN has shutdown

I'm running it natively (no docker) as I would ideally like to use custom models. Object Detection (YOLOv5 .NET) works just fine although speeds are in the ~500ms range.

modified 16-Apr-24 12:11pm.

Mike Lud12-Apr-24 10:07

Mike Lud

12-Apr-24 10:07

It looks like the module did not get fully install. Try uninstall then reinstall using Do not use download cache

kahancock12-Apr-24 14:16

12-Apr-24 14:16

Thanks, I uninstalled, rebooted the system and then tried a fresh install. Sill no luck, logs are below. Any ideas?

<pre>20:06:58:System:           Orange Pi
20:06:58:Operating System: Linux (Ubuntu 22.04)
20:06:58:CPUs:             1 CPU. (Arm64)
20:06:58:System RAM:       16 GiB
20:06:58:Platform:         OrangePi
20:06:58:BuildConfig:      Release
20:06:58:Execution Env:    Native (SSH)
20:06:58:Runtime Env:      Production
20:06:58:Runtimes installed:
20:06:58:  .NET runtime:     7.0.17
20:06:58:  .NET SDK:         7.0.117
20:06:58:  Default Python:   3.10.12
20:06:58:  Go:               Not found
20:06:58:  NodeJS:           Not found
20:06:58:  Rust:             Not found
20:06:58:App DataDir:      /etc/codeproject/ai
20:06:58:Video adapter info:
20:06:58:STARTING CODEPROJECT.AI SERVER
20:06:58:RUNTIMES_PATH             = /usr/bin/codeproject.ai-server-2.6.2/runtimes
20:06:58:PREINSTALLED_MODULES_PATH = /usr/bin/codeproject.ai-server-2.6.2/preinstalled-modules
20:06:58:DEMO_MODULES_PATH         = /usr/bin/codeproject.ai-server-2.6.2/demos/modules
20:06:58:MODULES_PATH              = /usr/bin/codeproject.ai-server-2.6.2/modules
20:06:58:PYTHON_PATH               = /bin/linux/%PYTHON_NAME%/venv/bin/python3
20:06:58:Data Dir                  = /etc/codeproject/ai
20:06:58:Server version:   2.6.2
20:07:03:Server: This is the latest version
20:07:34:Preparing to install module 'ObjectDetectionYoloRKNN'
20:07:34:Downloading module 'ObjectDetectionYoloRKNN'
20:07:34:Installing module 'ObjectDetectionYoloRKNN'
20:07:34:ObjectDetectionYoloRKNN: Setting verbosity to quiet
20:07:34:ObjectDetectionYoloRKNN: No schemas installed
20:07:34:ObjectDetectionYoloRKNN: (No schemas means: we can't detect if you're in light or dark mode)
20:07:34:ObjectDetectionYoloRKNN:              Installing CodeProject.AI Analysis Module                
20:07:34:ObjectDetectionYoloRKNN: ======================================================================
20:07:34:ObjectDetectionYoloRKNN:                    CodeProject.AI Installer                           
20:07:34:ObjectDetectionYoloRKNN: ======================================================================
20:07:34:ObjectDetectionYoloRKNN: 224.00 GiB of 231.07 GiB available on Orange Pi
20:07:34:ObjectDetectionYoloRKNN: Installing xz-utils...
20:08:04:Response timeout. Try increasing the timeout value
20:09:14:ObjectDetectionYoloRKNN: WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
20:09:14:ObjectDetectionYoloRKNN: WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
20:09:16:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
20:09:16:ObjectDetectionYoloRKNN: General CodeProject.AI setup                                          
20:09:16:ObjectDetectionYoloRKNN: Setting permissions on downloads folder...done
20:09:16:ObjectDetectionYoloRKNN: Setting permissions on modules download folder...done
20:09:16:ObjectDetectionYoloRKNN: Setting permissions on models download folder...done
20:09:16:ObjectDetectionYoloRKNN: Setting permissions on runtimes folder...done
20:09:16:ObjectDetectionYoloRKNN: Setting permissions on persisted data folder...done
20:09:16:ObjectDetectionYoloRKNN: GPU support                                                           
20:09:16:ObjectDetectionYoloRKNN: CUDA (NVIDIA) Present: No
20:09:16:ObjectDetectionYoloRKNN: ROCm (AMD) Present:    No
20:09:16:ObjectDetectionYoloRKNN: MPS (Apple) Present:   No
20:09:17:ObjectDetectionYoloRKNN: Reading module settings.......done
20:09:17:ObjectDetectionYoloRKNN: Processing module ObjectDetectionYoloRKNN 1.6.1                       
20:09:17:ObjectDetectionYoloRKNN: Installing Python 3.9
20:09:17:ObjectDetectionYoloRKNN: Python 3.9 is already installed
20:09:22:ObjectDetectionYoloRKNN: Ensuring PIP in base python install...  done
20:09:23:ObjectDetectionYoloRKNN: W: https://mirrors.aliyun.com/docker-ce/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
20:09:31:ObjectDetectionYoloRKNN: Upgrading PIP in base python install... done
20:09:31:ObjectDetectionYoloRKNN: Installing Virtual Environment tools for Linux...
20:09:39:ObjectDetectionYoloRKNN: Searching for python3-pip python3-setuptools python3.9...installing...   done
20:09:39:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
20:09:44:ObjectDetectionYoloRKNN: Creating Virtual Environment (Local)... done
20:09:44:ObjectDetectionYoloRKNN: Checking for Python 3.9...(Found Python 3.9.18) All good
20:09:53:ObjectDetectionYoloRKNN: Upgrading PIP in virtual environment... done
20:10:02:ObjectDetectionYoloRKNN: Installing updated setuptools in venv... done
20:10:02:ObjectDetectionYoloRKNN: checkdir:  cannot create extraction directory: assets
20:10:02:ObjectDetectionYoloRKNN:            Permission denied
20:10:02:ObjectDetectionYoloRKNN: Downloading Standard YOLOv5 RKNN models... already exists...Expanding... done.
20:10:02:ObjectDetectionYoloRKNN: checkdir:  cannot create extraction directory: custom-models
20:10:02:ObjectDetectionYoloRKNN:            Permission denied
20:10:03:ObjectDetectionYoloRKNN: Downloading Custom YOLOv5 RKNN models... already exists...Expanding... done.
20:10:03:ObjectDetectionYoloRKNN: Installing Python packages for Object Detection (YOLOv5 RKNN)
20:10:03:ObjectDetectionYoloRKNN: Installing GPU-enabled libraries: If available
20:10:04:ObjectDetectionYoloRKNN: Searching for python3-pip...All good.
20:10:04:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
20:10:07:ObjectDetectionYoloRKNN: Ensuring PIP compatibility... done
20:10:07:ObjectDetectionYoloRKNN: No suitable requirements.txt file found.
20:10:07:ObjectDetectionYoloRKNN: Installing Python packages for the CodeProject.AI Server SDK
20:10:08:ObjectDetectionYoloRKNN: Searching for python3-pip...All good.
20:10:08:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
20:10:11:ObjectDetectionYoloRKNN: Ensuring PIP compatibility... done
20:10:11:ObjectDetectionYoloRKNN: Python packages will be specified by requirements.txt
20:10:21:ObjectDetectionYoloRKNN:   - Installing Pillow, a Python Image Library... (❌ failed check) done
20:10:30:ObjectDetectionYoloRKNN:   - Installing Charset normalizer... (❌ failed check) done
20:10:40:ObjectDetectionYoloRKNN:   - Installing aiohttp, the Async IO HTTP library... (❌ failed check) done
20:10:49:ObjectDetectionYoloRKNN:   - Installing aiofiles, the Async IO Files library... (❌ failed check) done
20:10:59:ObjectDetectionYoloRKNN:   - Installing py-cpuinfo to allow us to query CPU info... (❌ failed check) done
20:11:08:ObjectDetectionYoloRKNN:   - Installing Requests, the HTTP library... (❌ failed check) done
20:11:08:ObjectDetectionYoloRKNN: Scanning modulesettings for downloadable models...No models specified
20:11:08:ObjectDetectionYoloRKNN: Traceback (most recent call last):
20:11:08:ObjectDetectionYoloRKNN:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/objectdetection_fd_rknn_adapter.py", line 9, in 
20:11:08:ObjectDetectionYoloRKNN:     from request_data import RequestData
20:11:08:ObjectDetectionYoloRKNN:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/../../SDK/Python/request_data.py", line 8, in 
20:11:08:ObjectDetectionYoloRKNN:     from PIL import Image
20:11:08:ObjectDetectionYoloRKNN: ModuleNotFoundError: No module named 'PIL'
20:11:08:ObjectDetectionYoloRKNN: Self test: Self-test failed
20:11:08:ObjectDetectionYoloRKNN: Module setup time 00:01:52
20:11:08:ObjectDetectionYoloRKNN:                 Setup complete                                        
20:11:08:ObjectDetectionYoloRKNN: Total setup time 00:03:34
20:11:08:Module ObjectDetectionYoloRKNN installed successfully.
20:11:08:Installer exited with code 0
20:11:08:
20:11:08:Module 'Object Detection (YOLOv5 RKNN)' 1.6.1 (ID: ObjectDetectionYoloRKNN)
20:11:08:Valid:         True
20:11:08:Module Path:   <root>/modules/ObjectDetectionYoloRKNN
20:11:08:AutoStart:     True
20:11:08:Queue:         objectdetection_queue
20:11:08:Runtime:       python3.9
20:11:08:Runtime Loc:   Local
20:11:08:FilePath:      objectdetection_fd_rknn_adapter.py
20:11:08:Start pause:   1 sec
20:11:08:Parallelism:   1
20:11:08:LogVerbosity:
20:11:08:Platforms:     orangepi
20:11:08:GPU Libraries: installed if available
20:11:08:GPU Enabled:   enabled
20:11:08:Accelerator:
20:11:08:Half Precis.:  enable
20:11:08:Environment Variables
20:11:08:CUSTOM_MODELS_DIR = <root>/modules/ObjectDetectionYoloRKNN/custom-models
20:11:08:MODELS_DIR        = <root>/modules/ObjectDetectionYoloRKNN/assets
20:11:08:MODEL_SIZE        = Small
20:11:08:
20:11:08:Started Object Detection (YOLOv5 RKNN) module
20:11:08:objectdetection_fd_rknn_adapter.py: Traceback (most recent call last):
20:11:08:objectdetection_fd_rknn_adapter.py:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/objectdetection_fd_rknn_adapter.py", line 9, in 
20:11:08:objectdetection_fd_rknn_adapter.py:     from request_data import RequestData
20:11:08:objectdetection_fd_rknn_adapter.py:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/../../SDK/Python/request_data.py", line 8, in 
20:11:08:objectdetection_fd_rknn_adapter.py:     from PIL import Image
20:11:08:objectdetection_fd_rknn_adapter.py: ModuleNotFoundError: No module named 'PIL'
20:11:08:objectdetection_fd_rknn_adapter.py: has exited
20:11:08:Module ObjectDetectionYoloRKNN has shutdown
20:11:09:Module ObjectDetectionYoloRKNN started successfully.

Chris Maunder15-Apr-24 6:21

Chris Maunder

15-Apr-24 6:21

It looks like you're installing the Ubuntu installer (all good) but you are missing some permissions.

When you installed the .deb CodeProject.AI Server package did you install under sudo or your local account? When you start up the server, are you starting up under sudo or local?

cheers
Chris Maunder

kahancock15-Apr-24 11:39

15-Apr-24 11:39

I'm 99% sure I ran everything as sudo but to be sure I uninstalled everything to start over (a process I know all too well at this point Big Grin | :-D

). To uninstall I ran:

Terminal

sudo dpkg -r codeproject.ai-server

That left some lingering files so I cleaned them up:

Terminal

sudo rm -rf /usr/bin/codeproject.ai-server-2.6.2/

Then did a full system reboot just for good measure and started installing:

Terminal

sudo dpkg -i codeproject.ai-server_2.6.2_arm64.deb

Terminal

pushd "/usr/bin/codeproject.ai-server-2.6.2/" && bash setup.sh && popd

Terminal

sudo bash /usr/bin/codeproject.ai-server-2.6.2/start.sh

I then did as you mentioned and installed it while checking "Do not use download cache". Below is the output which is the same as previously Frown | :(

Python

16:23:59:Preparing to install module 'ObjectDetectionYoloRKNN'
16:23:59:Downloading module 'ObjectDetectionYoloRKNN'
16:23:59:Installing module 'ObjectDetectionYoloRKNN'
16:23:59:ObjectDetectionYoloRKNN: Setting verbosity to quiet
16:23:59:ObjectDetectionYoloRKNN: No schemas installed
16:23:59:ObjectDetectionYoloRKNN: (No schemas means: we can't detect if you're in light or dark mode)
16:23:59:ObjectDetectionYoloRKNN:              Installing CodeProject.AI Analysis Module                
16:23:59:ObjectDetectionYoloRKNN: ======================================================================
16:23:59:ObjectDetectionYoloRKNN:                    CodeProject.AI Installer                           
16:23:59:ObjectDetectionYoloRKNN: ======================================================================
16:23:59:ObjectDetectionYoloRKNN: 224.00 GiB of 231.07 GiB available on Orange Pi
16:23:59:ObjectDetectionYoloRKNN: Installing xz-utils...
16:23:59:ObjectDetectionYoloRKNN: WARNING: WARNING: aptapt  does not have a stable CLI interface. does not have a stable CLI interface. Use with caution in scripts.Use with caution in scripts.
16:24:01:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
16:24:01:ObjectDetectionYoloRKNN: General CodeProject.AI setup                                          
16:24:01:ObjectDetectionYoloRKNN: Setting permissions on downloads folder...done
16:24:01:ObjectDetectionYoloRKNN: Setting permissions on modules download folder...done
16:24:01:ObjectDetectionYoloRKNN: Setting permissions on models download folder...done
16:24:01:ObjectDetectionYoloRKNN: Setting permissions on runtimes folder...done
16:24:01:ObjectDetectionYoloRKNN: Setting permissions on persisted data folder...done
16:24:01:ObjectDetectionYoloRKNN: GPU support                                                           
16:24:01:ObjectDetectionYoloRKNN: CUDA (NVIDIA) Present: No
16:24:01:ObjectDetectionYoloRKNN: ROCm (AMD) Present:    No
16:24:01:ObjectDetectionYoloRKNN: MPS (Apple) Present:   No
16:24:02:ObjectDetectionYoloRKNN: Reading module settings.......done
16:24:02:ObjectDetectionYoloRKNN: Processing module ObjectDetectionYoloRKNN 1.6.1                       
16:24:02:ObjectDetectionYoloRKNN: Installing Python 3.9
16:24:02:ObjectDetectionYoloRKNN: Python 3.9 is already installed
16:24:05:ObjectDetectionYoloRKNN: W: https://mirrors.aliyun.com/docker-ce/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
16:24:07:ObjectDetectionYoloRKNN: Ensuring PIP in base python install...  done
16:24:15:ObjectDetectionYoloRKNN: Upgrading PIP in base python install... done
16:24:15:ObjectDetectionYoloRKNN: Installing Virtual Environment tools for Linux...
16:24:24:ObjectDetectionYoloRKNN: Searching for python3-pip python3-setuptools python3.9...installing...   done
16:24:24:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
16:24:27:Response timeout. Try increasing the timeout value
16:24:29:ObjectDetectionYoloRKNN: Creating Virtual Environment (Local)... done
16:24:29:ObjectDetectionYoloRKNN: Checking for Python 3.9...(Found Python 3.9.18) All good
16:24:38:ObjectDetectionYoloRKNN: Upgrading PIP in virtual environment... done
16:24:46:ObjectDetectionYoloRKNN: Installing updated setuptools in venv... done
16:24:50:ObjectDetectionYoloRKNN: Downloading Standard YOLOv5 RKNN models...Expanding... done.
16:24:50:ObjectDetectionYoloRKNN: Moving contents of objectdetect-rknn-models.zip to assets...done.
16:24:53:ObjectDetectionYoloRKNN: Downloading Custom YOLOv5 RKNN models...Expanding... done.
16:24:53:ObjectDetectionYoloRKNN: Moving contents of objectdetect-rknn-custom-models.zip to custom-models...done.
16:24:53:ObjectDetectionYoloRKNN: Installing Python packages for Object Detection (YOLOv5 RKNN)
16:24:53:ObjectDetectionYoloRKNN: Installing GPU-enabled libraries: If available
16:24:54:ObjectDetectionYoloRKNN: Searching for python3-pip...All good.
16:24:54:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
16:24:57:ObjectDetectionYoloRKNN: Ensuring PIP compatibility... done
16:24:57:ObjectDetectionYoloRKNN: No suitable requirements.txt file found.
16:24:57:ObjectDetectionYoloRKNN: Installing Python packages for the CodeProject.AI Server SDK
16:24:58:ObjectDetectionYoloRKNN: Searching for python3-pip...All good.
16:24:58:ObjectDetectionYoloRKNN: stty: 'standard input': Inappropriate ioctl for device
16:25:01:ObjectDetectionYoloRKNN: Ensuring PIP compatibility... done
16:25:01:ObjectDetectionYoloRKNN: Python packages will be specified by requirements.txt
16:25:10:ObjectDetectionYoloRKNN:   - Installing Pillow, a Python Image Library... (❌ failed check) done
16:25:20:ObjectDetectionYoloRKNN:   - Installing Charset normalizer... (❌ failed check) done
16:25:30:ObjectDetectionYoloRKNN:   - Installing aiohttp, the Async IO HTTP library... (❌ failed check) done
16:25:39:ObjectDetectionYoloRKNN:   - Installing aiofiles, the Async IO Files library... (❌ failed check) done
16:25:49:ObjectDetectionYoloRKNN:   - Installing py-cpuinfo to allow us to query CPU info... (❌ failed check) done
16:25:59:ObjectDetectionYoloRKNN:   - Installing Requests, the HTTP library... (❌ failed check) done
16:25:59:ObjectDetectionYoloRKNN: Scanning modulesettings for downloadable models...No models specified
16:25:59:ObjectDetectionYoloRKNN: Traceback (most recent call last):
16:25:59:ObjectDetectionYoloRKNN:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/objectdetection_fd_rknn_adapter.py", line 9, in 
16:25:59:ObjectDetectionYoloRKNN:     from request_data import RequestData
16:25:59:ObjectDetectionYoloRKNN:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/../../SDK/Python/request_data.py", line 8, in 
16:25:59:ObjectDetectionYoloRKNN:     from PIL import Image
16:25:59:ObjectDetectionYoloRKNN: ModuleNotFoundError: No module named 'PIL'
16:25:59:ObjectDetectionYoloRKNN: Self test: Self-test failed
16:25:59:ObjectDetectionYoloRKNN: Module setup time 00:01:58
16:25:59:ObjectDetectionYoloRKNN:                 Setup complete                                        
16:25:59:ObjectDetectionYoloRKNN: Total setup time 00:02:00
16:25:59:Module ObjectDetectionYoloRKNN installed successfully.
16:25:59:Installer exited with code 0
16:25:59:
16:25:59:Module 'Object Detection (YOLOv5 RKNN)' 1.6.1 (ID: ObjectDetectionYoloRKNN)
16:25:59:Valid:         True
16:25:59:Module Path:   <root>/modules/ObjectDetectionYoloRKNN
16:25:59:AutoStart:     True
16:25:59:Queue:         objectdetection_queue
16:25:59:Runtime:       python3.9
16:25:59:Runtime Loc:   Local
16:25:59:FilePath:      objectdetection_fd_rknn_adapter.py
16:25:59:Start pause:   1 sec
16:25:59:Parallelism:   1
16:25:59:LogVerbosity:
16:25:59:Platforms:     orangepi
16:25:59:GPU Libraries: installed if available
16:25:59:GPU Enabled:   enabled
16:25:59:Accelerator:
16:25:59:Half Precis.:  enable
16:25:59:Environment Variables
16:25:59:CUSTOM_MODELS_DIR = <root>/modules/ObjectDetectionYoloRKNN/custom-models
16:25:59:MODELS_DIR        = <root>/modules/ObjectDetectionYoloRKNN/assets
16:25:59:MODEL_SIZE        = Small
16:25:59:
16:25:59:Started Object Detection (YOLOv5 RKNN) module
16:25:59:objectdetection_fd_rknn_adapter.py: Traceback (most recent call last):
16:25:59:objectdetection_fd_rknn_adapter.py:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/objectdetection_fd_rknn_adapter.py", line 9, in 
16:25:59:objectdetection_fd_rknn_adapter.py:     from request_data import RequestData
16:25:59:objectdetection_fd_rknn_adapter.py:   File "/usr/bin/codeproject.ai-server-2.6.2/modules/ObjectDetectionYoloRKNN/../../SDK/Python/request_data.py", line 8, in 
16:25:59:objectdetection_fd_rknn_adapter.py:     from PIL import Image
16:25:59:objectdetection_fd_rknn_adapter.py: ModuleNotFoundError: No module named 'PIL'
16:25:59:objectdetection_fd_rknn_adapter.py: has exited
16:25:59:Module ObjectDetectionYoloRKNN has shutdown

Chris Maunder16-Apr-24 10:47

Chris Maunder

16-Apr-24 10:47

The issue is with the installer. I'll try and have an updated version out tomorrow

Updated: 2.6.4 is out which should help

cheers
Chris Maunder

modified 16-Apr-24 21:27pm.

kahancock17-Apr-24 6:52

17-Apr-24 6:52

Removed the previous install and tried 2.6.4 twice. Both yielded an inability to download any new modules. Anytime I click on "install" for a new module I receive:

code

Error in Install ObjectDetectionYoloRKNN: 404

Matthew Dennis17-Apr-24 8:43

Matthew Dennis

17-Apr-24 8:43

There is a new bug that prevents installing modules in 2.6.4.
I'm working on it and should have a fix soon.

"Mistakes are prevented by Experience. Experience is gained by making mistakes."

kahancock19-Apr-24 6:21

License plate reader does not install after upgrading to 2.6.2 -- Investigating

19-Apr-24 6:21

Thanks, Matthew, any idea when the fix will be out? Happy to test this weekend if it helps?

divelandy11-Apr-24 20:20

divelandy

11-Apr-24 20:20

I just upgraded to 2.6.2 to get the performance improvements (my detect times are about 2/3 faster)
I cannot get the License Plate reader to install/work correctly. This worked well in the previous release of 2.5.6

Install information

2024-04-12 14:01:32: Preparing to install module 'ALPR'
2024-04-12 14:01:32: Downloading module 'ALPR'
2024-04-12 14:01:33: Installing module 'ALPR'
2024-04-12 14:01:33: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2024-04-12 14:01:33: ALPR: [0;33m[49m             Installing CodeProject.AI Analysis Module                [0m
2024-04-12 14:01:33: ALPR: [0;32m[49m======================================================================[0m
2024-04-12 14:01:34: ALPR: [0;32m[49m                   CodeProject.AI Installer                           [0m
2024-04-12 14:01:34: ALPR: [0;32m[49m======================================================================[0m
2024-04-12 14:01:34: ALPR: [0;37m[49m756.9Gb of 952Gb available on [0m
2024-04-12 14:01:34: ALPR: [0;97m[104mGeneral CodeProject.AI setup                                          [0m
2024-04-12 14:01:34: ALPR: [0;39m[49mCreating Directories...[0m[0;92m[49mdone[0m
2024-04-12 14:01:34: ALPR: [0;97m[42mGPU support                                                           [0m
2024-04-12 14:01:34: ALPR: [0;39m[49mCUDA Present...[0m[0;32m[49mYes (CUDA 12.3, cuDNN 8.5)[0m
2024-04-12 14:01:34: ALPR: [0;39m[49mROCm Present...[0m[0;33m[49mNo[0m
2024-04-12 14:01:36: ALPR: [0;37m[49mReading ALPR settings[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;32m[49mdone[0m
2024-04-12 14:01:36: ALPR: [0;97m[104mInstalling module License Plate Reader 3.1.0                          [0m
2024-04-12 14:01:36: ALPR: [0;39m[49mInstalling Python 3.9[0m
2024-04-12 14:01:36: ALPR: [0;32m[49mPython 3.9 is already installed[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mCreating Virtual Environment (Local)...[0m[0;32m[49mdone[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mConfirming we have Python 3.9 in our virtual environment...[0m[0;32m[49mpresent[0m
2024-04-12 14:01:42: ALPR: [0;30m[49mDownloading ALPR models...[0m[0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;32m[49mdone.[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mCopying contents of ocr-en-pp_ocrv4-paddle.zip to paddleocr...[0m[0;32m[49mdone[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mInstalling Python packages for License Plate Reader[0m
2024-04-12 14:01:42: ALPR: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2024-04-12 14:01:43: ALPR: [0;39m[49mEnsuring Python package manager (pip) is installed...[0m[0;32m[49mdone[0m
2024-04-12 14:01:50: ALPR: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0m[0;32m[49mdone[0m
2024-04-12 14:01:50: ALPR: [0;95m[49mPython packages specified by requirements.windows.cuda12.txt[0m

**** ERROR DURING INSTALL [INSERTED LINE] ****
2024-04-12 14:03:31: ALPR: [0;39m[49m  - Installing PaddlePaddle, Parallel Distributed Deep Learning...[0m[0;91m[49m(âŒ failed check) [0m[0;32m[49mdone[0m
**** END ERROR DURING INSTALL [INSERTED LINE] ****

2024-04-12 14:04:48: ALPR: [0;39m[49m  - Installing PaddleOCR, the OCR toolkit based on PaddlePaddle...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:04:50: ALPR: [0;39m[49m  - Installing imutils, the image utilities library...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:04:51: ALPR: [0;39m[49m  - Installing Pillow, a Python Image Library...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:04:52: ALPR: [0;39m[49m  - Installing OpenCV, the Computer Vision library for Python...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:05: ALPR: [0;39m[49m  - Installing NumPy, a package for scientific computing...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:05: ALPR: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2024-04-12 14:05:06: ALPR: [0;39m[49mEnsuring Python package manager (pip) is installed...[0m[0;32m[49mdone[0m
2024-04-12 14:05:08: ALPR: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0m[0;32m[49mdone[0m
2024-04-12 14:05:08: ALPR: [0;95m[49mPython packages specified by requirements.txt[0m
2024-04-12 14:05:09: ALPR: [0;39m[49m  - Installing Pillow, a Python Image Library...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:10: ALPR: [0;39m[49m  - Installing Charset normalizer...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:15: ALPR: [0;39m[49m  - Installing aiohttp, the Async IO HTTP library...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:05:17: ALPR: [0;39m[49m  - Installing aiofiles, the Async IO Files library...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:05:19: ALPR: [0;39m[49m  - Installing py-cpuinfo to allow us to query CPU info...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:05:20: ALPR: [0;39m[49m  - Installing Requests, the HTTP library...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:20: ALPR: [0;39m[49mScanning modulesettings for downloadable models...[0m[0;37m[49mNo models specified[0m
2024-04-12 14:05:20: ALPR: [0;39m[49mExecuting post-install script for License Plate Reader[0m
2024-04-12 14:05:20: ALPR: [0;39m[49mApplying PaddleOCR patch[0m
2024-04-12 14:05:20: ALPR:         1 file(s) copied.
2024-04-12 14:05:21: ALPR: Traceback (most recent call last):
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 16, in <module>
2024-04-12 14:05:21: ALPR:     from ALPR import init_detect_platenumber, detect_platenumber
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in <module>
2024-04-12 14:05:21: ALPR:     from paddleocr import PaddleOCR
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\__init__.py", line 14, in <module>
2024-04-12 14:05:21: ALPR:     from .paddleocr import *
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in <module>
2024-04-12 14:05:21: ALPR:     import paddle
2024-04-12 14:05:21: ALPR: ModuleNotFoundError: No module named 'paddle'
2024-04-12 14:05:21: ALPR: [0;39m[49mSelf test: [0m[0;32m[49mSelf-test passed[0m
2024-04-12 14:05:21: ALPR: [0;95m[49mModule setup time 00:03:46.88[0m
2024-04-12 14:05:21: ALPR: [0;97m[42mSetup complete                                                        [0m
2024-04-12 14:05:21: ALPR: [0;95m[49mTotal setup time 00:03:47.78[0m
2024-04-12 14:05:21: Module ALPR installed successfully.
2024-04-12 14:05:21: Running module using: C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\Scripts\python
2024-04-12 14:05:21: 
2024-04-12 14:05:21: Attempting to start ALPR with C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py"
2024-04-12 14:05:21: Starting C:\Program Files...ws\python39\venv\Scripts\python "C:\Program Files...\modules\ALPR\ALPR_adapter.py"
2024-04-12 14:05:21: 
2024-04-12 14:05:21: ** Module 'License Plate Reader' 3.1.0 (ID: ALPR)
2024-04-12 14:05:21: ** Valid:         True
2024-04-12 14:05:21: ** Module Path:   <root>\modules\ALPR
2024-04-12 14:05:21: ** AutoStart:     True
2024-04-12 14:05:21: ** Queue:         alpr_queue
2024-04-12 14:05:21: ** Runtime:       python3.9
2024-04-12 14:05:21: ** Runtime Loc:   Local
2024-04-12 14:05:21: ** FilePath:      ALPR_adapter.py
2024-04-12 14:05:21: ** Start pause:   3 sec
2024-04-12 14:05:21: ** Parallelism:   0
2024-04-12 14:05:21: ** LogVerbosity:
2024-04-12 14:05:21: ** Platforms:     all
2024-04-12 14:05:21: ** GPU Libraries: installed if available
2024-04-12 14:05:21: ** GPU Enabled:   enabled
2024-04-12 14:05:21: ** Accelerator:
2024-04-12 14:05:21: ** Half Precis.:  enable
2024-04-12 14:05:21: ** Environment Variables
2024-04-12 14:05:21: ** AUTO_PLATE_ROTATE            = True
2024-04-12 14:05:21: ** CROPPED_PLATE_DIR            = <root>\Server\wwwroot
2024-04-12 14:05:21: ** MIN_COMPUTE_CAPABILITY       = 6
2024-04-12 14:05:21: ** MIN_CUDNN_VERSION            = 7
2024-04-12 14:05:21: ** OCR_OPTIMAL_CHARACTER_HEIGHT = 60
2024-04-12 14:05:21: ** OCR_OPTIMAL_CHARACTER_WIDTH  = 30
2024-04-12 14:05:21: ** OCR_OPTIMIZATION             = True
2024-04-12 14:05:21: ** PLATE_CONFIDENCE             = 0.7
2024-04-12 14:05:21: ** PLATE_RESCALE_FACTOR         = 2
2024-04-12 14:05:21: ** PLATE_ROTATE_DEG             = 0
2024-04-12 14:05:21: ** REMOVE_SPACES                = False
2024-04-12 14:05:21: ** ROOT_PATH                    = <root>
2024-04-12 14:05:21: ** SAVE_CROPPED_PLATE           = False
2024-04-12 14:05:21: 
2024-04-12 14:05:21: Started License Plate Reader module
2024-04-12 14:05:21: Installer exited with code 0
2024-04-12 14:05:21: Object Detection (YOLOv5 6.2): Detecting using ipcam-general in Object Detection (YOLOv5 6.2)
2024-04-12 14:05:21: Response rec'd from Object Detection (YOLOv5 6.2) command 'custom' (#reqid a66c00b2-fa26-4e8b-be70-af9cd5cc324b) ['Found vehicle']  took 42ms
2024-04-12 14:05:22: ALPR_adapter.py: Traceback (most recent call last):
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 16, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     from ALPR import init_detect_platenumber, detect_platenumber
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     from paddleocr import PaddleOCR
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\__init__.py", line 14, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     from .paddleocr import *
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     import paddle
2024-04-12 14:05:22: ALPR_adapter.py: ModuleNotFoundError: No module named 'paddle'
2024-04-12 14:05:22: ** Module ALPR has shutdown
2024-04-12 14:05:22: ALPR_adapter.py: has exited
2024-04-12 14:05:24: Module ALPR started successfully.

My system information

Server version:   2.6.2
System:           Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22631)
CPUs:             13th Gen Intel(R) Core(TM) i7-13700K (Intel)
                  1 CPU x 16 cores. 24 logical processors (x64)
GPU (Primary):    NVIDIA GeForce RTX 3060 (8 GiB) (NVIDIA) 
                  Driver: 545.84, CUDA: 12.3 (up to: 12.3), Compute: 8.6, cuDNN: 8.5
System RAM:       32 GiB
Platform:         Windows
BuildConfig:      Release
Execution Env:    Native
Runtime Env:      Production
Runtimes installed:
  .NET runtime:     7.0.18
  .NET SDK:         Not found
  Default Python:   Not found
  Go:               Not found
  NodeJS:           Not found
  Rust:             Not found
Video adapter info:
  NVIDIA GeForce RTX 3060:
    Driver Version     31.0.15.4584
    Video Processor    NVIDIA GeForce RTX 3060
System GPU info:
  GPU 3D Usage       0%
  GPU RAM Usage      2.7 GiB
Global Environment variables:
  CPAI_APPROOTPATH = <root>
  CPAI_PORT        = 32168

Logs when i try to analyst an image

13:56:52:Started License Plate Reader module
13:56:52:ALPR_adapter.py: Traceback (most recent call last):
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 16, in 
13:56:52:ALPR_adapter.py:     from ALPR import init_detect_platenumber, detect_platenumber
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in 
13:56:52:ALPR_adapter.py:     from paddleocr import PaddleOCR
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\__init__.py", line 14, in 
13:56:52:ALPR_adapter.py:     from .paddleocr import *
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in 
13:56:52:ALPR_adapter.py:     import paddle
13:56:52:ALPR_adapter.py: ModuleNotFoundError: No module named 'paddle'
13:56:52:Module ALPR has shutdown

modified 16-Apr-24 12:12pm.

Re: License plate reader does not install after upgrading to 2.6.2

Mike Lud12-Apr-24 7:22

Mike Lud

12-Apr-24 7:22

It looks like the module did not get fully install. Try uninstall then reinstall using Do not use download cache

Re: License plate reader does not install after upgrading to 2.6.2

Stephen Armitage14-Apr-24 15:58

Stephen Armitage

14-Apr-24 15:58

Thanks for the response Mike.

I have installed and re-installed many times including the following permutations:
1. Adding and removing the module through the API
2. Adding and removing the module without download cache through the API
3. Uninstalling CodeProjectAI - making sure the C:\Program Files\CodeProject\ folder was deleted and reinstalling from scratch

Any other ideas?

Re: License plate reader does not install after upgrading to 2.6.2

Stephen Armitage14-Apr-24 16:14

Stephen Armitage

14-Apr-24 16:14

requirements.windows.cuda12.txt specifies paddlepaddle-gpu==2.6.0.post120

When i try to manually install this, i get an error that it is not found:

c:\> pip install paddlepaddle-gpu--2.6.0.post120
ERROR: Could not find a version that satisfies the requirement paddlepaddle-gpu--2.6.0.post120 (from versions: none)
ERROR: No matching distribution found for paddlepaddle-gpu--2.6.0.post120

Also the file states Python 3.7 - with 3.7, i can only install paddlepaddle-gpu 2.5.2. With Python 3.9 i get 2.6.1

Re: License plate reader does not install after upgrading to 2.6.2

Sean Ewington15-Apr-24 6:03

Re: License plate reader does not install after upgrading to 2.6.2

15-Apr-24 6:03

Thanks very much for the additional info. I'm assuming you have similar info to OP, but could you please share your System Info tab from your CodeProject.AI Server dashboard? Also could you please share your installation log for the License Plate Reader module?

Thanks,
Sean Ewington
CodeProject

divelandy14-Apr-24 20:12

divelandy

14-Apr-24 20:12

RESOLVED: The issue is that network connections to China were blocked on my network, so it could not download the component. I allowed access and the install worked.

unknown mime-type, anyone got a solution?

todaxtream11-Apr-24 11:27

todaxtream

11-Apr-24 11:27

Warning: unknown mime-type for "http://192.168.1.205:32168" -- using "application/octet-stream"

Re: unknown mime-type, anyone got a solution?

todaxtream11-Apr-24 11:28

todaxtream

11-Apr-24 11:28

Error: no such file "http://192.168.1.205:32168"

this is another error that i get after it

Re: unknown mime-type, anyone got a solution?

Sean Ewington15-Apr-24 6:01

Generating a URL from transcribed videos

15-Apr-24 6:01

Thanks very much for your report. Could you please share your System Info tab from your CodeProject.AI Server dashboard, and what you are trying to do when you get this error?

Thanks,
Sean Ewington
CodeProject

mjdesnoyer11-Apr-24 9:49

mjdesnoyer

11-Apr-24 9:49

I would like to train a text module with transcribed videos (including their URL) and be able to ask the AI server some questions about the content of the video's. Would this be possible with this server? And if so please provide some suggestions.

thanks Murray D.

Re: Generating a URL from transcribed videos

Sean Ewington11-Apr-24 10:23

Llama Chat Bot -- Resolved

11-Apr-24 10:23

Thanks very much for your inquiry. Currently CodeProject.AI Server can only train on images, so not yet.

Thanks,
Sean Ewington
CodeProject

Jebus5911-Apr-24 8:33

Jebus59

11-Apr-24 8:33

First of all, nice work. Makes code writing a bit easier. It's kinda fun too, having a personal assistant. My plugin for Homeseer leverages it's built in speech engine.
Initially, on Win7, Python 3.9 is a no go. Until I figured out the missing dll.
Also, it took a bit to figure out the API, as the API docs have not been updated. Once I figured out what the return endpoint is, the rest was easy.
The only issue I see is the Llama chat module shows CPU and it looks like it is using GPU. UPDATE: It looks like it is not using the GPU.

4/11/2024 11:17:18 AM ~ Prompt Return {"success":true,"message":"Command is running in the background","commandId":"38ec745d-789f-4f73-b78b-b4be1faba3e1","commandStatus":"running","moduleId":"LlamaChat","moduleName":"LlamaChat","code":200,"command":"prompt","requestId":"38ec745d-789f-4f73-b78b-b4be1faba3e1","inferenceDevice":"CPU","analysisRoundTripMs":6,"processedBy":"localhost","timestampUTC":"Thu, 11 Apr 2024 18:17:23 GMT"}

10:23:41:Module 'LlamaChat' 1.4.1 (ID: LlamaChat)
10:23:41:Valid:         True
10:23:41:
10:23:41:Attempting to start LlamaChat with C:\Program Files\CodeProject\AI\modules\LlamaChat\bin\windows\python39\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\LlamaChat\llama_chat_adapter.py"
10:23:41:Module Path:   <root>\modules\LlamaChat
10:23:41:AutoStart:     True
10:23:41:Queue:         llamachat_queue
10:23:41:Runtime:       python3.9
10:23:41:Runtime Loc:   Local
10:23:41:FilePath:      llama_chat_adapter.py
10:23:41:Start pause:   0 sec
10:23:41:Parallelism:   1
10:23:41:LogVerbosity:
10:23:41:Platforms:     all,!raspberrypi,!orangepi,!jetson
10:23:41:GPU Libraries: installed if available
10:23:41:GPU Enabled:   enabled
10:23:41:Accelerator:
10:23:41:Half Precis.:  enable
10:23:41:Environment Variables
10:23:41:CPAI_LOG_VERBOSITY               = Quiet
10:23:41:CPAI_MODULE_LLAMA_MODEL_DIR      = .\models
10:23:41:CPAI_MODULE_LLAMA_MODEL_FILEGLOB = *.Q4_K_M.gguf
10:23:41:CPAI_MODULE_LLAMA_MODEL_FILENAME = mistral-7b-instruct-v0.2.Q4_K_M.gguf
10:23:41:CPAI_MODULE_LLAMA_MODEL_REPO     = @TheBloke\Mistral-7B-Instruct-v0.2-GGUF
10:23:41:
10:23:41:Started LlamaChat module
10:23:47:llama_chat_adapter.py: Running init for LlamaChat
10:23:47:llama_chat_adapter.py: Using model from '.\models\mistral-7b-instruct-v0.2.Q4_K_M.gguf'

modified 19-Apr-24 11:48am.

Sean Ewington11-Apr-24 10:20

11-Apr-24 10:20

Thanks very much for your report. Could you please share your System Info tab from your CodeProject.AI Server dashboard?

Thanks,
Sean Ewington
CodeProject

Matthew Dennis11-Apr-24 11:27

Matthew Dennis

11-Apr-24 11:27

It appears that the module is not reporting the usage of the GPU correctly.
Open the Task Manager, go to the performance tab and select the GPU.
Then when you run the Llama Chat, you should see a spike in the GPU usage.

"Mistakes are prevented by Experience. Experience is gained by making mistakes."

Jebus5911-Apr-24 12:42

Jebus59

11-Apr-24 12:42

I did some digging and everytime I run ..\..\setup --verbose, I see it gets the wheel package everytime. Not sure if some libs are not compatible with older win. I aquired the dll workaround for Win7 and Python 3.9. The TextToImage module works fine with it's 3.9 virtual environment and uses cuda. In GPU Shark core and mem usage spikes when making a Llama chat request. I have three modules loaded and GPU Shark shows I have three python instances running. Request return from Llama chat shows "inferenceDevice":"CPU"