CodeProject.AI Discussions

CodeProject.AI is our standalone, self-hosted, fast, free and Open Source Artificial Intelligence microserver for any platform, any language.

First Prev Next

Re: CP on RockPi 5B

Chris Maunder16-Apr-24 10:47

Chris Maunder

16-Apr-24 10:47

The issue is with the installer. I'll try and have an updated version out tomorrow

Updated: 2.6.4 is out which should help

cheers
Chris Maunder

modified 2 days ago.

Re: CP on RockPi 5B

kahancock17-Apr-24 6:52

kahancock

17-Apr-24 6:52

Removed the previous install and tried 2.6.4 twice. Both yielded an inability to download any new modules. Anytime I click on "install" for a new module I receive:

code

Error in Install ObjectDetectionYoloRKNN: 404

Re: CP on RockPi 5B

Matthew Dennis17-Apr-24 8:43

Matthew Dennis

17-Apr-24 8:43

There is a new bug that prevents installing modules in 2.6.4.
I'm working on it and should have a fix soon.

"Mistakes are prevented by Experience. Experience is gained by making mistakes."

License plate reader does not install after upgrading to 2.6.2 -- Investigating

divelandy11-Apr-24 20:20

divelandy

11-Apr-24 20:20

I just upgraded to 2.6.2 to get the performance improvements (my detect times are about 2/3 faster)
I cannot get the License Plate reader to install/work correctly. This worked well in the previous release of 2.5.6

Install information

2024-04-12 14:01:32: Preparing to install module 'ALPR'
2024-04-12 14:01:32: Downloading module 'ALPR'
2024-04-12 14:01:33: Installing module 'ALPR'
2024-04-12 14:01:33: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2024-04-12 14:01:33: ALPR: [0;33m[49m             Installing CodeProject.AI Analysis Module                [0m
2024-04-12 14:01:33: ALPR: [0;32m[49m======================================================================[0m
2024-04-12 14:01:34: ALPR: [0;32m[49m                   CodeProject.AI Installer                           [0m
2024-04-12 14:01:34: ALPR: [0;32m[49m======================================================================[0m
2024-04-12 14:01:34: ALPR: [0;37m[49m756.9Gb of 952Gb available on [0m
2024-04-12 14:01:34: ALPR: [0;97m[104mGeneral CodeProject.AI setup                                          [0m
2024-04-12 14:01:34: ALPR: [0;39m[49mCreating Directories...[0m[0;92m[49mdone[0m
2024-04-12 14:01:34: ALPR: [0;97m[42mGPU support                                                           [0m
2024-04-12 14:01:34: ALPR: [0;39m[49mCUDA Present...[0m[0;32m[49mYes (CUDA 12.3, cuDNN 8.5)[0m
2024-04-12 14:01:34: ALPR: [0;39m[49mROCm Present...[0m[0;33m[49mNo[0m
2024-04-12 14:01:36: ALPR: [0;37m[49mReading ALPR settings[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;37m[49m.[0m[0;32m[49mdone[0m
2024-04-12 14:01:36: ALPR: [0;97m[104mInstalling module License Plate Reader 3.1.0                          [0m
2024-04-12 14:01:36: ALPR: [0;39m[49mInstalling Python 3.9[0m
2024-04-12 14:01:36: ALPR: [0;32m[49mPython 3.9 is already installed[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mCreating Virtual Environment (Local)...[0m[0;32m[49mdone[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mConfirming we have Python 3.9 in our virtual environment...[0m[0;32m[49mpresent[0m
2024-04-12 14:01:42: ALPR: [0;30m[49mDownloading ALPR models...[0m[0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;32m[49mdone.[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mCopying contents of ocr-en-pp_ocrv4-paddle.zip to paddleocr...[0m[0;32m[49mdone[0m
2024-04-12 14:01:42: ALPR: [0;39m[49mInstalling Python packages for License Plate Reader[0m
2024-04-12 14:01:42: ALPR: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2024-04-12 14:01:43: ALPR: [0;39m[49mEnsuring Python package manager (pip) is installed...[0m[0;32m[49mdone[0m
2024-04-12 14:01:50: ALPR: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0m[0;32m[49mdone[0m
2024-04-12 14:01:50: ALPR: [0;95m[49mPython packages specified by requirements.windows.cuda12.txt[0m

**** ERROR DURING INSTALL [INSERTED LINE] ****
2024-04-12 14:03:31: ALPR: [0;39m[49m  - Installing PaddlePaddle, Parallel Distributed Deep Learning...[0m[0;91m[49m(âŒ failed check) [0m[0;32m[49mdone[0m
**** END ERROR DURING INSTALL [INSERTED LINE] ****

2024-04-12 14:04:48: ALPR: [0;39m[49m  - Installing PaddleOCR, the OCR toolkit based on PaddlePaddle...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:04:50: ALPR: [0;39m[49m  - Installing imutils, the image utilities library...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:04:51: ALPR: [0;39m[49m  - Installing Pillow, a Python Image Library...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:04:52: ALPR: [0;39m[49m  - Installing OpenCV, the Computer Vision library for Python...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:05: ALPR: [0;39m[49m  - Installing NumPy, a package for scientific computing...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:05: ALPR: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2024-04-12 14:05:06: ALPR: [0;39m[49mEnsuring Python package manager (pip) is installed...[0m[0;32m[49mdone[0m
2024-04-12 14:05:08: ALPR: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0m[0;32m[49mdone[0m
2024-04-12 14:05:08: ALPR: [0;95m[49mPython packages specified by requirements.txt[0m
2024-04-12 14:05:09: ALPR: [0;39m[49m  - Installing Pillow, a Python Image Library...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:10: ALPR: [0;39m[49m  - Installing Charset normalizer...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:15: ALPR: [0;39m[49m  - Installing aiohttp, the Async IO HTTP library...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:05:17: ALPR: [0;39m[49m  - Installing aiofiles, the Async IO Files library...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:05:19: ALPR: [0;39m[49m  - Installing py-cpuinfo to allow us to query CPU info...[0m[0;32m[49m(âœ… checked) [0m[0;32m[49mdone[0m
2024-04-12 14:05:20: ALPR: [0;39m[49m  - Installing Requests, the HTTP library...[0m[0;32m[49mAlready installed[0m
2024-04-12 14:05:20: ALPR: [0;39m[49mScanning modulesettings for downloadable models...[0m[0;37m[49mNo models specified[0m
2024-04-12 14:05:20: ALPR: [0;39m[49mExecuting post-install script for License Plate Reader[0m
2024-04-12 14:05:20: ALPR: [0;39m[49mApplying PaddleOCR patch[0m
2024-04-12 14:05:20: ALPR:         1 file(s) copied.
2024-04-12 14:05:21: ALPR: Traceback (most recent call last):
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 16, in <module>
2024-04-12 14:05:21: ALPR:     from ALPR import init_detect_platenumber, detect_platenumber
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in <module>
2024-04-12 14:05:21: ALPR:     from paddleocr import PaddleOCR
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\__init__.py", line 14, in <module>
2024-04-12 14:05:21: ALPR:     from .paddleocr import *
2024-04-12 14:05:21: ALPR:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in <module>
2024-04-12 14:05:21: ALPR:     import paddle
2024-04-12 14:05:21: ALPR: ModuleNotFoundError: No module named 'paddle'
2024-04-12 14:05:21: ALPR: [0;39m[49mSelf test: [0m[0;32m[49mSelf-test passed[0m
2024-04-12 14:05:21: ALPR: [0;95m[49mModule setup time 00:03:46.88[0m
2024-04-12 14:05:21: ALPR: [0;97m[42mSetup complete                                                        [0m
2024-04-12 14:05:21: ALPR: [0;95m[49mTotal setup time 00:03:47.78[0m
2024-04-12 14:05:21: Module ALPR installed successfully.
2024-04-12 14:05:21: Running module using: C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\Scripts\python
2024-04-12 14:05:21: 
2024-04-12 14:05:21: Attempting to start ALPR with C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py"
2024-04-12 14:05:21: Starting C:\Program Files...ws\python39\venv\Scripts\python "C:\Program Files...\modules\ALPR\ALPR_adapter.py"
2024-04-12 14:05:21: 
2024-04-12 14:05:21: ** Module 'License Plate Reader' 3.1.0 (ID: ALPR)
2024-04-12 14:05:21: ** Valid:         True
2024-04-12 14:05:21: ** Module Path:   <root>\modules\ALPR
2024-04-12 14:05:21: ** AutoStart:     True
2024-04-12 14:05:21: ** Queue:         alpr_queue
2024-04-12 14:05:21: ** Runtime:       python3.9
2024-04-12 14:05:21: ** Runtime Loc:   Local
2024-04-12 14:05:21: ** FilePath:      ALPR_adapter.py
2024-04-12 14:05:21: ** Start pause:   3 sec
2024-04-12 14:05:21: ** Parallelism:   0
2024-04-12 14:05:21: ** LogVerbosity:
2024-04-12 14:05:21: ** Platforms:     all
2024-04-12 14:05:21: ** GPU Libraries: installed if available
2024-04-12 14:05:21: ** GPU Enabled:   enabled
2024-04-12 14:05:21: ** Accelerator:
2024-04-12 14:05:21: ** Half Precis.:  enable
2024-04-12 14:05:21: ** Environment Variables
2024-04-12 14:05:21: ** AUTO_PLATE_ROTATE            = True
2024-04-12 14:05:21: ** CROPPED_PLATE_DIR            = <root>\Server\wwwroot
2024-04-12 14:05:21: ** MIN_COMPUTE_CAPABILITY       = 6
2024-04-12 14:05:21: ** MIN_CUDNN_VERSION            = 7
2024-04-12 14:05:21: ** OCR_OPTIMAL_CHARACTER_HEIGHT = 60
2024-04-12 14:05:21: ** OCR_OPTIMAL_CHARACTER_WIDTH  = 30
2024-04-12 14:05:21: ** OCR_OPTIMIZATION             = True
2024-04-12 14:05:21: ** PLATE_CONFIDENCE             = 0.7
2024-04-12 14:05:21: ** PLATE_RESCALE_FACTOR         = 2
2024-04-12 14:05:21: ** PLATE_ROTATE_DEG             = 0
2024-04-12 14:05:21: ** REMOVE_SPACES                = False
2024-04-12 14:05:21: ** ROOT_PATH                    = <root>
2024-04-12 14:05:21: ** SAVE_CROPPED_PLATE           = False
2024-04-12 14:05:21: 
2024-04-12 14:05:21: Started License Plate Reader module
2024-04-12 14:05:21: Installer exited with code 0
2024-04-12 14:05:21: Object Detection (YOLOv5 6.2): Detecting using ipcam-general in Object Detection (YOLOv5 6.2)
2024-04-12 14:05:21: Response rec'd from Object Detection (YOLOv5 6.2) command 'custom' (#reqid a66c00b2-fa26-4e8b-be70-af9cd5cc324b) ['Found vehicle']  took 42ms
2024-04-12 14:05:22: ALPR_adapter.py: Traceback (most recent call last):
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 16, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     from ALPR import init_detect_platenumber, detect_platenumber
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     from paddleocr import PaddleOCR
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\__init__.py", line 14, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     from .paddleocr import *
2024-04-12 14:05:22: ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in <module>
2024-04-12 14:05:22: ALPR_adapter.py:     import paddle
2024-04-12 14:05:22: ALPR_adapter.py: ModuleNotFoundError: No module named 'paddle'
2024-04-12 14:05:22: ** Module ALPR has shutdown
2024-04-12 14:05:22: ALPR_adapter.py: has exited
2024-04-12 14:05:24: Module ALPR started successfully.

My system information

Server version:   2.6.2
System:           Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22631)
CPUs:             13th Gen Intel(R) Core(TM) i7-13700K (Intel)
                  1 CPU x 16 cores. 24 logical processors (x64)
GPU (Primary):    NVIDIA GeForce RTX 3060 (8 GiB) (NVIDIA) 
                  Driver: 545.84, CUDA: 12.3 (up to: 12.3), Compute: 8.6, cuDNN: 8.5
System RAM:       32 GiB
Platform:         Windows
BuildConfig:      Release
Execution Env:    Native
Runtime Env:      Production
Runtimes installed:
  .NET runtime:     7.0.18
  .NET SDK:         Not found
  Default Python:   Not found
  Go:               Not found
  NodeJS:           Not found
  Rust:             Not found
Video adapter info:
  NVIDIA GeForce RTX 3060:
    Driver Version     31.0.15.4584
    Video Processor    NVIDIA GeForce RTX 3060
System GPU info:
  GPU 3D Usage       0%
  GPU RAM Usage      2.7 GiB
Global Environment variables:
  CPAI_APPROOTPATH = <root>
  CPAI_PORT        = 32168

Logs when i try to analyst an image

13:56:52:Started License Plate Reader module
13:56:52:ALPR_adapter.py: Traceback (most recent call last):
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 16, in 
13:56:52:ALPR_adapter.py:     from ALPR import init_detect_platenumber, detect_platenumber
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in 
13:56:52:ALPR_adapter.py:     from paddleocr import PaddleOCR
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\__init__.py", line 14, in 
13:56:52:ALPR_adapter.py:     from .paddleocr import *
13:56:52:ALPR_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python39\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in 
13:56:52:ALPR_adapter.py:     import paddle
13:56:52:ALPR_adapter.py: ModuleNotFoundError: No module named 'paddle'
13:56:52:Module ALPR has shutdown

modified 2 days ago.

Re: License plate reader does not install after upgrading to 2.6.2

Mike Lud12-Apr-24 7:22

Mike Lud

12-Apr-24 7:22

It looks like the module did not get fully install. Try uninstall then reinstall using Do not use download cache

Re: License plate reader does not install after upgrading to 2.6.2

Stephen Armitage14-Apr-24 15:58

Stephen Armitage

14-Apr-24 15:58

Thanks for the response Mike.

I have installed and re-installed many times including the following permutations:
1. Adding and removing the module through the API
2. Adding and removing the module without download cache through the API
3. Uninstalling CodeProjectAI - making sure the C:\Program Files\CodeProject\ folder was deleted and reinstalling from scratch

Any other ideas?

Re: License plate reader does not install after upgrading to 2.6.2

Stephen Armitage14-Apr-24 16:14

Stephen Armitage

14-Apr-24 16:14

requirements.windows.cuda12.txt specifies paddlepaddle-gpu==2.6.0.post120

When i try to manually install this, i get an error that it is not found:

c:\> pip install paddlepaddle-gpu--2.6.0.post120
ERROR: Could not find a version that satisfies the requirement paddlepaddle-gpu--2.6.0.post120 (from versions: none)
ERROR: No matching distribution found for paddlepaddle-gpu--2.6.0.post120

Also the file states Python 3.7 - with 3.7, i can only install paddlepaddle-gpu 2.5.2. With Python 3.9 i get 2.6.1

Re: License plate reader does not install after upgrading to 2.6.2

Sean Ewington15-Apr-24 6:03

Sean Ewington

15-Apr-24 6:03

Thanks very much for the additional info. I'm assuming you have similar info to OP, but could you please share your System Info tab from your CodeProject.AI Server dashboard? Also could you please share your installation log for the License Plate Reader module?

Thanks,
Sean Ewington
CodeProject

Re: License plate reader does not install after upgrading to 2.6.2

divelandy14-Apr-24 20:12

divelandy

14-Apr-24 20:12

RESOLVED: The issue is that network connections to China were blocked on my network, so it could not download the component. I allowed access and the install worked.

unknown mime-type, anyone got a solution?

todaxtream11-Apr-24 11:27

todaxtream

11-Apr-24 11:27

Warning: unknown mime-type for "http://192.168.1.205:32168" -- using "application/octet-stream"

Re: unknown mime-type, anyone got a solution?

todaxtream11-Apr-24 11:28

todaxtream

11-Apr-24 11:28

Error: no such file "http://192.168.1.205:32168"

this is another error that i get after it

Re: unknown mime-type, anyone got a solution?

Sean Ewington15-Apr-24 6:01

Sean Ewington

15-Apr-24 6:01

Thanks very much for your report. Could you please share your System Info tab from your CodeProject.AI Server dashboard, and what you are trying to do when you get this error?

Thanks,
Sean Ewington
CodeProject

Generating a URL from transcribed videos

mjdesnoyer11-Apr-24 9:49

mjdesnoyer

11-Apr-24 9:49

I would like to train a text module with transcribed videos (including their URL) and be able to ask the AI server some questions about the content of the video's. Would this be possible with this server? And if so please provide some suggestions.

thanks Murray D.

Re: Generating a URL from transcribed videos

Sean Ewington11-Apr-24 10:23

Sean Ewington

11-Apr-24 10:23

Thanks very much for your inquiry. Currently CodeProject.AI Server can only train on images, so not yet.

Thanks,
Sean Ewington
CodeProject

Llama Chat Bot

Jebus5911-Apr-24 8:33

Jebus59

11-Apr-24 8:33

First of all, nice work. Makes code writing a bit easier. It's kinda fun too, having a personal assistant. My plugin for Homeseer leverages it's built in speech engine.
Initially, on Win7, Python 3.9 is a no go. Until I figured out the missing dll.
Also, it took a bit to figure out the API, as the API docs have not been updated. Once I figured out what the return endpoint is, the rest was easy.
The only issue I see is the Llama chat module shows CPU and it looks like it is using GPU. UPDATE: It looks like it is not using the GPU.

4/11/2024 11:17:18 AM ~ Prompt Return {"success":true,"message":"Command is running in the background","commandId":"38ec745d-789f-4f73-b78b-b4be1faba3e1","commandStatus":"running","moduleId":"LlamaChat","moduleName":"LlamaChat","code":200,"command":"prompt","requestId":"38ec745d-789f-4f73-b78b-b4be1faba3e1","inferenceDevice":"CPU","analysisRoundTripMs":6,"processedBy":"localhost","timestampUTC":"Thu, 11 Apr 2024 18:17:23 GMT"}

10:23:41:Module 'LlamaChat' 1.4.1 (ID: LlamaChat)
10:23:41:Valid:         True
10:23:41:
10:23:41:Attempting to start LlamaChat with C:\Program Files\CodeProject\AI\modules\LlamaChat\bin\windows\python39\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\LlamaChat\llama_chat_adapter.py"
10:23:41:Module Path:   <root>\modules\LlamaChat
10:23:41:AutoStart:     True
10:23:41:Queue:         llamachat_queue
10:23:41:Runtime:       python3.9
10:23:41:Runtime Loc:   Local
10:23:41:FilePath:      llama_chat_adapter.py
10:23:41:Start pause:   0 sec
10:23:41:Parallelism:   1
10:23:41:LogVerbosity:
10:23:41:Platforms:     all,!raspberrypi,!orangepi,!jetson
10:23:41:GPU Libraries: installed if available
10:23:41:GPU Enabled:   enabled
10:23:41:Accelerator:
10:23:41:Half Precis.:  enable
10:23:41:Environment Variables
10:23:41:CPAI_LOG_VERBOSITY               = Quiet
10:23:41:CPAI_MODULE_LLAMA_MODEL_DIR      = .\models
10:23:41:CPAI_MODULE_LLAMA_MODEL_FILEGLOB = *.Q4_K_M.gguf
10:23:41:CPAI_MODULE_LLAMA_MODEL_FILENAME = mistral-7b-instruct-v0.2.Q4_K_M.gguf
10:23:41:CPAI_MODULE_LLAMA_MODEL_REPO     = @TheBloke\Mistral-7B-Instruct-v0.2-GGUF
10:23:41:
10:23:41:Started LlamaChat module
10:23:47:llama_chat_adapter.py: Running init for LlamaChat
10:23:47:llama_chat_adapter.py: Using model from '.\models\mistral-7b-instruct-v0.2.Q4_K_M.gguf'

Re: Llama Chat Bot

Sean Ewington11-Apr-24 10:20

Sean Ewington

11-Apr-24 10:20

Thanks very much for your report. Could you please share your System Info tab from your CodeProject.AI Server dashboard?

Thanks,
Sean Ewington
CodeProject

Re: Llama Chat Bot

Matthew Dennis11-Apr-24 11:27

Matthew Dennis

11-Apr-24 11:27

It appears that the module is not reporting the usage of the GPU correctly.
Open the Task Manager, go to the performance tab and select the GPU.
Then when you run the Llama Chat, you should see a spike in the GPU usage.

"Mistakes are prevented by Experience. Experience is gained by making mistakes."

Re: Llama Chat Bot

Jebus5911-Apr-24 12:42

Jebus59

11-Apr-24 12:42

I did some digging and everytime I run ..\..\setup --verbose, I see it gets the wheel package everytime. Not sure if some libs are not compatible with older win. I aquired the dll workaround for Win7 and Python 3.9. The TextToImage module works fine with it's 3.9 virtual environment and uses cuda. In GPU Shark core and mem usage spikes when making a Llama chat request. I have three modules loaded and GPU Shark shows I have three python instances running. Request return from Llama chat shows "inferenceDevice":"CPU"

YOLOv8 Segmentation -- Resolved

Member 1587624110-Apr-24 21:30

Member 15876241

10-Apr-24 21:30

Does anyone have any idea on how to get YOLOv8 to perform segmentation? I'm using AgentDVR with CodeProject AI, and so far, what I see in the CodeProject AI's log is saying "detect". But I think if segmentation were performed, it would say "segment".

Is there any specific requirement to make YOLOv8 to perform segmentation?

I have Tesla P4 and YOLOv8 is running on GPU (CUDA).

modified 3 days ago.

Re: YOLOv8 Segmentation

Sean Ewington11-Apr-24 11:06

Sean Ewington

11-Apr-24 11:06

You can do it in the CodeProject.AI Server Explorer, if you're using the YOLOv8 module and check the box "Perform segmentation"

Thanks,
Sean Ewington
CodeProject

Re: YOLOv8 Segmentation

Member 1587624111-Apr-24 23:05

Member 15876241

11-Apr-24 23:05

Understood that. But my question is, when it works with the AgentDVR, is there a way to make it perform/use "segmentation" automatically instead of standard detection?

Re: YOLOv8 Segmentation

Sean Ewington12-Apr-24 4:38

Sean Ewington

12-Apr-24 4:38

I think this might have to be an AgentDVR support question. I know the creator is very responsive on the AgentDVR subreddit[^].

Because the default API call goes to v1/vision/detection, and you can actually change this in the Object Detection camera settings in AgentDVR (for image segmentation its v1/vision/segmentation), but the default behaviour for AgentDVR is to draw bounding boxes around the objects on display. I don't think it even shows bounding boxes on the screengrabs or videos that get taken. So I think you'd be asking for a feature request to do this.

Thanks,
Sean Ewington
CodeProject

modified 12-Apr-24 11:23am.

Re: YOLOv8 Segmentation

Member 1587624112-Apr-24 19:39

Member 15876241

12-Apr-24 19:39

Hi Sean, thank you for your answer. It helped! Because in AgentDVR, you can adjust the API call for the Object Detection, so I was able to change "v1/vision/detection" to "v1/vision/segmentation". After I changed it, it is now using "segment" command per the CPAI's log!

Thanks a million!

Version 2.6.2 - Logging stops by random

StefanLU10-Apr-24 4:24

StefanLU

10-Apr-24 4:24

Hello together,

since update to 2.6.2 logging stopped now the 2nd time by random. Detection seems to work normal.

Only Yolo V5.6.2 activated in GPU mode, Face Processing installed but stopped, because of too much false negatives, detected myself instead of an real intruder.

Logging with 2.5.6 worked without problems.

EDIT: Only restarting Yolo doesn't help. The entire service must be restarted.

Server version: 2.6.2
System: Windows
Operating System: Windows (Microsoft Windows 10.0.14393)
CPUs: Intel(R) Core(TM) i9-10850K CPU @ 3.60GHz (Intel)
1 CPU x 10 cores. 20 logical processors (x64)
GPU (Primary): NVIDIA T600 (4 GiB) (NVIDIA)
Driver: 527.41, CUDA: 12.0 (up to: 12.0), Compute: 7.5, cuDNN:
System RAM: 64 GiB
Platform: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
Runtimes installed:
.NET runtime: 7.0.16
.NET SDK: Not found
Default Python: Not found
Go: Not found
NodeJS: Not found
Rust: Not found
Video adapter info:
NVIDIA T600:
Driver Version 31.0.15.2741
Video Processor NVIDIA T600
System GPU info:
GPU 3D Usage 19%
GPU RAM Usage 3,1 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168

Re: Version 2.6.2 - Logging stops by random

Sean Ewington10-Apr-24 8:52

Sean Ewington

10-Apr-24 8:52

Thanks very much for the report. Is anything showing in the logs when (or just before) this happens, or does the service suddenly go offline?

Thanks,
Sean Ewington
CodeProject

Last Visit: 31-Dec-99 18:00 Last Update: 18-Apr-24 23:32

Refresh

ᐊ Prev 1 2 345 6 7 8 9 10 11 Next ᐅ

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.