|
You want this guy:
docker pull codeproject/ai-server:cuda12_2
Thanks,
Sean Ewington
CodeProject
|
|
|
|
|
Thanks for that!! Also, here is some extra logs before you recommended the 12_2
01:49:05:Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
01:49:05:Module Path: /app/preinstalled-modules/FaceProcessing
01:49:05:AutoStart: True
01:49:05:Queue: faceprocessing_queue
01:49:05:Platforms: windows,linux,linux-arm64,macos,macos-arm64
01:49:05:GPU Libraries: installed if available
01:49:05:Command: python3.8
01:49:05:Starting python3.8 "/app.../FaceProcessing/intelligencelayer/face.py"
01:49:05:
01:49:05:Attempting to start FaceProcessing with python3.8 "/app/preinstalled-modules/FaceProcessing/intelligencelayer/face.py"
01:49:05:GPU Enabled: enabled
01:49:05:Parallelism: 0
01:49:05:Accelerator:
01:49:05:Half Precis.: enable
01:49:05:Runtime: python3.8
01:49:05:Runtime Loc: Shared
01:49:05:FilePath: intelligencelayer\face.py
01:49:05:Pre installed: True
01:49:05:Start pause: 3 sec
01:49:05:LogVerbosity:
01:49:05:Valid: True
01:49:05:Environment Variables
01:49:05:APPDIR = %CURRENT_MODULE_PATH%\intelligencelayer
01:49:05:DATA_DIR = %DATA_DIR%
01:49:05:MODE = MEDIUM
01:49:05:MODELS_DIR = %CURRENT_MODULE_PATH%\assets
01:49:05:PROFILE = desktop_gpu
01:49:05:USE_CUDA = True
01:49:05:YOLOv5_AUTOINSTALL = false
01:49:05:YOLOv5_VERBOSE = false
01:49:05:CPAI_HALF_PRECISION = force
01:49:05:
01:49:05:Started Face Processing module
01:49:08:face.py: Vision AI services setup: Retrieving environment variables...
01:49:08:Running init for Face Processing
01:49:08:face.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
01:49:08:face.py: USE_MPS not found. Setting to default True
01:49:08:face.py: APPDIR: /app/preinstalled-modules/FaceProcessing/intelligencelayer
01:49:08:face.py: PROFILE: desktop_cpu
01:49:08:face.py: USE_CUDA: False
01:49:08:face.py: DATA_DIR: /etc/codeproject/ai
01:49:08:face.py: MODELS_DIR: /app/preinstalled-modules/FaceProcessing/assets
01:49:08:face.py: MODE: MEDIUM
01:49:08:Face Processing: Face Processing started.
|
|
|
|
|
Getting more of the same after switching the image.
ran docker ps to get list to show I was using the right one
23ceba4e0a5 codeproject/ai-server:cuda12_2 "./CodeProject.AI.Se…" 9 minutes ago Up 3 minutes 5000/tcp, 0.0.0.0:32168->32168/tcp, :::32168->32168/tcp
Also, did you know the that 12_2 still shows as version 2.3.2-Alpha?
modified 15-Dec-23 17:16pm.
|
|
|
|
|
Dear team!
I'm having systematic error during installation on a Windows 10 OS. Cuda 11.8. CodeProject 3.2.4 but also tested with older releases.
Particularity: PROXMOX VM with GPU GTX1070 passthrough. (should not be a problem anyway)
GPU is well recognized and working fine under Windows.
Also last week I've installed the same CodeProject inside an UBUNTU VM/GPU Passthrough and everything was working fine, CodeProject was excellent in recognition using the GPU mode.
But I want to put BLUEIRIS + CodeProject to be on the same system: so on WINDOWS.... (BI exists only on Windows)
I've uninstalled, reinstalled many times, I've tested with CUDA 12.2 then 11.8, same problem.
detect_adapter.py: ImportError: DLL load failed: The specified module could not be found.
Then CodeProject is accepting only the CPU mode and not the GPU one on Windows.
(althought the same configuration with UBUNTU VM is working fine and GPU is working well)
Here is the full log during installation. It's weird.
Could you please help me? How to solve? What to test?
I'm ready to provide every log/or make specific test.
Thank you all!
Bye
15:53:00:System: Windows
15:53:00:Operating System: Windows (Microsoft Windows 10.0.19044)
15:53:00:CPUs: QEMU Virtual CPU version 2.5+
15:53:00: 2 CPUs x 4 cores. 4 logical processors (x64)
15:53:00:GPU: NVIDIA GeForce GTX 1070 (8 GiB) (NVIDIA)
15:53:00: Driver: 536.23 CUDA: 11.8.89 (max supported: 12.2) Compute: 6.1
15:53:00:System RAM: 8 GiB
15:53:00:Target: Windows
15:53:00:BuildConfig: Release
15:53:00:Execution Env: Native
15:53:00:Runtime Env: Production
15:53:00:.NET framework: .NET 7.0.10
15:53:00:App DataDir: C:\ProgramData\CodeProject\AI
15:53:00:Video adapter info:
15:53:00: NVIDIA GeForce GTX 1070:
15:53:00: Driver Version 31.0.15.3623
15:53:00: Video Processor NVIDIA GeForce GTX 1070
15:53:00: Microsoft Basic Display Adapter:
15:53:00: Driver Version 10.0.19041.868
15:53:00: Video Processor SeaBIOS VBE(C) 2011
15:53:00:STARTING CODEPROJECT.AI SERVER
15:53:00:RUNTIMES_PATH = C:\Program Files\CodeProject\AI\runtimes
15:53:00:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
15:53:00:MODULES_PATH = C:\Program Files\CodeProject\AI\modules
15:53:00:PYTHON_PATH = \bin\windows\%PYTHON_DIRECTORY%\venv\Scripts\python
15:53:00:Data Dir = C:\ProgramData\CodeProject\AI
15:53:00:Server version: 2.3.4-Beta
15:53:03:Setting up initial modules. Please be patient...
15:53:03:Installing initial module FaceProcessing.
15:53:03:Preparing to install module 'FaceProcessing'
15:53:03:Downloading module 'FaceProcessing'
15:53:04:Installing module 'FaceProcessing'
15:53:04:FaceProcessing: Installing CodeProject.AI Analysis Module
15:53:04:FaceProcessing: ========================================================================
15:53:04:FaceProcessing: CodeProject.AI Installer
15:53:04:FaceProcessing: ========================================================================
15:53:04:FaceProcessing: General CodeProject.AI setup
15:53:04:FaceProcessing: Creating Directories...Done
15:53:04:FaceProcessing: GPU support
15:53:04:FaceProcessing: CUDA Present...Yes (version 11.8)
15:53:05:FaceProcessing: ROCm Present...False
15:53:05:FaceProcessing: Installing module FaceProcessing 1.8.1
15:53:05:FaceProcessing: Installing Python 3.7
15:53:05:Server: This is the latest version
15:53:11:FaceProcessing: Downloading Python 3.7 interpreter...Expanding...Done.
15:53:25:FaceProcessing: Creating Virtual Environment (Shared)...Done
15:53:25:FaceProcessing: Confirming we have Python 3.7 in our virtual environment...present
15:53:48:FaceProcessing: Downloading YOLO models...Expanding...Done.
15:53:50:FaceProcessing: Copying contents of models.zip to assets...done
15:53:50:FaceProcessing: Cleaning up...done
15:53:50:FaceProcessing: Installing Python packages for FaceProcessing
15:53:50:FaceProcessing: [0;Installing GPU-enabled libraries: If available
15:53:54:FaceProcessing: Ensuring Python package manager (pip) is installed...Done
15:54:07:FaceProcessing: Ensuring Python package manager (pip) is up to date...Done
15:54:07:FaceProcessing: Python packages specified by requirements.windows.cuda.txt
15:54:09:FaceProcessing: - Installing urllib3, the HTTP client for Python...(✔️ checked) Done
15:54:31:FaceProcessing: - Installing Pandas, a data analysis / data manipulation tool...(✔️ checked) Done
15:55:05:FaceProcessing: - Installing CoreMLTools, for working with .mlmodel format models...(✔️ checked) Done
15:55:15:FaceProcessing: - Installing OpenCV, the Open source Computer Vision library...(✔️ checked) Done
15:55:18:FaceProcessing: - Installing Pillow, a Python Image Library...(✔️ checked) Done
15:55:36:FaceProcessing: - Installing SciPy, a library for mathematics, science, and engineering...(✔️ checked) Done
15:55:36:FaceProcessing: - Installing PyYAML, a library for reading configuration files...Already installed
15:57:38:FaceProcessing: - Installing PyTorch, an open source machine learning framework...(✔️ checked) Done
15:59:28:FaceProcessing: - Installing TorchVision, for working with computer vision models...(✔️ checked) Done
16:00:04:FaceProcessing: - Installing Seaborn, a data visualization library based on matplotlib...(✔️ checked) Done
16:00:04:FaceProcessing: Installing Python packages for the CodeProject.AI Server SDK
16:00:05:FaceProcessing: Ensuring Python package manager (pip) is installed...Done
16:00:07:FaceProcessing: Ensuring Python package manager (pip) is up to date...Done
16:00:07:FaceProcessing: Python packages specified by requirements.txt
16:00:08:FaceProcessing: - Installing Pillow, a Python Image Library...Already installed
16:00:09:FaceProcessing: - Installing Charset normalizer...Already installed
16:00:14:FaceProcessing: - Installing aiohttp, the Async IO HTTP library...(✔️ checked) Done
16:00:16:FaceProcessing: - Installing aiofiles, the Async IO Files library...(✔️ checked) Done
16:00:18:FaceProcessing: - Installing py-cpuinfo to allow us to query CPU info...(✔️ checked) Done
16:00:19:FaceProcessing: - Installing Requests, the HTTP library...Already installed
16:00:19:FaceProcessing: Setup complete
16:00:19:Module FaceProcessing installed successfully.
16:00:19:
16:00:19:Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
16:00:19:Module Path: C:\Program Files\CodeProject\AI\modules\FaceProcessing
16:00:19:AutoStart: True
16:00:19:Queue: faceprocessing_queue
16:00:19:Platforms: windows,linux,linux-arm64,macos,macos-arm64
16:00:19:GPU Libraries: installed if available
16:00:19:GPU Enabled: enabled
16:00:19:Parallelism: 0
16:00:19:Accelerator:
16:00:19:Half Precis.: enable
16:00:19:Runtime: python3.7
16:00:19:Runtime Loc: Shared
16:00:19:FilePath: intelligencelayer\face.py
16:00:19:Pre installed: False
16:00:19:Start pause: 3 sec
16:00:19:LogVerbosity:
16:00:19:Valid: True
16:00:19:Environment Variables
16:00:19:APPDIR = %CURRENT_MODULE_PATH%\intelligencelayer
16:00:19:DATA_DIR = %DATA_DIR%
16:00:19:MODE = MEDIUM
16:00:19:MODELS_DIR = %CURRENT_MODULE_PATH%\assets
16:00:19:PROFILE = desktop_gpu
16:00:19:USE_CUDA = True
16:00:19:YOLOv5_AUTOINSTALL = false
16:00:19:YOLOv5_VERBOSE = false
16:00:19:
16:00:19:Started Face Processing module
16:00:19:Installer exited with code 0
16:00:19:Installing initial module ObjectDetectionNet.
16:00:19:Preparing to install module 'ObjectDetectionNet'
16:00:19:Downloading module 'ObjectDetectionNet'
16:00:20:Installing module 'ObjectDetectionNet'
16:00:20:ObjectDetectionNet: Installing CodeProject.AI Analysis Module
16:00:20:ObjectDetectionNet: ========================================================================
16:00:20:ObjectDetectionNet: CodeProject.AI Installer
16:00:20:ObjectDetectionNet: ========================================================================
16:00:20:ObjectDetectionNet: General CodeProject.AI setup
16:00:20:ObjectDetectionNet: Creating Directories...Done
16:00:20:ObjectDetectionNet: GPU support
16:00:20:ObjectDetectionNet: CUDA Present...Yes (version 11.8)
16:00:20:ObjectDetectionNet: ROCm Present...False
16:00:20:ObjectDetectionNet: Installing module ObjectDetectionNet 1.7.1
16:00:22:Module FaceProcessing started successfully.
16:00:24:face.py: GPU in use: NVIDIA GeForce GTX 1070
16:00:24:face.py: Traceback (most recent call last):
16:00:24:face.py: File "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\face.py", line 41, in
16:00:24:face.py: from process import YOLODetector
16:00:24:face.py: File "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\.\process.py", line 2, in
16:00:24:face.py: import cv2
16:00:24:face.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\cv2\__init__.py", line 181, in
16:00:24:face.py: bootstrap()
16:00:24:face.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\cv2\__init__.py", line 153, in bootstrap
16:00:24:face.py: native_module = importlib.import_module("cv2")
16:00:24:face.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\lib\importlib\__init__.py", line 127, in import_module
16:00:24:face.py: return _bootstrap._gcd_import(name[level:], package, level)
16:00:24:face.py: ImportError: DLL load failed: The specified module could not be found.
16:00:24:Module FaceProcessing has shutdown
16:00:24:face.py: has exited
16:00:30:ObjectDetectionNet: Downloading ObjectDetectionNet-DirectML-1.7.1.zip...Expanding...Done.
16:00:31:ObjectDetectionNet: Copying contents of ObjectDetectionNet-DirectML-1.7.1.zip to ...done
16:00:31:ObjectDetectionNet: Cleaning up...done
16:00:41:ObjectDetectionNet: Downloading YOLO ONNX models...Expanding...Done.
16:00:42:ObjectDetectionNet: Copying contents of yolonet-models.zip to assets...done
16:00:42:ObjectDetectionNet: Cleaning up...done
16:00:52:ObjectDetectionNet: Downloading Custom YOLO ONNX models...Expanding...Done.
16:00:52:ObjectDetectionNet: Copying contents of yolonet-custom-models.zip to custom-models...done
16:00:52:ObjectDetectionNet: Cleaning up...done
16:00:52:ObjectDetectionNet: Setup complete
16:00:52:Module ObjectDetectionNet installed successfully.
16:00:52:Module ObjectDetectionNet not configured to AutoStart.
16:00:52:Installer exited with code 0
16:00:52:Installing initial module ObjectDetectionYolo.
16:00:52:Preparing to install module 'ObjectDetectionYolo'
16:00:52:Downloading module 'ObjectDetectionYolo'
16:00:52:Installing module 'ObjectDetectionYolo'
16:00:54:ObjectDetectionYolo: Installing CodeProject.AI Analysis Module
16:00:54:ObjectDetectionYolo: ========================================================================
16:00:54:ObjectDetectionYolo: CodeProject.AI Installer
16:00:54:ObjectDetectionYolo: ========================================================================
16:00:54:ObjectDetectionYolo: General CodeProject.AI setup
16:00:54:ObjectDetectionYolo: Creating Directories...Done
16:00:54:ObjectDetectionYolo: GPU support
16:00:54:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
16:00:54:ObjectDetectionYolo: ROCm Present...False
16:00:54:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1
16:00:54:ObjectDetectionYolo: Installing Python 3.7
16:00:54:ObjectDetectionYolo: Python 3.7 is already installed
16:00:54:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
16:00:55:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
16:01:01:ObjectDetectionYolo: Downloading Standard YOLO models...Expanding...Done.
16:01:01:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
16:01:01:ObjectDetectionYolo: Cleaning up...done
16:01:11:ObjectDetectionYolo: Downloading Custom YOLO models...Expanding...Done.
16:01:11:ObjectDetectionYolo: Copying contents of custom-models-yolo5-pt.zip to custom-models...done
16:01:11:ObjectDetectionYolo: Cleaning up...done
16:01:11:ObjectDetectionYolo: Installing Python packages for ObjectDetectionYolo
16:01:11:ObjectDetectionYolo: [0;Installing GPU-enabled libraries: If available
16:01:13:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
16:01:15:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
16:01:15:ObjectDetectionYolo: Python packages specified by requirements.windows.cuda.txt
16:01:16:ObjectDetectionYolo: - Installing Pandas, a data analysis / data manipulation tool...Already installed
16:01:17:ObjectDetectionYolo: - Installing CoreMLTools, for working with .mlmodel format models...Already installed
16:01:18:ObjectDetectionYolo: - Installing OpenCV, the Open source Computer Vision library...Already installed
16:01:18:ObjectDetectionYolo: - Installing Pillow, a Python Image Library...Already installed
16:01:19:ObjectDetectionYolo: - Installing SciPy, a library for mathematics, science, and engineering...Already installed
16:01:20:ObjectDetectionYolo: - Installing PyYAML, a library for reading configuration files...Already installed
16:01:21:ObjectDetectionYolo: - Installing PyTorch, an open source machine learning framework...Already installed
16:01:22:ObjectDetectionYolo: - Installing TorchVision, for working with computer vision models...Already installed
16:03:40:ObjectDetectionYolo: - Installing Ultralytics YoloV5 package for object detection in images...(✔️ checked) Done
16:03:41:ObjectDetectionYolo: - Installing Seaborn, a data visualization library based on matplotlib...Already installed
16:03:41:ObjectDetectionYolo: Installing Python packages for the CodeProject.AI Server SDK
16:03:42:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
16:03:45:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
16:03:45:ObjectDetectionYolo: Python packages specified by requirements.txt
16:03:46:ObjectDetectionYolo: - Installing Pillow, a Python Image Library...Already installed
16:03:47:ObjectDetectionYolo: - Installing Charset normalizer...Already installed
16:03:48:ObjectDetectionYolo: - Installing aiohttp, the Async IO HTTP library...Already installed
16:03:49:ObjectDetectionYolo: - Installing aiofiles, the Async IO Files library...Already installed
16:03:50:ObjectDetectionYolo: - Installing py-cpuinfo to allow us to query CPU info...Already installed
16:03:50:ObjectDetectionYolo: - Installing Requests, the HTTP library...Already installed
16:03:50:ObjectDetectionYolo: Setup complete
16:03:50:Module ObjectDetectionYolo installed successfully.
16:03:50:
16:03:50:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
16:03:50:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
16:03:50:AutoStart: True
16:03:50:Queue: objectdetection_queue
16:03:50:Platforms: all
16:03:50:GPU Libraries: installed if available
16:03:50:GPU Enabled: enabled
16:03:50:Parallelism: 0
16:03:50:Accelerator:
16:03:50:Half Precis.: enable
16:03:50:Runtime: python3.7
16:03:50:Runtime Loc: Shared
16:03:50:FilePath: detect_adapter.py
16:03:50:Pre installed: False
16:03:50:Start pause: 1 sec
16:03:50:LogVerbosity:
16:03:50:Valid: True
16:03:50:Environment Variables
16:03:50:APPDIR = %CURRENT_MODULE_PATH%
16:03:50:CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
16:03:50:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
16:03:50:MODEL_SIZE = Medium
16:03:50:USE_CUDA = True
16:03:50:YOLOv5_AUTOINSTALL = false
16:03:50:YOLOv5_VERBOSE = false
16:03:50:
16:03:50:Started Object Detection (YOLOv5 6.2) module
16:03:50:Installer exited with code 0
16:03:51:Module ObjectDetectionYolo started successfully.
16:03:52:detect_adapter.py: Traceback (most recent call last):
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py", line 20, in
16:03:52:detect_adapter.py: from detect import do_detection
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect.py", line 8, in
16:03:52:detect_adapter.py: from yolov5.models.common import DetectMultiBackend, AutoShape
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\__init__.py", line 1, in
16:03:52:detect_adapter.py: from yolov5.helpers import YOLOv5
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\helpers.py", line 3, in
16:03:52:detect_adapter.py: from yolov5.models.common import AutoShape, DetectMultiBackend
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\models\common.py", line 18, in
16:03:52:detect_adapter.py: import cv2
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\cv2\__init__.py", line 181, in
16:03:52:detect_adapter.py: bootstrap()
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\cv2\__init__.py", line 153, in bootstrap
16:03:52:detect_adapter.py: native_module = importlib.import_module("cv2")
16:03:52:detect_adapter.py: File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\lib\importlib\__init__.py", line 127, in import_module
16:03:52:detect_adapter.py: return _bootstrap._gcd_import(name[level:], package, level)
16:03:52:detect_adapter.py: ImportError: DLL load failed: The specified module could not be found.
16:03:52:Module ObjectDetectionYolo has shutdown
16:03:52:detect_adapter.py: has exited
modified 9-Nov-23 10:37am.
|
|
|
|
|
Today I've tested also with 1050Ti card on Ubuntu: it's working fine, as with my GTX1070.
Please any tips about how to solve? import CV2 seems to be the problem, how to force a python lib update using venv on CodeProject??
And I've tested with the WINDOWS as problem remains the same with 1050Ti:
detect_adapter.py: ImportError: DLL load failed: The specified module could not be found.
Any help please ???
modified 15-Nov-23 4:26am.
|
|
|
|
|
Chris, Mike & others: any help please?!
this is the first time I have such problem, it seems that python lib or DLL is not correctly loaded but what's the best approach to solve this problem?
Thanks for your help and tips!
|
|
|
|
|
Your setup is a little outside the scope of what we support but there's clearly an OpenCV installation or path issue going on.
Could I suggest you switch from using the ObjectDetectionYOLO module to the ObjectDetectionNet module and see if that helps?
cheers
Chris Maunder
|
|
|
|
|
So it doesnt jump to requirements.windows.cuda.txt...
I see the changes in setup bat from 2.2.4.
:: Report on GPU ability
:: GPU / CPU support ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
call "!sdkScriptsDirPath!\utils.bat" WriteLine "GPU support" "White" "Blue" !lineWidth!
call "!sdkScriptsDirPath!\utils.bat" WriteLine ""
REM Test for CUDA drivers
call "!sdkScriptsDirPath!\utils.bat" Write "CUDA Present..."
set hasCUDA=false
I changed to:
set hasCUDA=true
and the correct requirements were used. I have not perused utils.bat for why it is reporting no cuda.
nvsmi path...
C:\Program Files\NVIDIA Corporation\NVSMI
BTW, the error was "not enough memory"...
|
|
|
|
|
When installing CUDA did you do a full install?
The issue is nvcc is not installed. Open a command prompt and see if you get the below screenshot when executing nvcc --version.
|
|
|
|
|
It's all working.
Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 6.1.7601 Service Pack 1)
CPUs: Intel(R) Core(TM) i7-6850K CPU @ 3.60GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: NVIDIA GeForce RTX 3060 (12 GiB) (NVIDIA)
Driver: 474.11 CUDA: 11.4.48 (max supported: 11.4) Compute:
System RAM: 48 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
NVIDIA GeForce RTX 3060:
Driver Version 30.0.14.7411
Video Processor NVIDIA GeForce RTX 3060
System GPU info:
GPU 3D Usage 3%
GPU RAM Usage 11.8 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
It did not see my cuda install and went to default requirements.txt and tossed "not enough memory" error until I bypassed that check.
A bit of log trace right after loading CP.AI server. Everything functioning great now.
19:50:15:Started Object Detection (YOLOv5 6.2) module
19:50:16:face.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
19:50:16:face.py: Vision AI services setup: Retrieving environment variables...
19:50:16:face.py: USE_MPS not found. Setting to default True
19:50:16:face.py: GPU in use: NVIDIA GeForce RTX 3060
19:50:16:face.py: APPDIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer
19:50:16:face.py: PROFILE: desktop_gpu
19:50:16:face.py: USE_CUDA: True
19:50:16:face.py: DATA_DIR: C:\ProgramData\CodeProject\AI
19:50:16:face.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\assets
19:50:16:face.py: MODE: MEDIUM
19:50:16:Running init for Face Processing
19:50:16:Face Processing: Face Processing started.
19:50:19:detect_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
19:50:19:detect_adapter.py: APPDIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
19:50:19:detect_adapter.py: MODEL_SIZE: medium
19:50:19:detect_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets
19:50:19:Running init for Object Detection (YOLOv5 6.2)
19:50:19:Object Detection (YOLOv5 6.2): Object Detection (YOLOv5 6.2) started.
|
|
|
|
|
Hi!
Is it possible to use Coral for Face Recognition?
|
|
|
|
|
|
I have both modules working, using cuda. The python installs are not downloading. so I had to copy over python37 folder from old save 2.2.4. Wondering if that gives me all the correct packages?
Here is the partial log from the last try on install. The whole log is huge on verbose, I would be happy to send some way...
This jumps out: 2023-11-07 13:12:40: FaceProcessing: Not enough memory.
The exceptions on log access jump out also...
Any guidence?
Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 6.1.7601 Service Pack 1)
CPUs: Intel(R) Core(TM) i7-6850K CPU @ 3.60GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: NVIDIA GeForce RTX 3060 (12 GiB) (NVIDIA)
Driver: 474.11 CUDA: 11.4.48 (max supported: 11.4) Compute:
System RAM: 48 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
NVIDIA GeForce RTX 3060:
Driver Version 30.0.14.7411
Video Processor NVIDIA GeForce RTX 3060
System GPU info:
GPU 3D Usage 3%
GPU RAM Usage 11.8 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
2023-11-07 13:12:21: Preparing to install module 'FaceProcessing'
2023-11-07 13:12:21: Downloading module 'FaceProcessing'
2023-11-07 13:12:21: Preparing to install module 'FaceProcessing'
2023-11-07 13:12:21: Downloading module 'FaceProcessing'
2023-11-07 13:12:22: Installing module 'FaceProcessing'
2023-11-07 13:12:22: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:22: FaceProcessing: [0;33m[49m Installing CodeProject.AI Analysis Module [0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m========================================================================[0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m CodeProject.AI Installer [0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m========================================================================[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49msetupMode = InstallModule[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mexecutionEnvironment = Production[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49minstallerScriptsPath = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49msdkScriptsDirPath = C:\Program Files\CodeProject\AI\SDK\Scripts[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mabsoluteAppRootDir = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mruntimesDirPath = C:\Program Files\CodeProject\AI\runtimes[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mmodulesDirPath = C:\Program Files\CodeProject\AI\modules[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mdownloadDirPath = C:\Program Files\CodeProject\AI\downloads[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mGeneral CodeProject.AI setup [0m
2023-11-07 13:12:22: Installing module 'FaceProcessing'
2023-11-07 13:12:22: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:22 [System.IO.IOException: The process cannot access the file 'C:\Program Files\CodeProject\AI\modules\FaceProcessing\install.log' because it is being used by another process.
at Microsoft.Win32.SafeHandles.SafeFileHandle.CreateFile(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.File.AppendText(String path)
at CodeProject.AI.Server.Modules.ModuleInstaller.InstallModuleAsync(String installPackagePath, String moduleId, LogVerbosity verbosity)
at CodeProject.AI.Server.Modules.ModuleInstaller.DownloadAndInstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at CodeProject.AI.Server.Controllers.ModuleController.InstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at lambda_method95(Closure, Object)
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeactionmethodasync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokenextactionfilterasync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeinnerfilterasync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokefilterpipelineasync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.<invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)]: Connection id "0HMUVQNTJL7FS", Request id "0HMUVQNTJL7FS:000000A1": An unhandled exception was thrown by the application.
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCreating Directories...[0m[0;92m[49mDone[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mGPU support [0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCUDA Present...[0m[0;33m[49mNo[0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mROCm Present...[0m[0;33m[49mFalse[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mVariable Dump [0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mmoduleName = FaceProcessing[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mmoduleVersion = 1.8.1[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mruntime = python3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49minstallGPU = true[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpythonLocation = Shared[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpythonVersion = 3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mvirtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mvenvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpackagesDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mInstalling module FaceProcessing 1.8.1 [0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mInstalling Python 3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mInstalling python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37[0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49mPython 3.7 is already installed[0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCreating Virtual Environment (Shared)...[0m[0;32m[49mVirtual Environment already present[0m
2023-11-07 13:12:23: FaceProcessing: [0;39m[49mConfirming we have Python 3.7 in our virtual environment...[0m
2023-11-07 13:12:23: FaceProcessing: [0;39m[49m-------------------------------------------------------------[0m
2023-11-07 13:12:23: FaceProcessing: [0;91m[49mError: Python not installed[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49mDownloading models.zip to C:\Program Files\CodeProject\AI\downloads\FaceProcessing[0m
2023-11-07 13:12:23: FaceProcessing: [0;30m[49mDownloading YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\FaceProcessing\models.zip'[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\FaceProcessing[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49mExtracting models.zip[0m
2023-11-07 13:12:31: FaceProcessing: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mCopying contents of models.zip to assets...[0m[0;32m[49mdone[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:12:32: FaceProcessing: [0;32m[49mdone[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mInstalling Python packages for FaceProcessing[0m
2023-11-07 13:12:32: FaceProcessing: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2023-11-07 13:12:33: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmptse0292i
2023-11-07 13:12:33: FaceProcessing: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:33: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:33: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:34: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:35: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:36: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\modules\FaceProcessing[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\FaceProcessing[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\modules\FaceProcessing\requirements.txt[0m
2023-11-07 13:12:36: FaceProcessing: Not enough memory.
2023-11-07 13:12:36: FaceProcessing: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2023-11-07 13:12:37: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmp399821cb
2023-11-07 13:12:37: FaceProcessing: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:37: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:37: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:38: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:39: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:40: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt[0m
2023-11-07 13:12:40: FaceProcessing: Not enough memory.
2023-11-07 13:12:40: FaceProcessing: [0;97m[42mSetup complete [0m
2023-11-07 13:12:40: Module FaceProcessing installed successfully.
2023-11-07 13:12:40: Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
2023-11-07 13:12:40:
2023-11-07 13:12:40: Attempting to start FaceProcessing with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\face.py"
2023-11-07 13:12:40: Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...ing\intelligencelayer\face.py"
2023-11-07 13:12:40:
2023-11-07 13:12:40: ** Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
2023-11-07 13:12:40: ** Module Path: C:\Program Files\CodeProject\AI\modules\FaceProcessing
2023-11-07 13:12:40: ** AutoStart: True
2023-11-07 13:12:40: ** Queue: faceprocessing_queue
2023-11-07 13:12:40: ** Platforms: windows,linux,linux-arm64,macos,macos-arm64
2023-11-07 13:12:40: ** GPU Libraries: installed if available
2023-11-07 13:12:40: ** GPU Enabled: enabled
2023-11-07 13:12:40: ** Parallelism: 0
2023-11-07 13:12:40: ** Accelerator:
2023-11-07 13:12:40: ** Half Precis.: enable
2023-11-07 13:12:40: ** Runtime: python3.7
2023-11-07 13:12:40: ** Runtime Loc: Shared
2023-11-07 13:12:40: ** FilePath: intelligencelayer\face.py
2023-11-07 13:12:40: ** Pre installed: False
2023-11-07 13:12:40: ** Start pause: 3 sec
2023-11-07 13:12:40: ** LogVerbosity:
2023-11-07 13:12:40: ** Valid: True
2023-11-07 13:12:40: ** Environment Variables
2023-11-07 13:12:40: ** APPDIR = %CURRENT_MODULE_PATH%\intelligencelayer
2023-11-07 13:12:40: ** DATA_DIR = %DATA_DIR%
2023-11-07 13:12:40: ** MODE = MEDIUM
2023-11-07 13:12:40: ** MODELS_DIR = %CURRENT_MODULE_PATH%\assets
2023-11-07 13:12:40: ** PROFILE = desktop_gpu
2023-11-07 13:12:40: ** USE_CUDA = True
2023-11-07 13:12:40: ** YOLOv5_AUTOINSTALL = false
2023-11-07 13:12:40: ** YOLOv5_VERBOSE = false
2023-11-07 13:12:40:
2023-11-07 13:12:40: Started Face Processing module
2023-11-07 13:12:40: Installer exited with code 0
2023-11-07 13:12:43: Module FaceProcessing started successfully.
2023-11-07 13:12:44: face.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
2023-11-07 13:12:44: face.py: Vision AI services setup: Retrieving environment variables...
2023-11-07 13:12:44: face.py: USE_MPS not found. Setting to default True
2023-11-07 13:12:44: face.py: GPU in use: NVIDIA GeForce RTX 3060
2023-11-07 13:12:44: face.py: APPDIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer
2023-11-07 13:12:44: face.py: PROFILE: desktop_gpu
2023-11-07 13:12:44: face.py: USE_CUDA: True
2023-11-07 13:12:44: face.py: DATA_DIR: C:\ProgramData\CodeProject\AI
2023-11-07 13:12:44: Running init for Face Processing
2023-11-07 13:12:44: face.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\assets
2023-11-07 13:12:44: face.py: MODE: MEDIUM
2023-11-07 13:12:44: Face Processing: Face Processing started. in Face Processing
2023-11-07 13:12:54: Preparing to install module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Downloading module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Preparing to install module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Downloading module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installing module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:54: ObjectDetectionYolo: [0;33m[49m Installing CodeProject.AI Analysis Module [0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m========================================================================[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m CodeProject.AI Installer [0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m========================================================================[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;37m[49msetupMode = InstallModule[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;37m[49mexecutionEnvironment = Production[0m
2023-11-07 13:12:54: Installing module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:55 [System.IO.IOException: The process cannot access the file 'C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\install.log' because it is being used by another process.
at Microsoft.Win32.SafeHandles.SafeFileHandle.CreateFile(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.File.AppendText(String path)
at CodeProject.AI.Server.Modules.ModuleInstaller.InstallModuleAsync(String installPackagePath, String moduleId, LogVerbosity verbosity)
at CodeProject.AI.Server.Modules.ModuleInstaller.DownloadAndInstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at CodeProject.AI.Server.Controllers.ModuleController.InstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at lambda_method95(Closure, Object)
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeactionmethodasync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokenextactionfilterasync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeinnerfilterasync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokefilterpipelineasync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.<invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)]: Connection id "0HMUVQNTJL7FS", Request id "0HMUVQNTJL7FS:000000F4": An unhandled exception was thrown by the application.
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49minstallerScriptsPath = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49msdkScriptsDirPath = C:\Program Files\CodeProject\AI\SDK\Scripts[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mabsoluteAppRootDir = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mruntimesDirPath = C:\Program Files\CodeProject\AI\runtimes[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mmodulesDirPath = C:\Program Files\CodeProject\AI\modules[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mdownloadDirPath = C:\Program Files\CodeProject\AI\downloads[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mGeneral CodeProject.AI setup [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCreating Directories...[0m[0;92m[49mDone[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mGPU support [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCUDA Present...[0m[0;33m[49mNo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mROCm Present...[0m[0;33m[49mFalse[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mVariable Dump [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mmoduleName = ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mmoduleVersion = 1.7.1[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mruntime = python3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49minstallGPU = true[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpythonLocation = Shared[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpythonVersion = 3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mvirtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mvenvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpackagesDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mInstalling module ObjectDetectionYolo 1.7.1 [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mInstalling Python 3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mInstalling python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;32m[49mPython 3.7 is already installed[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCreating Virtual Environment (Shared)...[0m[0;32m[49mVirtual Environment already present[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mConfirming we have Python 3.7 in our virtual environment...[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49m-------------------------------------------------------------[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;91m[49mError: Python not installed[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mDownloading models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;30m[49mDownloading Standard YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\models-yolo5-pt.zip'[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mExtracting models-yolo5-pt.zip[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;39m[49mCopying contents of models-yolo5-pt.zip to assets...[0m[0;32m[49mdone[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;32m[49mdone[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mDownloading custom-models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;30m[49mDownloading Custom YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\custom-models-yolo5-pt.zip'[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mExtracting custom-models-yolo5-pt.zip[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mCopying contents of custom-models-yolo5-pt.zip to custom-models...[0m[0;32m[49mdone[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;32m[49mdone[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mInstalling Python packages for ObjectDetectionYolo[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2023-11-07 13:13:03: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmpvk6ykxnz
2023-11-07 13:13:03: ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:03: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:04: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:04: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:06: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:06: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\requirements.txt[0m
2023-11-07 13:13:06: ObjectDetectionYolo: Not enough memory.
2023-11-07 13:13:06: ObjectDetectionYolo: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2023-11-07 13:13:07: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmp36gxmpt7
2023-11-07 13:13:07: ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:07: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:08: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:08: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:09: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:10: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt[0m
2023-11-07 13:13:10: ObjectDetectionYolo: Not enough memory.
2023-11-07 13:13:10: ObjectDetectionYolo: [0;97m[42mSetup complete [0m
2023-11-07 13:13:10: Module ObjectDetectionYolo installed successfully.
2023-11-07 13:13:10: Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
2023-11-07 13:13:10:
2023-11-07 13:13:10: Attempting to start ObjectDetectionYolo with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py"
2023-11-07 13:13:10: Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...tectionYolo\detect_adapter.py"
2023-11-07 13:13:10:
2023-11-07 13:13:10: ** Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
2023-11-07 13:13:10: ** Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-07 13:13:10: ** AutoStart: True
2023-11-07 13:13:10: ** Queue: objectdetection_queue
2023-11-07 13:13:10: ** Platforms: all
2023-11-07 13:13:10: ** GPU Libraries: installed if available
2023-11-07 13:13:10: ** GPU Enabled: enabled
2023-11-07 13:13:10: ** Parallelism: 0
2023-11-07 13:13:10: ** Accelerator:
2023-11-07 13:13:10: ** Half Precis.: enable
2023-11-07 13:13:10: ** Runtime: python3.7
2023-11-07 13:13:10: ** Runtime Loc: Shared
2023-11-07 13:13:10: ** FilePath: detect_adapter.py
2023-11-07 13:13:10: ** Pre installed: False
2023-11-07 13:13:10: ** Start pause: 1 sec
2023-11-07 13:13:10: ** LogVerbosity:
2023-11-07 13:13:10: ** Valid: True
2023-11-07 13:13:10: ** Environment Variables
2023-11-07 13:13:10: ** APPDIR = %CURRENT_MODULE_PATH%
2023-11-07 13:13:10: ** CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
2023-11-07 13:13:10: ** MODELS_DIR = %CURRENT_MODULE_PATH%/assets
2023-11-07 13:13:10: ** MODEL_SIZE = Medium
2023-11-07 13:13:10: ** USE_CUDA = True
2023-11-07 13:13:10: ** YOLOv5_AUTOINSTALL = false
2023-11-07 13:13:10: ** YOLOv5_VERBOSE = false
2023-11-07 13:13:10:
2023-11-07 13:13:10: Started Object Detection (YOLOv5 6.2) module
2023-11-07 13:13:10: Installer exited with code 0
2023-11-07 13:13:11: Module ObjectDetectionYolo started successfully.
2023-11-07 13:13:15: detect_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
2023-11-07 13:13:15: detect_adapter.py: APPDIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-07 13:13:15: detect_adapter.py: MODEL_SIZE: medium
2023-11-07 13:13:15: detect_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets
2023-11-07 13:13:15: Running init for Object Detection (YOLOv5 6.2)
2023-11-07 13:13:15: Object Detection (YOLOv5 6.2): Object Detection (YOLOv5 6.2) started. in Object Detection (YOLOv5 6.2)
modified 7-Nov-23 16:45pm.
|
|
|
|
|
48Gb is a fair whack of memory and shouldn't be stressed at all. I run the installed on an 8Gb raspberry Pi and a 2GB Jetson and it works (though the Jetson is creaking badly).
There are file access issues in their that are unrelated, but I wonder if the memory error is actually bogus. In image processing in .NET there is an issue where unsupported formats through a 'out of memory' error rather than a 'I don't understand this format'. I'm wondering if it's the same type of issue.
Is anything else running on your system during install?
(and if you copied the entire Python37 folder it should all be good)
cheers
Chris Maunder
|
|
|
|
|
Nothing else running, 30 gigs free. Before I had 16 gigs and a GTX 960 w/2 gigs. Two modules ran great. Of note, every install od CP.AI I have installed, just this box, has the amazon bit bucket permissions error. I can "open the doors" on this box, router too, and it will still error on permissions dowloading python and all any libraries, plus the model zips. I can make it run. It runs great. Very acceptable times.
I should add that I can go to a browser(Firefox) and download python37.zip from the bitbucket...
https:
|
|
|
|
|
I get the following error on a brand new install of 2.3.4. When I go to AI Explorer, and try to register a new face, I get "Quote: Response timeout. Try increasing the timeout value
So I started looking at the logs.
08:02:16:System: Windows
08:02:16:Operating System: Windows (Microsoft Windows 11 version 10.0.22635)
08:02:16:CPUs: AMD Ryzen Threadripper 3960X 24-Core Processor (AMD)
08:02:16: 1 CPU x 24 cores. 48 logical processors (x64)
08:02:16:GPU: NVIDIA GeForce RTX 3070 (8 GiB) (NVIDIA)
08:02:16: Driver: 546.01 CUDA: 11.8.89 (max supported: 12.3) Compute: 8.6
08:02:16:System RAM: 128 GiB
08:02:16:Target: Windows
08:02:16:BuildConfig: Release
08:02:16:Execution Env: Native
08:02:16:Runtime Env: Production
08:02:16:.NET framework: .NET 7.0.13
08:02:16:App DataDir: C:\ProgramData\CodeProject\AI
08:02:16:Video adapter info:
08:02:16: NVIDIA GeForce RTX 3070:
08:02:16: Driver Version 31.0.15.4601
08:02:16: Video Processor NVIDIA GeForce RTX 3070
08:02:16:STARTING CODEPROJECT.AI SERVER
08:02:16:RUNTIMES_PATH = C:\Program Files\CodeProject\AI\runtimes
08:02:16:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
08:02:16:MODULES_PATH = C:\Program Files\CodeProject\AI\modules
08:02:16:PYTHON_PATH = \bin\windows\%PYTHON_DIRECTORY%\venv\Scripts\python
08:02:16:Data Dir = C:\ProgramData\CodeProject\AI
08:02:16:Server version: 2.3.4-Beta
08:02:19:Setting up initial modules. Please be patient...
08:02:19:Installing initial module FaceProcessing.
08:02:19:Preparing to install module 'FaceProcessing'
08:02:20:Downloading module 'FaceProcessing'
08:02:21:Installing module 'FaceProcessing'
08:02:21:FaceProcessing: Installing CodeProject.AI Analysis Module
08:02:21:FaceProcessing: ========================================================================
08:02:21:FaceProcessing: CodeProject.AI Installer
08:02:21:FaceProcessing: ========================================================================
08:02:21:FaceProcessing: General CodeProject.AI setup
08:02:21:FaceProcessing: Creating Directories...Done
08:02:21:FaceProcessing: GPU support
08:02:21:FaceProcessing: CUDA Present...Yes (version 11.8)
08:02:21:FaceProcessing: ROCm Present...False
08:02:22:Server: This is the latest version
08:02:22:FaceProcessing: Installing module FaceProcessing 1.8.1
08:02:22:FaceProcessing: Installing Python 3.7
08:05:03:FaceProcessing: Downloading Python 3.7 interpreter...Expanding...Done.
08:05:16:FaceProcessing: Creating Virtual Environment (Shared)...Done
08:05:16:FaceProcessing: Confirming we have Python 3.7 in our virtual environment...present
08:22:21:Module FaceProcessing installed successfully.
08:22:21:FaceProcessing: Downloading YOLO models...
08:22:21:
08:22:21:Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
08:22:21:Module Path: C:\Program Files\CodeProject\AI\modules\FaceProcessing
08:22:21:AutoStart: True
08:22:21:Queue: faceprocessing_queue
08:22:21:Platforms: windows,linux,linux-arm64,macos,macos-arm64
08:22:21:GPU Libraries: installed if available
08:22:21:GPU Enabled: enabled
08:22:21:Parallelism: 0
08:22:21:Accelerator:
08:22:21:Half Precis.: enable
08:22:21:Runtime: python3.7
08:22:21:Runtime Loc: Shared
08:22:21:FilePath: intelligencelayer\face.py
08:22:21:Pre installed: False
08:22:21:Start pause: 3 sec
08:22:21:LogVerbosity:
08:22:21:Valid: True
08:22:21:Environment Variables
08:22:21:APPDIR = %CURRENT_MODULE_PATH%\intelligencelayer
08:22:21:DATA_DIR = %DATA_DIR%
08:22:21:MODE = MEDIUM
08:22:21:MODELS_DIR = %CURRENT_MODULE_PATH%\assets
08:22:21:PROFILE = desktop_gpu
08:22:21:USE_CUDA = True
08:22:21:YOLOv5_AUTOINSTALL = false
08:22:21:YOLOv5_VERBOSE = false
08:22:21:
08:22:21:Started Face Processing module
08:22:21:Unable to install FaceProcessing: Timed out attempting to install Module 'FaceProcessing' (A task was canceled.)
08:22:21:Installing initial module ObjectDetectionNet.
08:22:21:Preparing to install module 'ObjectDetectionNet'
08:22:21:Downloading module 'ObjectDetectionNet'
08:22:21:face.py: Traceback (most recent call last):
08:22:21:face.py: File "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\face.py", line 21, in
08:22:21:face.py: from request_data import RequestData
08:22:21:face.py: File "../../SDK/Python\request_data.py", line 7, in
08:22:21:face.py: from PIL import Image
08:22:21:face.py: ModuleNotFoundError: No module named 'PIL'
08:22:21:face.py: has exited
08:22:21:Module FaceProcessing has shutdown
08:22:22:Installing module 'ObjectDetectionNet'
08:22:22:ObjectDetectionNet: Installing CodeProject.AI Analysis Module
08:22:22:ObjectDetectionNet: ========================================================================
08:22:22:ObjectDetectionNet: CodeProject.AI Installer
08:22:22:ObjectDetectionNet: ========================================================================
08:22:22:ObjectDetectionNet: General CodeProject.AI setup
08:22:22:ObjectDetectionNet: Creating Directories...Done
08:22:23:ObjectDetectionNet: GPU support
08:22:23:ObjectDetectionNet: CUDA Present...Yes (version 11.8)
08:22:23:ObjectDetectionNet: ROCm Present...False
08:22:23:ObjectDetectionNet: Installing module ObjectDetectionNet 1.7.1
08:22:24:Module FaceProcessing started successfully.
08:27:33:ObjectDetectionNet: Downloading ObjectDetectionNet-DirectML-1.7.1.zip...Expanding...Done.
08:27:34:ObjectDetectionNet: Copying contents of ObjectDetectionNet-DirectML-1.7.1.zip to ...done
08:27:34:ObjectDetectionNet: Cleaning up...done
08:42:22:Module ObjectDetectionNet installed successfully.
08:42:22:Module ObjectDetectionNet not configured to AutoStart.
08:42:22:ObjectDetectionNet: Downloading YOLO ONNX models...
08:42:22:Unable to install ObjectDetectionNet: Timed out attempting to install Module 'ObjectDetectionNet' (A task was canceled.)
08:42:22:Installing initial module ObjectDetectionYolo.
08:42:22:Preparing to install module 'ObjectDetectionYolo'
08:42:22:Downloading module 'ObjectDetectionYolo'
08:42:23:Installing module 'ObjectDetectionYolo'
08:42:23:ObjectDetectionYolo: Installing CodeProject.AI Analysis Module
08:42:23:ObjectDetectionYolo: ========================================================================
08:42:23:ObjectDetectionYolo: CodeProject.AI Installer
08:42:23:ObjectDetectionYolo: ========================================================================
08:42:23:ObjectDetectionYolo: General CodeProject.AI setup
08:42:24:ObjectDetectionYolo: Creating Directories...Done
08:42:24:ObjectDetectionYolo: GPU support
08:42:24:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
08:42:24:ObjectDetectionYolo: ROCm Present...False
08:42:24:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1
08:42:24:ObjectDetectionYolo: Installing Python 3.7
08:42:24:ObjectDetectionYolo: Python 3.7 is already installed
08:42:24:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
08:42:24:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
08:55:26:ObjectDetectionYolo: Downloading Standard YOLO models...Expanding...Done.
08:55:27:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
08:55:27:ObjectDetectionYolo: Cleaning up...done
09:02:23:Module ObjectDetectionYolo installed successfully.
09:02:23:
09:02:23:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
09:02:23:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
09:02:23:AutoStart: True
09:02:23:Queue: objectdetection_queue
09:02:23:Platforms: all
09:02:23:GPU Libraries: installed if available
09:02:23:GPU Enabled: enabled
09:02:23:Parallelism: 0
09:02:23:Accelerator:
09:02:23:Half Precis.: enable
09:02:23:Runtime: python3.7
09:02:23:Runtime Loc: Shared
09:02:23:FilePath: detect_adapter.py
09:02:23:Pre installed: False
09:02:23:Start pause: 1 sec
09:02:23:LogVerbosity:
09:02:23:Valid: True
09:02:23:Environment Variables
09:02:23:APPDIR = %CURRENT_MODULE_PATH%
09:02:23:CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
09:02:23:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
09:02:23:MODEL_SIZE = Medium
09:02:23:USE_CUDA = True
09:02:23:YOLOv5_AUTOINSTALL = false
09:02:23:YOLOv5_VERBOSE = false
09:02:23:
09:02:23:Started Object Detection (YOLOv5 6.2) module
09:02:23:ObjectDetectionYolo: Downloading Custom YOLO models...
09:02:23:Unable to install ObjectDetectionYolo: Timed out attempting to install Module 'ObjectDetectionYolo' (A task was canceled.)
09:02:23:detect_adapter.py: Traceback (most recent call last):
09:02:23:detect_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py", line 12, in
09:02:23:detect_adapter.py: from request_data import RequestData
09:02:23:detect_adapter.py: File "../../SDK/Python\request_data.py", line 7, in
09:02:23:detect_adapter.py: from PIL import Image
09:02:23:detect_adapter.py: ModuleNotFoundError: No module named 'PIL'
09:02:23:Module ObjectDetectionYolo has shutdown
09:02:23:detect_adapter.py: has exited
09:02:24:Module ObjectDetectionYolo started successfully.
Here is my System Tab
<blockquote class="quote"><div class="op">Quote:</div>Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22635)
CPUs: AMD Ryzen Threadripper 3960X 24-Core Processor (AMD)
1 CPU x 24 cores. 48 logical processors (x64)
GPU: NVIDIA GeForce RTX 3070 (8 GiB) (NVIDIA)
Driver: 546.01 CUDA: 11.8.89 (max supported: 12.3) Compute: 8.6
System RAM: 128 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.13
Video adapter info:
NVIDIA GeForce RTX 3070:
Driver Version 31.0.15.4601
Video Processor NVIDIA GeForce RTX 3070
System GPU info:
GPU 3D Usage 27%
GPU RAM Usage 3.1 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168</blockquote>
|
|
|
|
|
Thanks very much for the report and all that info. It could be that all you have to do is try uninstalling and reinstalling the modules you want to use, one by one.
It looks like there was also a timeout issue, though. You may need to change the ModuleInstallTimeout value in appsettings.json. You can also download the module manually: CodeProject.AI Server Modules Registry[^]
Thanks,
Sean Ewington
CodeProject
|
|
|
|
|
I noticed that if you use default model then requests will be balanced between two engines I have enabled
Object Detection (YOLOv5 6.2)
and
ObjectDetection (Coral)
Coral is usually 3-4x faster.
Yolo is faster if I use `ipcam-general` model but that one is not available for Coral so if the software is set to use custom model it will error out when it will try to get response from the Coral Engine.
- Is it possible to get the same models for Coral? I see that it is a 3th party repo on github? That way both engines can use the same custom engine.
- Is it possible to disable coral from using CPU? Sometimes (for unknown reasons for now) the TPU is not available and it will switch to CPU which is WAY slower. I would prefer for it to remain OFF then switch to CPU. In that case YoloCPU will process all object detections and it is faster the Coral CPU
- What are the cli commands to restart an engine? Sometimes a restart of Coral fixes the issue (Sometimes Face-detection also crashes and needs manual restart)
Using 2.2.4 on Docker on Linux
|
|
|
|
|
Converting YOLOv5 to edgeTPU is walked through here. A bit of fiddling and it should be straightforward enough. Unfortunately I don't have the time at the moment to dive in myself.
VavoVavo wrote: Is it possible to disable coral from using CPU
Not now, but I can add that option. The Coral module would just stop in that case.
VavoVavo wrote: What are the cli commands to restart an engine
POST: localhost:32168/v1/settings/<ModuleId>
Where moduleID is ObjectDetectionCoral for the coral module, and include a name/value pair name = 'Restart', value = 'now' in the form data sent.
cheers
Chris Maunder
|
|
|
|
|
15:46:08:ObjectDetection (Coral): Retrieved objectdetection_queue command
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3], dtype=int32), 'shape_signature': array([ 1, 300, 300, 3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...b8118a) took 2689ms
After this blurp in the log the TPU is not working, The UI still says GPU (TPU) but the numbers are > 1sec, otherwise it takes ~20ms
Probably switching to CPU
17:11:32:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:11:33:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...b80a07) took 1003ms
17:11:52:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:11:53:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...2532f7) took 1006ms
17:12:04:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:12:05:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...020032) took 1003ms
17:12:35:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:12:36:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...58423f) took 1003ms
I can detect this by periodic tests from my monitoring system by sending a detection request with a known image periodically. So I can automate the restarts or CPAI can implement service autorestart?
|
|
|
|
|
Just installed codeproject/ai-server:cuda11_7 in docker and it reports size of 10.9GB. This is plain insane. Why it needs to be that huge? I bet it can fit couple hundreds megs at max. Fix it please, it makes no sense at all.
|
|
|
|
|
Welcome to the world of AI.
The main culprits are
- PyTorch and other AI / GPU libraries. Well over a Gb each
- The AI models themselves. 10's of Mb each
- The base OS
- The NVIDIA drivers and libraries.
cheers
Chris Maunder
|
|
|
|
|
I installed 2.3.4 on my Win10 machine with Quadro P1000 but I can't get YOLOv5 6.2 - 1.7.1 to use GPU anymore. Always says CPU. I tried reinstalling CPAI and the module without cache. Logs looks like it detects CUDA and is looking to use it, but info for the module says it's running on CPU.
Previous CPAI version listed it as running on GPU.
UPDATE 1
Did a clean and re-install of latest supported drivers and CUDA 11.8 as per instructions.
Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 10.0.19045)
CPUs: Intel(R) Core(TM) i7-8700T CPU @ 2.40GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: Quadro P1000 (4 GiB) (NVIDIA)
Driver: 537.70 CUDA: 11.8.89 (max supported: 12.2) Compute: 6.1
System RAM: 16 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
NVIDIA Quadro P1000:
Driver Version 31.0.15.3770
Video Processor Quadro P1000
Intel(R) UHD Graphics 630:
Driver Version 31.0.101.2125
Video Processor Intel(R) UHD Graphics Family
System GPU info:
GPU 3D Usage 0%
GPU RAM Usage 398 MiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
Module Path: <root>\modules\ObjectDetectionYolo
AutoStart: True
Queue: objectdetection_queue
Platforms: all
GPU Libraries: installed if available
GPU Enabled: enabled
Parallelism: 0
Accelerator:<br />
Half Precis.: enable
Runtime: python3.7
Runtime Loc: Shared
FilePath: detect_adapter.py
Pre installed: False
Start pause: 1 sec
LogVerbosity:<br />
Valid: True
Environment Variables
APPDIR = <root>\modules\ObjectDetectionYolo
CUSTOM_MODELS_DIR = <root>\modules\ObjectDetectionYolo\custom-models
MODELS_DIR = <root>\modules\ObjectDetectionYolo\assets
MODEL_SIZE = Medium
USE_CUDA = True
YOLOv5_AUTOINSTALL = false
YOLOv5_VERBOSE = false
Started: 05 nov. 2023 11:36:08 a.m. W. Europe Standard Time
LastSeen: 05 nov. 2023 11:39:07 a.m. W. Europe Standard Time
Status: Started
Processed: 0
Provider:<br />
CanUseGPU: False
HardwareType: CPU
11:34:18:Call to Uninstall on module ObjectDetectionYolo has completed.
11:35:37:Preparing to install module 'ObjectDetectionYolo'
11:35:37:Downloading module 'ObjectDetectionYolo'
11:35:38:Installing module 'ObjectDetectionYolo'
11:35:38:ObjectDetectionYolo: Installing CodeProject.AI Analysis Module<br />
11:35:38:ObjectDetectionYolo: ========================================================================
11:35:38:ObjectDetectionYolo: CodeProject.AI Installer<br />
11:35:38:ObjectDetectionYolo: ========================================================================
11:35:38:ObjectDetectionYolo: General CodeProject.AI setup<br />
11:35:38:ObjectDetectionYolo: Creating Directories...Done
11:35:38:ObjectDetectionYolo: GPU support<br />
11:35:38:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
11:35:38:ObjectDetectionYolo: ROCm Present...False
11:35:39:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1<br />
11:35:39:ObjectDetectionYolo: Installing Python 3.7
11:35:39:ObjectDetectionYolo: Python 3.7 is already installed
11:35:39:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
11:35:39:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
11:35:40:ObjectDetectionYolo: Downloading Standard YOLO models...already exists...Expanding...Done.
11:35:40:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
11:35:40:ObjectDetectionYolo: Cleaning up...done
11:35:41:ObjectDetectionYolo: Downloading Custom YOLO models...already exists...Expanding...Done.
11:35:41:ObjectDetectionYolo: Copying contents of custom-models-yolo5-pt.zip to custom-models...done
11:35:41:ObjectDetectionYolo: Cleaning up...done
11:35:41:ObjectDetectionYolo: Installing Python packages for ObjectDetectionYolo
11:35:41:ObjectDetectionYolo: [0;Installing GPU-enabled libraries: If available
11:35:43:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
11:35:46:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
11:35:46:ObjectDetectionYolo: Python packages specified by requirements.windows.cuda.txt
11:35:48:ObjectDetectionYolo: - Installing Pandas, a data analysis / data manipulation tool...Already installed
11:35:49:ObjectDetectionYolo: - Installing CoreMLTools, for working with .mlmodel format models...Already installed
11:35:50:ObjectDetectionYolo: - Installing OpenCV, the Open source Computer Vision library...Already installed
11:35:51:ObjectDetectionYolo: - Installing Pillow, a Python Image Library...Already installed
11:35:52:ObjectDetectionYolo: - Installing SciPy, a library for mathematics, science, and engineering...Already installed
11:35:53:ObjectDetectionYolo: - Installing PyYAML, a library for reading configuration files...Already installed
11:35:54:ObjectDetectionYolo: - Installing PyTorch, an open source machine learning framework...Already installed
11:35:55:ObjectDetectionYolo: - Installing TorchVision, for working with computer vision models...Already installed
11:35:56:ObjectDetectionYolo: - Installing Ultralytics YoloV5 package for object detection in images...Already installed
11:35:58:ObjectDetectionYolo: - Installing Seaborn, a data visualization library based on matplotlib...Already installed
11:35:58:ObjectDetectionYolo: Installing Python packages for the CodeProject.AI Server SDK
11:35:59:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
11:36:02:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
11:36:02:ObjectDetectionYolo: Python packages specified by requirements.txt
11:36:03:ObjectDetectionYolo: - Installing Pillow, a Python Image Library...Already installed
11:36:04:ObjectDetectionYolo: - Installing Charset normalizer...Already installed
11:36:05:ObjectDetectionYolo: - Installing aiohttp, the Async IO HTTP library...Already installed
11:36:06:ObjectDetectionYolo: - Installing aiofiles, the Async IO Files library...Already installed
11:36:07:ObjectDetectionYolo: - Installing py-cpuinfo to allow us to query CPU info...Already installed
11:36:08:ObjectDetectionYolo: - Installing Requests, the HTTP library...Already installed
11:36:08:ObjectDetectionYolo: Setup complete<br />
11:36:08:Module ObjectDetectionYolo installed successfully.
11:36:08:
11:36:08:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
11:36:08:Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
11:36:08:AutoStart: True
11:36:08:Queue: objectdetection_queue
11:36:08:Platforms: all
11:36:08:GPU Libraries: installed if available
11:36:08:GPU Enabled: enabled
11:36:08:Parallelism: 0
11:36:08:Accelerator:
11:36:08:Half Precis.: enable
11:36:08:Runtime: python3.7
11:36:08:Runtime Loc: Shared
11:36:08:FilePath: detect_adapter.py
11:36:08:Pre installed: False
11:36:08:Start pause: 1 sec
11:36:08:LogVerbosity:
11:36:08:Valid: True
11:36:08:Environment Variables
11:36:08:APPDIR = %CURRENT_MODULE_PATH%
11:36:08:CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
11:36:08:MODELS_DIR = %CURRENT_MODULE_PATH%/assets
11:36:08:MODEL_SIZE = Medium
11:36:08:USE_CUDA = True
11:36:08:YOLOv5_AUTOINSTALL = false
11:36:08:YOLOv5_VERBOSE = false
11:36:08:
11:36:08:Started Object Detection (YOLOv5 6.2) module
11:36:08:Installer exited with code 0
11:36:08:Call to Install on module ObjectDetectionYolo has completed.
modified 5-Nov-23 5:43am.
|
|
|
|
|
Do you see the folder c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo or c:\Program Files\CodeProject\AI\preinstalled-modules\ObjectDetectionYolo or both?
If you see `c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo does that contain \bin\windows\python3.7\venv\lib\python37\site-packages (doing this off the top of my head so folder may be slightly misspelled), and if so do you see a Torch folder, and do you see mention of torch 1.13 or torch 2.0?
It should have installed torch 1.13 (and that's what the install self check says it did) but sometimes things go weird.
Everything seems in place. Not sure why it's not reporting GPU usage. Have you tried performing a detection using the explorer to give it a kick?
cheers
Chris Maunder
|
|
|
|
|
Thank you for your reply.
I only got c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
No bin folder inside that. The Torch folders are in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages
Inside that folder there is torch, torch-1.13.0+cpu.dist-info and torch-1.13.1.dist-info.
Detection using explorer seems fine, but it's using CPU.
Also, what is the difference on using "Detect Objects" vs "Custom Detect" in the explorer? Custom detect is about twice as fast as Detect Objects.
modified 5-Nov-23 15:54pm.
|
|
|
|
|