[{"_1":2,"_160":-5,"_161":-5},"loaderData",{"_3":4,"_13":14,"_21":22,"_138":139},"root",{"_5":-5,"_6":-7,"_7":8,"_9":-7,"_10":11,"_12":-7},"currentUser","primaryEmail","siteVerification","6LeIxAcTAAAAAJcZVRqyHh71UMIEGNQ_MXjiZKhI","toast","enableDev",false,"incidentStatus","routes/_layout",{"_15":-5,"_16":17,"_18":17,"_19":11,"_20":11},"username","isAskGordonEnabled",true,"isUsingNewTemplate","showMinimalLanding","showHoneypotTrap","routes/_layout.r.$namespace.$reponame",{"_23":24,"_25":-5,"_26":11,"_27":11,"_28":29,"_30":31,"_32":-5,"_33":11,"_34":35,"_88":-5,"_89":90,"_129":-5,"_130":11,"_131":17,"_132":11,"_133":-5,"_134":11,"_135":-5,"_136":137},"canonicalUrl","https://hub.docker.com/r/ukicomputers/yolonas-cpp/tags","mcpServer","canSeeDockerfile","canSeeAutobuilds","namespace","ukicomputers","reponame","yolonas-cpp","cloudBuildSource","isAutobuildsAvailable","repo",{"_36":37,"_43":44,"_46":47,"_48":49,"_50":11,"_51":52,"_53":54,"_55":56,"_39":31,"_28":29,"_58":59,"_60":45,"_61":62,"_63":62,"_64":65,"_66":-5,"_67":68,"_69":70,"_71":11,"_72":29,"_73":74,"_79":11,"_80":81,"_85":29,"_86":87},"categories",[38],{"_39":40,"_41":42},"name","Machine learning & AI","slug","machine-learning-and-ai","content_types",[45],"image","date_registered","2024-06-18T13:07:21.127131Z","description","Dockerized CPP library for inferencing with OpenCV DNN and YOLO-NAS","is_private","last_updated","2024-06-19T11:51:54.105981Z","last_modified","2024-10-16T13:48:34.145251Z","media_types",[57],"application/vnd.docker.container.image.v1+json","pull_count",1029,"repository_type","star_count",1,"status","status_description","active","source","collaborator_count",0,"full_description","# yolonas-cpp\nAn CPP library for object detection with full processing using OpenCV DNN (for ONNX) on YOLO-NAS model.
\n[Showcase, demo and quckstart YouTube video](https://youtu.be/t4x2_ebe988)\n\n## Introduction\nAs normal world of AI today becomed reality, we use it as much as we can. Everyone knows that today to run an AI model, or anything similar to that, you need intermediate processing power that many people cannot afford it. As we, humans, we always choose the easiest path to do something. That is similar here. If you search online for some machine vision thing, you will probably 99% of time get something written in **Python**. Currently, **Python** is the easiest path, but in inference time not the fastest. If you understand what Python **_Interpreter_** is, you will understand how is it slow to do some complex tasks. There comes **CPP**. It almost runs everything today under the hood, and it's incredibly **FAST**. But **ONLY KNOWLEDGABLE PEOPLE** knows how to use it. So, here comes this libary. You can in **TWO LINES** of code run machine detection. It runs using **OpenCV**, and it can use **YOLO-NAS**, that model which is really good, with fastest detection (inference) time, and it CAN detect extremly small objects. Here is it's efficiency comparing to other models:

\n![efficency](https://github.com/ukicomputers/yolonas-cpp/assets/84191191/3c991abb-e1ed-49da-9cc0-0c37fcab7fe8)\n\n## Detection\n![detected](https://github.com/ukicomputers/yolonas-cpp/assets/84191191/888a729e-bdc2-4c59-ae74-6cf855fc5cf3)\n

Library uses **OpenCV** and it's **DNN** to run the model. Model is under **ONNX** format. It's also able to run with **CUDA** (not tested yet).\n\n## Requirements\n- GCC\n- CMake\n- OpenCV (installed as CMake library) with `dnn` submodule enabled\n- CUDA compatible GPU + `nvcc` (_optionally, if you want to use GPU inference_)\n### Attention!\nI got issues when I used precompiled version of OpenCV, `libopencv-dev`, installed with `apt` package manager. Then, I was not able to start a inference at all. To fix this issue, I compiled and installed OpenCV using this [gist](https://gist.github.com/ukicomputers/e559854ac0b4fba7ea722722f96d5fbf). Please use it to avoid any issues.\n\n## Setup\n### via Docker\nTo setup this library and interact with it via Docker, you can simply pull it and run by using commands:\n```bash\ndocker pull ukicomputers/yolonas-cpp\ndocker run ukicomputers/yolonas-cpp\n```\nBy default, container will use default model and picture for detection.\nCurrently, Docker container **DOES NOT** support GPU accelerated, and video inference.\nThese features are comming soon.\nYou can interact with it by setting enviroment variables when running it:\n```bash\ndocker run -v /path/to/write/out/imgs:/output -e model=\"path/to/model\" -e metadata=\"path/to/metadata\" -e source=\"path/to/source\" ukicomputers/yolonas-cpp\n```\nIt is important that if you want to get images of detections, you need to make a bridge from folder on your device, exactly to folder on container located on `/output`. You may also want to create bridges for models, etc located on your local device.\nYou can also find image on [Docker Hub](https://hub.docker.com/r/ukicomputers/yolonas-cpp).\n### Local setup\nTo install this library on your computer, firstly clone this repository:\n```bash\ngit clone https://github.com/ukicomputers/yolonas-cpp.git\n```\nThen change directory to it, and execute **install.bash** with superuser permission, installing as CMake libary:\n```bash\ncd yolonas-cpp\nsudo bash install.bash\n```\nAfter that library will be installed.

**Aditionally**, if you want to download YOLO-NAS S COCO model to use directly from example, you can just execute this bash script:\n```bash\nbash download_models.bash\n```\nDownload size is about ~47MB (_maybe more, as the models are constantly updated_).\n\n## Quick usage\n**CPP** code (_not full code, just minimal example_):\n```cpp\n// include\n#include \n// modelpath metadata Labels CUDA\nYoloNAS net(\"./yolo_nas_s.onnx\", \"./metadata\", {\"lbl1\", \"lbl2\"}, false);\n// img draw score threshold\nnet.predict(img, true, 0.5);\n```\nInclude library in **CMake**:\n```cmake\nfind_package(YoloNAS REQUIRED)\ntarget_link_libraries(${PROJECT_NAME} ukicomputers::YoloNAS)\n```\nAlso required to include **OpenCV**:\n```cmake\nfind_package(OpenCV REQUIRED)\ninclude_directories(${OpenCV_INCLUDE_DIRS})\ntarget_link_libraries(${PROJECT_NAME} ${OpenCV_LIBS})\n```\n\n## Full library usage\n### `YoloNAS` class\nAcceptable arguments:\n```cpp\nYoloNAS::YoloNAS(string netPath, string config, vector lbls, bool cuda = false);\n```\n**Initializes YoloNAS class.**\n- modelpath (`std::string`),\n- Metadata file (`std::string`),\n- labels in a vector (`std::vector`)\n- CUDA support (`bool`, default `false`),\n\n```cpp\nYoloNAS net(modelPath, metadata, CUDA, labels);\n```\n### Function `predict`\nAcceptable arguments:\n```cpp\nvector YoloNAS::predict(cv::Mat &img, bool applyOverlayOnImage = true, float scoreThresh = -1.00)\n```\n**Predicts (detects) objects from image.**\n- image (`cv::Mat`)\n- visualy display detection (`bool`, writing on given image, default `true`)\n- score thereshold (`float`, if thereshold is not given, library will use thereshold from metadata, otherwise, it will use from given argument, **values are entered from 0.1-1.0 not 1-100**, may vary for if different model is used)\n```cpp\nnet.predict(image, overlayOnImage, scoreThreshold);\n```\n**Returns `detectionInfo` struct(s) in vector for each detection.**
\nAccesible elements from `detectionInfo` struct:\n```cpp\nstruct detectionInfo\n{\n int x, y, w, h;\n float score;\n string label;\n};\n```\n**Score is returned as float value from 0.1-1.0**. May vary if different model is used.\n\n## Demo\nDemo is located in folder `demo` from downloaded repository. To use it out-of-box, you can download example models by executing `download_models.bash`. To compile and run it, execute `build.bash` from `demo` folder.\n\n## Custom model & metadata\nTo use your own model, and run it also inside library, use `metadata.py` script, [link here](https://github.com/ukicomputers/yolonas-cpp/blob/main/metadata.py). To use it, in `metadata.py`, first few variables needs to be changed according to your model (model path, model type, number of classes). **IMPORTANT: `metadata.py` DOES NOT ACCEPT `.onnx` FILE FORMAT!** It only accepts the standard YOLO `.pt` format.

Script will convert your model to ONNX, and return required `metadata` file, that can be later used in inference.\n\n## TODO\n- fix required Docker things\n- make detection visualisation look cooler\n\n## License & contributions\nPlease add my name to top of a document to use library. It helps for me to get reputation.\n```cpp\n// YOLO-NAS CPP library written by Uglješa Lukešević (github.com/ukicomputers)\n```\nAlso, feel free to open new issues, and contribute it by opening pull request.\n\n## References\n- [https://github.com/Deci-AI/super-gradients](https://github.com/Deci-AI/super-gradients)\n- [https://github.com/Hyuto/yolo-nas-onnx](https://github.com/Hyuto/yolo-nas-onnx/tree/master/yolo-nas-cpp)\n\n**ukicomputers.**\n","has_starred","hub_user","immutable_tags_settings",{"_75":11,"_76":77},"enabled","rules",[78],".*","is_automated","permissions",{"_82":17,"_83":11,"_84":11},"read","write","admin","user","storage_size",1947442104,"orgData","recentTags",[91],{"_92":45,"_93":94,"_95":96,"_97":98,"_99":100,"_101":102,"_51":118,"_119":94,"_120":29,"_121":57,"_39":122,"_123":124,"_125":109,"_126":118,"_127":65,"_128":17},"content_type","creator",27527152,"digest","sha256:0df38338a78104edda3ca2fc2c02e89e2e3a9dc34a178f64b89051a2d4f7c6de","full_size",987636244,"id",700873913,"images",[103],{"_104":105,"_95":96,"_106":107,"_108":109,"_110":111,"_112":113,"_114":107,"_115":-5,"_116":98,"_63":65,"_117":-5},"architecture","amd64","features","","last_pulled","2026-09-20T14:40:40.583579451Z","last_pushed","2024-06-19T11:51:54Z","os","linux","os_features","os_version","size","variant","2024-06-19T11:51:53.865977Z","last_updater","last_updater_username","media_type","latest","repository",24398553,"tag_last_pulled","tag_last_pushed","tag_status","v2","sbxKitMetadata","isPotentialSpam","isHubSbxKitsEnabled","showSbxLogoOverride","sbxTrademarkText","displaySecurityMetadata","tagAttestations","tagsHaveAttestations",[],"routes/_layout.r.$namespace.$reponame.tags",{"_34":140,"_148":149,"_136":158,"_159":11},{"_36":141,"_43":143,"_46":47,"_48":49,"_50":11,"_51":52,"_53":54,"_55":144,"_39":31,"_28":29,"_58":59,"_60":45,"_61":62,"_63":62,"_64":65,"_66":-5,"_67":68,"_69":70,"_71":11,"_72":29,"_73":145,"_79":11,"_80":147,"_85":29,"_86":87},[142],{"_39":40,"_41":42},[45],[57],{"_75":11,"_76":146},[78],{"_82":17,"_83":11,"_84":11},"tags",{"_150":62,"_151":-5,"_152":-5,"_153":154},"count","next","previous","results",[155],{"_92":45,"_93":94,"_95":96,"_97":98,"_99":100,"_101":156,"_51":118,"_119":94,"_120":29,"_121":57,"_39":122,"_123":124,"_125":109,"_126":118,"_127":65,"_128":17},[157],{"_104":105,"_95":96,"_106":107,"_108":109,"_110":111,"_112":113,"_114":107,"_115":-5,"_116":98,"_63":65,"_117":-5},[],"canDeleteTags","actionData","errors"]

ukicomputers/yolonas-cpp

Tags for ukicomputers/yolonas-cpp