deciai/infery repository overview

⁠Deci Inference Examples

A collection of demo-apps and inference scripts for various frameworks using infery.

infery is Deci's Inference Engine for Python with robust API for inference and benchmarks, on any hardware.

⁠Basic Examples (Copy-Paste scripts)

⁠

⁠

⁠

⁠

⁠

⁠

⁠

⁠Advanced Examples

⁠

⁠

⁠

⁠

⁠Application Examples

⁠

⁠

⁠

⁠Custom Hardware Examples

⁠

⁠

⁠

⁠

⁠

⁠

⁠Getting Started

• Infery
  • You can use the Docker Container⁠ for GPU installations.
  • Or, Install on your host machine
• Git LFS
  • We use Git LFS to store the example models checkpoints.

  # 1. Install dependencies: 
  #   - python3 -m pip install <infery[all] | infery-gpu[all] | infery[openvino] | infery-gpu[tensorrt_8.0] | ... >
  #   - apt-get install git-lfs
  
  # 2. Clone this repo and download the example models
  git clone https://github.com/Deci-AI/infery-examples.git && cd infery-examples/ && git lfs fetch && git lfs checkout
  
  # 3. cd to the example's directory and run an example (The ONNX one, in this case).
  cd basic && python3 predict_onnx.py
  

  Copy

⁠Infery Documentation

• QuickStart Tutorial⁠
• Installation⁠
• Load Models⁠
• Error Handling⁠

⁠Contributing

• Feel free to request a feature, example or application.
  • Open an issue on GitHub and describe your desired usage.
• Please format the code before opening a pull-request using ./scripts/lint.sh.

⁠Infery Support Matrix

• (*) will always use GPU if infery-gpu installed
• (**) Limited multi-output support

⁠Licence

                            Deci Infery License
        This Python Package and the associated documentation (the "Software") is
         licensed to you by Deci.AI, Inc. ("Deci") under the following terms:
                            © 2022 – Deci.AI, Inc.

Subject to your full compliance with all of the terms herein, Deci hereby grants you a non-exclusive, revocable, non-sublicensable, non-transferable worldwide and limited right and license to use the Software in connection with the inference of models . If you are using the Deci platform for model optimization, your use of the Software is subject to the Terms of Use available here (the "Terms of Use").

You shall not, without Deci's prior written consent: (i) resell, lease, sublicense or distribute the Software to any person; (ii) use the Software to provide third parties with managed services or provide remote access to the Software to any person or compete with Deci in any way; (iii) represent that you possess any proprietary interest in the Software; (iv) directly or indirectly, take any action to contest Deci's intellectual property rights or infringe them in any way; (V) reverse-engineer, decompile, disassemble, alter, enhance, improve, add to, delete from, or otherwise modify, or derive (or attempt to derive) the technology or source code underlying any part of the Software; (vi) use the Software (or any part thereof) in any illegal, indecent, misleading, harmful, abusive, harassing and/or disparaging manner or for any such purposes. Except as provided under the terms of any separate agreement between you and Deci, including the Terms of Use to the extent applicable, you may not use the Software for any commercial use, including in connection with any models used in a production environment.

DECI PROVIDES THE SOFTWARE "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS OF THE SOFTWARE BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

        The Software may contain other software licensed under different terms.