This article is designed to provide you with the structure and requirements for the different types of models we have used to date and also how they should be built.
The structure of a model’s file system is very important as to the way our Model Manager and OpenVINO Engine App leverage the hard work and time that has been spent creating your models.
If you are using Windows to package your model the instructions can be found here (How to package your model to work with ADLINK’s OpenVINO App using Windows).
Typically we expect a model to be of the format .tar.gz. The contents of this file can vary slightly but typically we find all models have a .bin and .xml files and some have a .mapping file.
Examples are shown here of the typical contents.
The method for tar and gzip these files is as follows, utilizing a Linux PC, I can see here that I have a model called frozen Inference graph. These model files must be tar and gzip into a root directory folder, this is a key requirement for the OpenVINO Inferencing Engine to be able to unpack and use the contents.
To tar and gzip the contents correctly navigate in a terminal windows (ctrl-alt-t) to the folder that your files are located and run the command with the following syntax
tar -zcvf “the name of the .tar.gz file” “file1” “file2” …
where the elements in ” ” need to be entered. I have shown my example below for my Frozen inference Graph.
Running this command will produce the file below, this is the file that we add to our Model Manager within Profile Builder.
Please read this article (https://goto50.ai/?p=122) to see how to use your newly packaged model with ADLINK’s Model Manager App and apply it to your OpenVINO inferencing engine.