Context

Snippets is a highly specialized JIT (just-in-time) compiler for computational graphs. It provides a scalable approach to operations' fusions and enablement. As a typical compiler, Snippets have frontend (tokenizer), optimizer and backend (generator).

The first of the Snippets pipeline, Tokenization, identifies parts of the initial ov::Model that can be lowered by Snippets efficiently, and tokenizes them into one whole node - Subgraph.
The second step of the pipeline (Optimizer) is applying common and device-specific optimizations to Subgraph and getting lowered representation of tokenized Subgraph.
Finally, the last stage is code emission. The target generator maps every operation in the IR to a binary code emitter JIT Emitter, which is then used to produce a piece of executable code. As a result, we produce an executable that performs calculations described by the initial input ov::Model.

The purpose of this issue is enabling tokenization of logical elementwise operations (LogicalAnd, LogicalOr, LogicalXor, LogicalNot) in Snippets for ARM devices. All JIT Emitters are already implemented in the CPU Plugin, so no need to write JIT Emitters.

Prerequisites

Recommended to use ARM CPU based platform for development (e.g. Mac, Raspberry Pi etc). The cross-compilation with an emulator (e.g. QEMU) using is still option: cmake -DCMAKE_TOOLCHAIN_FILE=../cmake/arm64.toolchain.cmake ...

What needs to be done?

• Need to enable Snippets tokenization of logical operations (LogicalAnd, LogicalOr, LogicalXor, LogicalNot) on AArch64 devices. Add them to the list in the is_supported_op in the tokenization pass callback.
• Register the operations with the corresponding JIT emitters in CPUTargetMachine.

Tests

Tests are disabled in default build, so ensure to add -DENABLE_TESTS=ON into cmake command.

GoogleTest is used for testing. CPU functional test target is ov_cpu_func_tests. You can use GoogleTest filter:

./bin/[platform]/[build_type]/ov_cpu_func_tests --gtest_filter="*smoke*LogicalLayerTest*"

Examples

• Enabled Ceiling and FloorMod tokenization: [Snippets][AArch64] Enabled Ceiling and FloorMod tokenization #28092
• The JIT Emitter implementation for Equal operation: [CPU] [ARM64] jit equal #23266
• CPU Target machine for x64 platforms: link.

Resources

• Contribution guide - start here!
• What is OpenVINO?
• Snippets - JIT compiler for computational graphs
• CPU plugin JIT emitters
• Blog post on contributing to OpenVINO
• User documentation
• Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers
• How to link your Pull Request to an issue

Contact points

@a-sidorova, @dmitry-gorokhov