-
Notifications
You must be signed in to change notification settings - Fork 2.7k
Disable Layer Fusion in OpenVINO #31215
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
Rah00m
wants to merge
18
commits into
openvinotoolkit:master
Choose a base branch
from
Rah00m:disable-layer-fusion
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Hi! I've finished implementing the patch to allow disabling layer fusion via environment variable or config. |
itikhono
reviewed
Jul 4, 2025
@@ -15,7 +15,7 @@ set(OPTIONAL_FUNC_TESTS_INCLUDES "") | |||
set(OPTIONAL_FUNC_TESTS_LIBS "") | |||
|
|||
set(SKIP_CONFIG "npu_skip_func_tests.xml") | |||
set(SKIP_CONFIG_PATH ${CMAKE_CURRENT_SOURCE_DIR}/shared_tests_instances/${SKIP_CONFIG}) | |||
# set(SKIP_CONFIG_PATH ${CMAKE_CURRENT_SOURCE_DIR}/shared_tests_instances/${SKIP_CONFIG}) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
debug?
itikhono
reviewed
Jul 4, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
category: AUTO BATCH
OpenVINO Auto Batch plugin
category: AUTO
OpenVINO AUTO device selection plugin
category: build
OpenVINO cmake script / infra
category: C API
OpenVINO C API bindings
category: Core
OpenVINO Core (aka ngraph)
category: CPP API
OpenVINO CPP API bindings
category: CPU
OpenVINO CPU plugin
category: docs
OpenVINO documentation
category: GPU
OpenVINO GPU plugin
category: inference
OpenVINO Runtime library - Inference
category: IR FE
OpenVINO IR v10 / v11 FrontEnd
category: JAX FE
OpenVINO JAX FrontEnd
category: JS API
OpenVino JS API Bindings
category: NPU
OpenVINO NPU plugin
category: ONNX FE
OpenVINO ONNX FrontEnd
category: Python API
OpenVINO Python bindings
category: samples
OpenVINO Runtime Samples
category: TEMPLATE
OpenVINO Template plugin
ExternalPR
External contributor
no-match-files
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
✨ Feature: Disable Layer Fusion (via Config or Env Var)
This PR adds the ability to disable CPU layer fusion in OpenVINO via a runtime config or environment variable, enabling:
✅ What's Added
DISABLE_LAYER_FUSION
DISABLE_LAYER_FUSION
test_disable_fusion.py
to validate behaviorConfig::applyDebugCapsProperties()
🎯 Why Disable Layer Fusion?
Disabling layer fusion is useful for:
ReLU
,HSwish
,Pooling
)benchmark_detailed_counters_report.csv
)✅ Option 1 – Runtime Config (Recommended)
✅ This guarantees fusion is disabled before model compilation.
Windows (CMD):
Linux/macOS (Bash):
export DISABLE_LAYER_FUSION=YES python test_disable_fusion.py
📄 More details: See
docs/disable_layer_fusion_doc.md