Commit Graph

7707 Commits

Author SHA1 Message Date
Jaroslaw Warchulski
0012328c9a feature: add debug flag to control state cache invalidation WA
Also, temporarily disable this WA.

Related-To: NEO-16281, NEO-16405
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-11-04 15:58:09 +01:00
Lukasz Jobczyk
498f62d7a0 fix: Reset direct submission when reinitialize context
Resolves: HSD-15018564496
Related-To: NEO-16651

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-11-04 13:32:36 +01:00
Katarzyna Cencelewska
5cf3eeb615 fix: use lowest priority level as default for primary context
calculate the lowest and highest software priority in one place

Related-To: HSD-18043767497
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2025-11-04 11:42:35 +01:00
Kamil Kopryk
8b98e0d500 refactor: rename functions to check if buffer has stateful access
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-11-04 09:39:26 +01:00
Compute-Runtime-Validation
5f874f45e2 Revert "feature: Add support for euss buffer overflow on windows"
This reverts commit 703dd48038.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-11-04 01:59:27 +01:00
Pratik Bari
811ed064d2 fix: Fix unrecoverable abort during device destruction
An inappropriate ioctl call for the device is observed when both zesInit
and zeInit are called in a process and Sysman device reset is called.
A condition has been added in the UNRECOVERABLE_IF to prevent crash
during cleanup.

Related-To: NEO-16439

Signed-off-by: Pratik Bari <pratik.bari@intel.com>
2025-11-03 15:38:37 +01:00
Mateusz Jablonski
ffb1d297c8 fix: merge hasPrintfCalls and usesPrintf flags within KernelAttributes flags
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-11-03 12:21:35 +01:00
Kamil Kopryk
f84a5fbee9 feature: add host functions workers
* add common host function worker interface
* add worker as a single thread per csr with 3 modes
* add logic for waiting on internal tag, check gpu hang
* if tag is in pending state, read callback data, run callback
and signal completion
* threads will exit the work loop once stop request
is called in finish
* add multi thread unit tests

Related-To: NEO-14577
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-11-03 12:11:17 +01:00
Mateusz Jablonski
ae05e0551e fix: remove not needed WA for printf buffer
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-11-03 11:48:23 +01:00
Szymon Morek
037756460f refactor: remove unused code
Related-To: NEO-14360

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-11-03 11:15:12 +01:00
Lukasz Jobczyk
88d379f5e5 performance: enable timestamp caching on OCL
Related-To: NEO-14360

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-11-03 10:51:26 +01:00
shubham kumar
703dd48038 feature: Add support for euss buffer overflow on windows
Related-To: NEO-15684

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-11-03 10:20:16 +01:00
Compute-Runtime-Validation
151afa37e7 Revert "performance: enable timestamp caching on OCL"
This reverts commit e9fdab3458.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-11-02 23:19:34 +01:00
Compute-Runtime-Validation
f9225de6b1 Revert "feature: integrate UsmMemAllocPoolsManager with OpenCL device pool"
This reverts commit 7833d62e3a.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-31 20:44:08 +01:00
Igor Venevtsev
4406889b39 fix: use condition variables instead of busy waits in worker threads
Resolves: NEO-16085, GSD-11678, HSD-14025819208

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2025-10-31 15:28:54 +01:00
Szymon Morek
e9fdab3458 performance: enable timestamp caching on OCL
Related-To: NEO-14360

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-31 11:37:56 +01:00
Mateusz Jablonski
a0845b707e build: add wrapper for gmmlib include
Related-To: NEO-11080

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-31 10:30:18 +01:00
Brandon Yates
acc7747abc fix: Fix memory corruption in toDrmEuDebugEuControl
This function was unnecessarily creating a new allocation for bitmaskPtr
This allocation was lost then the object went out of scope, which broke
existing flows

Related-to: NEO-16068

Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2025-10-31 08:57:07 +01:00
Compute-Runtime-Validation
fc62e025d2 Revert "fix: Check if provided CCS number is correct"
This reverts commit 94be8023dc.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-31 08:40:51 +01:00
Mateusz Jablonski
6aa5610f4c fix: correct UNICODE definition setting for Windows build
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-30 17:06:16 +01:00
Kindracki, Jakub Tomasz
94be8023dc fix: Check if provided CCS number is correct
Check if `ZEX_NUMBER_OF_CCS` env variable provided by the user is
correct. If it isn't then return false and print debug message.

Related-To: NEO-15230, GSD-11251
Signed-off-by: Kindracki, Jakub Tomasz <jakub.tomasz.kindracki@intel.com>
2025-10-30 16:00:55 +01:00
Narendra Bagria
b4983f234d fix: update CopyBufferRectBytes*2d* builtins
Related-To: NEO-16155

Signed-off-by: Narendra Bagria <narendra.bagria@intel.com>
2025-10-30 15:46:52 +01:00
Aleksander Czerwionka
7833d62e3a feature: integrate UsmMemAllocPoolsManager with OpenCL device pool
Related-To: NEO-16082

Signed-off-by: Aleksander Czerwionka <aleksander.czerwionka@intel.com>
2025-10-30 14:44:41 +01:00
Lukasz Jobczyk
0ac8e8ceaa performance: Set L1 cache policy to WB on PTL
Resolves: NEO-16378

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-30 14:30:39 +01:00
Jaroslaw Warchulski
f6b9454914 fix: state cache invalidation WA for xe3
Related-To: NEO-16281, NEO-16405

Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-10-30 11:50:26 +01:00
Slawomir Milczarek
6857e02c3c feature: Enable ULLS context termination for context group on multi-tile
Related-To: NEO-13325

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-10-30 09:49:28 +01:00
Compute-Runtime-Validation
59179fa9d9 Revert "performance: Set L1 cache policy to WB on PTL"
This reverts commit 577de9770d.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-30 05:03:02 +01:00
Compute-Runtime-Validation
56ce056ee2 Revert "feature: enable defer backing by default"
This reverts commit 19bef4f891.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-30 03:02:30 +01:00
John Falkowski
9590a42c10 feature: Enable madvise autoreset by default for shared system USM
Related-To: NEO-16531

Signed-off-by: John Falkowski <john.falkowski@intel.com>
2025-10-29 17:19:27 +01:00
Fabian Zwoliński
3c43276dab feature: add global/const surface nonUSM allocation pooling
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-10-29 16:56:59 +01:00
Fabian Zwoliński
5bad32c676 fix: move onChunkFreeCallback in AbstractBuffersPool constructors
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-10-29 16:37:20 +01:00
Lukasz Jobczyk
577de9770d performance: Set L1 cache policy to WB on PTL
Resolves: NEO-16378

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-29 15:06:02 +01:00
Mateusz Hoppe
08fc0c1e1f fix: expose single device mode
- return internal engine as default engine when defaultEngineIndex is not
yet set
- return correct internal engine from Device::getInternalEngine()

Resolves: HSD-18043691881

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-10-29 09:27:17 +01:00
Mateusz Jablonski
2892e5a7f9 feature: add support for require_assert_buffer and require_sync_buffer in zeinfo
Related-To: NEO-16544, IGC-11358
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-28 13:51:41 +01:00
Fabian Zwoliński
c0abff9cf2 refactor: introduce generic pool allocator using traits pattern
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-10-28 13:21:03 +01:00
Aleksander Czerwionka
0f639dc723 feature: set manager pool sizes based on isExtendedUsmPoolSizeEnabled
Related-To: NEO-16082

Signed-off-by: Aleksander Czerwionka <aleksander.czerwionka@intel.com>
2025-10-28 08:01:27 +01:00
Wesley Waugh
2f2a7bb84a feature: Add sipUsesSubslicePools ProductHelper function
Related-To: NEO-15672
Signed-off-by: Wesley Waugh <wesley.waugh@intel.com>
2025-10-27 19:00:32 +01:00
Narendra Bagria
19bef4f891 feature: enable defer backing by default
Related-To: NEO-13403

Signed-off-by: Bellekallu Rajkiran <bellekallu.rajkiran@intel.com>
Signed-off-by: Narendra Bagria <narendra.bagria@intel.com>
2025-10-27 16:49:02 +01:00
Grochowski, Stanislaw
f6eb59035b fix: remove ocl_khr_spir
Related-To: NEO-15215

Signed-off-by: Grochowski, Stanislaw <stanislaw.grochowski@intel.com>
2025-10-27 16:20:50 +01:00
Mateusz Hoppe
ce61eebafa feature: add primary context helper methods to ioctl helper xe
Related-To: NEO-16521

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-10-27 15:26:37 +01:00
Krzysztof Sprzaczkowski
c7b736f493 fix: gpu va mapping in 32 bit apps
Addresses GPU virtual address mapping failures in the allocateByKMD path
due to missing error handling for device state transitions.
Enhanced error handling now properly manages GPU state changes
during memory-intensive operations in 32-bit applications.

Related-To: NEO-12953
Signed-off-by: Krzysztof Sprzaczkowski <krzysztof.sprzaczkowski@intel.com>
2025-10-27 12:34:41 +01:00
Jack Myers
856c954324 fix: skip cpu copies for small bar config
Related-To: NEO-15922
Signed-off-by: Jack Myers <jack.myers@intel.com>
2025-10-25 02:33:15 +02:00
Mateusz Jablonski
b97754c107 refactor: create gmm page table manager from branch specific file
Related-To: NEO-11080

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-24 15:00:11 +02:00
Mateusz Jablonski
cf4e6858fa refactor: move gmm client context initialization to separate file
Related-To: NEO-11080

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-24 13:14:52 +02:00
Dominik Dabek
ff48090c11 feature: usm pool residency tracking
Initially under debug flag.
Track residency of pool and chunks.
If pool is already resident or already evicted, we can skip memory
operation on chunk from pool.

Return error on using not allocated chunk in pool.

Related-To: NEO-16303

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2025-10-24 13:14:37 +02:00
Mateusz Jablonski
145f03c294 refactor: encapsulate gmm page table manager handle
wrap destruction logic within unique ptr

set csr handle when creating page table manager

Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-24 12:50:10 +02:00
Compute-Runtime-Validation
ad05878165 Revert "refactor: Move residency controller to wddm"
This reverts commit d9624a270c.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-24 11:38:41 +02:00
Bellekallu Rajkiran
4573511966 refactor: Refactor user fence setup logic
Signed-off-by: Bellekallu Rajkiran <bellekallu.rajkiran@intel.com>
2025-10-24 11:22:26 +02:00
Compute-Runtime-Validation
b7d1c32edd Revert "fix: use condition variables instead of busy waits in worker threads"
This reverts commit 1f6039676f.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-24 10:55:27 +02:00
Krzysztof Sprzaczkowski
79b2be8f67 feature: Add support for older ocloc libraries to create fatbinary w/legacy devs
Related-To: NEO-9630
Signed-off-by: Krzysztof Sprzaczkowski <krzysztof.sprzaczkowski@intel.com>
2025-10-24 10:00:18 +02:00