Commit Graph

836 Commits

Author SHA1 Message Date
Krzysztof Sprzaczkowski
c7b736f493 fix: gpu va mapping in 32 bit apps
Addresses GPU virtual address mapping failures in the allocateByKMD path
due to missing error handling for device state transitions.
Enhanced error handling now properly manages GPU state changes
during memory-intensive operations in 32-bit applications.

Related-To: NEO-12953
Signed-off-by: Krzysztof Sprzaczkowski <krzysztof.sprzaczkowski@intel.com>
2025-10-27 12:34:41 +01:00
Mateusz Jablonski
b97754c107 refactor: create gmm page table manager from branch specific file
Related-To: NEO-11080

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-24 15:00:11 +02:00
Mateusz Jablonski
145f03c294 refactor: encapsulate gmm page table manager handle
wrap destruction logic within unique ptr

set csr handle when creating page table manager

Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-24 12:50:10 +02:00
Compute-Runtime-Validation
ad05878165 Revert "refactor: Move residency controller to wddm"
This reverts commit d9624a270c.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-24 11:38:41 +02:00
Mateusz Jablonski
5f5c08b7a7 refactor: split gmm memory definitions
Related-To: NEO-11080

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-24 08:15:53 +02:00
Compute-Runtime-Validation
6151a587f3 Revert "feature: Add support for euss buffer overflow on windows"
This reverts commit 91a27e9e9d.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-24 02:21:16 +02:00
shubham kumar
91a27e9e9d feature: Add support for euss buffer overflow on windows
Related-To: NEO-15684

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-10-23 08:25:23 +02:00
Lukasz Jobczyk
d9624a270c refactor: Move residency controller to wddm
Resolves: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-21 14:56:14 +02:00
Compute-Runtime-Validation
5c557bbd15 Revert "refactor: Move residency controller to wddm"
This reverts commit 645fc3d8af.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-10-20 07:25:03 +02:00
Lukasz Jobczyk
645fc3d8af refactor: Move residency controller to wddm
Resolves: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-17 15:57:09 +02:00
Lukasz Jobczyk
c888e8d57c Revert "refactor: Move residency controller to wddm"
This reverts commit 2e5cfc190e.

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-17 09:00:52 +02:00
Lukasz Jobczyk
2e5cfc190e refactor: Move residency controller to wddm
Resolves: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-16 14:35:55 +02:00
Chandio, Bibrak Qamar
49020f234d feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint on zeVirtualMemReserve.
If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-10-16 00:22:00 +02:00
Lukasz Jobczyk
f1f13f05e2 refactor: Move monitor fence to os context win
Related-To: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-15 11:06:54 +02:00
Lukasz Jobczyk
a45a4ab44e refactor: Remove osContextId member from residency controller
Related-To: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-14 10:38:54 +02:00
Szymon Morek
f90f73e3e4 fix: don't create threads during process shutdown
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-13 18:09:41 +02:00
Lukasz Jobczyk
6515e422e9 refactor: move eviction container to residency controller
Related-To: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-13 08:41:34 +02:00
shubham kumar
7a97b98cfe feature: Map PMT interface correctly on multi GPU system
Related-To: NEO-15912

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-10-10 17:20:17 +02:00
Fabian Zwoliński
226846323f feature: add memsetAllocation helper with blitter support
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-10-10 15:12:17 +02:00
Radoslaw Jablonski
54de14a9dc refactor: apply clang-format's InsertBraces rule
Formats code before InsertBraces rule is enabled.

Signed-off-by: Radoslaw Jablonski <radoslaw.jablonski@intel.com>
2025-10-06 15:32:46 +02:00
Szymon Morek
ee032982a6 refactor: print faulted address when waiting for tag
getDeviceState on Windows prints faulted GPU VA
if OOB access happened.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-02 14:59:02 +02:00
Mateusz Jablonski
5b8e8b8b1a refactor: unify GmmMemory definition
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-01 14:23:35 +02:00
Marcel Skierkowski
047f6851f7 refactor: correct programming of SLM size
Unify reading hw avaialble slm size:
Pre-Xe2 SLMSizeInKb stores total SLM size across all DSS
Xe2+ SLMSizeInKb stores SLM size per SS

apply restrictions for preferred/programmable SLM size

Related-To: NEO-12949
Signed-off-by: Marcel Skierkowski <marcel.skierkowski@intel.com>
2025-09-30 17:57:18 +02:00
Mateusz Jablonski
3c13fb81f7 refactor: remove not needed logic
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-09-30 14:50:49 +02:00
Filip Hazubski
b73e85de0d refactor: Refactor direct submission logic
Remove ReleaseHelper::isDirectSubmissionSupported function.
Update ProductHelper::isDirectSubmissionSupported to return correct values.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2025-09-30 13:41:03 +02:00
Mateusz Hoppe
98fcaf4ceb feature: support for context group on Windows
Related-To: NEO-14289


Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-09-28 13:38:53 +02:00
Szymon Morek
5714c3858f fix: increase staging threshold for misaligned ptrs
Related-To: NEO-16118

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-09-22 12:46:58 +02:00
Jaroslaw Warchulski
195bf66a49 refactor: fix typos
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-09-22 12:46:41 +02:00
Maciej Bielski
e8d43ff074 fix: various small improvements
Related-To: NEO-15630

Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-09-19 13:42:36 +02:00
Mateusz Hoppe
0f657e8877 fix: allow creating hostptr allocations with GPU VA equal hostptr
- when host USM memory is allocated, gpu virtual address should be the
same as cpu address when chunking due to huge size is used

Related-To: GSD-11423

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-09-16 17:13:17 +02:00
Mateusz Jablonski
92316c8cd6 fix: don't setup notifyAubCapture callback when not needed
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-09-12 11:28:37 +02:00
Vysochyn, Illia
f4bd4e603d refactor: Use else if instead of nested else-if conditions
Replaces nested else-if with else if for consistency and readability.
No functional changes.

Signed-off-by: Vysochyn, Illia <illia.vysochyn@intel.com>
2025-09-11 16:20:59 +02:00
Mateusz Jablonski
ed15408592 fix: correct order of wddm initialization
init gmm after getting device and paging queue handles

Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-09-11 16:14:49 +02:00
Szymon Morek
03357b6089 performance: adjust size threshold for staging on linux
Related-To: NEO-15973

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-09-05 18:09:49 +02:00
Grochowski, Stanislaw
12fa26f202 refactor: remove kmdaf from codebase
Related-To: NEO-14800

Signed-off-by: Grochowski, Stanislaw <stanislaw.grochowski@intel.com>
2025-08-27 11:12:53 +02:00
Radoslaw Jablonski
393604ef80 refactor: numThreadsPerEu
Signed-off-by: Radoslaw Jablonski <radoslaw.jablonski@intel.com>
2025-08-25 11:31:49 +02:00
Neil R. Spruit
43ebc17e17 feature: Support for opaque IPC handles on Windows and Linux
- Added support for creating and managing opaque IPC NT handles in the
WDDM layer.
- Introduced a new flag `shareableWithoutNTHandle` to indicate if memory
can be shared without an NT handle.
- Updated the `isShareableMemory` method to accommodate this new flag.
- Added debug variable EnableShareableWithoutNTHandle to control the
behavior of sharing memory without NT handles until requested.
- Updated Linux path to enable sharing DMA Buf FDs between processes
for use in pidfd_getfd
- Updated getfd and get IPC Handle helper functions to support opaque or
previous versions

Related-To: NEO-15345 , NEO-15346 , NEO-15347, NEO-10380

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
2025-08-18 16:23:44 +02:00
Compute-Runtime-Validation
0855219087 Revert "feature: Support for opaque IPC handles on Windows and Linux"
This reverts commit 46b1b2783b.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-08-15 02:22:02 +02:00
Mateusz Jablonski
ec36dd6275 refactor: move gmm callbacks definition to common place
- merge all the callbacks to single template class
- store callback functions in global arrays
- partially reuse callbacks on Linux

Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-08-14 16:49:29 +02:00
Neil R. Spruit
46b1b2783b feature: Support for opaque IPC handles on Windows and Linux
- Added support for creating and managing opaque IPC NT handles in the
WDDM layer.
- Introduced a new flag `shareableWithoutNTHandle` to indicate if memory
can be shared without an NT handle.
- Updated the `isShareableMemory` method to accommodate this new flag.
- Added debug variable EnableShareableWithoutNTHandle to control the
behavior of sharing memory without NT handles until requested.
- Updated Linux path to enable sharing DMA Buf FDs between processes
for use in pidfd_getfd

Related-To: NEO-15345 , NEO-15346 , NEO-15347, NEO-10380

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
2025-08-14 08:33:56 +02:00
Compute-Runtime-Validation
6880014602 Revert "refactor: store gmm callback functions in global arrays"
This reverts commit a68ea38ba1.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-08-13 23:19:58 +02:00
Mateusz Jablonski
a68ea38ba1 refactor: store gmm callback functions in global arrays
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-08-13 14:12:23 +02:00
Jakub Nowacki
c4ab767797 fix: add missing NonCopyableAndNonMovable asserts
Related-To: NEO-15630

Signed-off-by: Jakub Nowacki <jakub.nowacki@intel.com>
2025-08-13 13:13:05 +02:00
Chandio, Bibrak Qamar
6acfcb83b9 Revert "Two commits related to pStart feature"
Related-To: NEO-15156, GSD-9939

Revert "test: fix minor errors"

This reverts commit 712dc8221e.

Revert "feature: Support for pStart"

This reverts commit 47caeda487.

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-13 07:10:40 +02:00
Chandio, Bibrak Qamar
47caeda487 feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint in zeVirtualMemReserve.

If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-06 12:40:29 +02:00
Compute-Runtime-Validation
c9456cda14 Revert "feature: Support for pStart"
This reverts commit a50c0dbecf.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-08-06 02:26:13 +02:00
Chandio, Bibrak Qamar
a50c0dbecf feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint in zeVirtualMemReserve.

If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-05 10:14:01 +02:00
Lukasz Jobczyk
3e2acefac1 fix: Do not align svm gpu greater than its svm cpu
Resolves: HSD-18042781233

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-08-05 07:52:18 +02:00
Maciej Plewka
ced6c55caf fix: use alignment when allocate by win kmd
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-07-29 12:42:03 +02:00
Kindracki, Jakub Tomasz
a73d5724e3 feature: Return insufficient permissions when driver device cannot be loaded
Return ZE_RESULT_ERROR_INSUFFICIENT_PERMISSIONS when user doesn't have
permissions to access the GPU driver device file.

Related-To: NEO-8682
Signed-off-by: Kindracki, Jakub Tomasz <jakub.tomasz.kindracki@intel.com>
2025-07-28 16:31:07 +02:00