Commit Graph

822 Commits

Author SHA1 Message Date
Lukasz Jobczyk
a45a4ab44e refactor: Remove osContextId member from residency controller
Related-To: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-14 10:38:54 +02:00
Szymon Morek
f90f73e3e4 fix: don't create threads during process shutdown
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-13 18:09:41 +02:00
Lukasz Jobczyk
6515e422e9 refactor: move eviction container to residency controller
Related-To: NEO-13315

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-10-13 08:41:34 +02:00
shubham kumar
7a97b98cfe feature: Map PMT interface correctly on multi GPU system
Related-To: NEO-15912

Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-10-10 17:20:17 +02:00
Fabian Zwoliński
226846323f feature: add memsetAllocation helper with blitter support
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-10-10 15:12:17 +02:00
Radoslaw Jablonski
54de14a9dc refactor: apply clang-format's InsertBraces rule
Formats code before InsertBraces rule is enabled.

Signed-off-by: Radoslaw Jablonski <radoslaw.jablonski@intel.com>
2025-10-06 15:32:46 +02:00
Szymon Morek
ee032982a6 refactor: print faulted address when waiting for tag
getDeviceState on Windows prints faulted GPU VA
if OOB access happened.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-02 14:59:02 +02:00
Mateusz Jablonski
5b8e8b8b1a refactor: unify GmmMemory definition
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-10-01 14:23:35 +02:00
Marcel Skierkowski
047f6851f7 refactor: correct programming of SLM size
Unify reading hw avaialble slm size:
Pre-Xe2 SLMSizeInKb stores total SLM size across all DSS
Xe2+ SLMSizeInKb stores SLM size per SS

apply restrictions for preferred/programmable SLM size

Related-To: NEO-12949
Signed-off-by: Marcel Skierkowski <marcel.skierkowski@intel.com>
2025-09-30 17:57:18 +02:00
Mateusz Jablonski
3c13fb81f7 refactor: remove not needed logic
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-09-30 14:50:49 +02:00
Filip Hazubski
b73e85de0d refactor: Refactor direct submission logic
Remove ReleaseHelper::isDirectSubmissionSupported function.
Update ProductHelper::isDirectSubmissionSupported to return correct values.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2025-09-30 13:41:03 +02:00
Mateusz Hoppe
98fcaf4ceb feature: support for context group on Windows
Related-To: NEO-14289


Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-09-28 13:38:53 +02:00
Szymon Morek
5714c3858f fix: increase staging threshold for misaligned ptrs
Related-To: NEO-16118

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-09-22 12:46:58 +02:00
Jaroslaw Warchulski
195bf66a49 refactor: fix typos
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-09-22 12:46:41 +02:00
Maciej Bielski
e8d43ff074 fix: various small improvements
Related-To: NEO-15630

Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-09-19 13:42:36 +02:00
Mateusz Hoppe
0f657e8877 fix: allow creating hostptr allocations with GPU VA equal hostptr
- when host USM memory is allocated, gpu virtual address should be the
same as cpu address when chunking due to huge size is used

Related-To: GSD-11423

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-09-16 17:13:17 +02:00
Mateusz Jablonski
92316c8cd6 fix: don't setup notifyAubCapture callback when not needed
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-09-12 11:28:37 +02:00
Vysochyn, Illia
f4bd4e603d refactor: Use else if instead of nested else-if conditions
Replaces nested else-if with else if for consistency and readability.
No functional changes.

Signed-off-by: Vysochyn, Illia <illia.vysochyn@intel.com>
2025-09-11 16:20:59 +02:00
Mateusz Jablonski
ed15408592 fix: correct order of wddm initialization
init gmm after getting device and paging queue handles

Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-09-11 16:14:49 +02:00
Szymon Morek
03357b6089 performance: adjust size threshold for staging on linux
Related-To: NEO-15973

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-09-05 18:09:49 +02:00
Grochowski, Stanislaw
12fa26f202 refactor: remove kmdaf from codebase
Related-To: NEO-14800

Signed-off-by: Grochowski, Stanislaw <stanislaw.grochowski@intel.com>
2025-08-27 11:12:53 +02:00
Radoslaw Jablonski
393604ef80 refactor: numThreadsPerEu
Signed-off-by: Radoslaw Jablonski <radoslaw.jablonski@intel.com>
2025-08-25 11:31:49 +02:00
Neil R. Spruit
43ebc17e17 feature: Support for opaque IPC handles on Windows and Linux
- Added support for creating and managing opaque IPC NT handles in the
WDDM layer.
- Introduced a new flag `shareableWithoutNTHandle` to indicate if memory
can be shared without an NT handle.
- Updated the `isShareableMemory` method to accommodate this new flag.
- Added debug variable EnableShareableWithoutNTHandle to control the
behavior of sharing memory without NT handles until requested.
- Updated Linux path to enable sharing DMA Buf FDs between processes
for use in pidfd_getfd
- Updated getfd and get IPC Handle helper functions to support opaque or
previous versions

Related-To: NEO-15345 , NEO-15346 , NEO-15347, NEO-10380

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
2025-08-18 16:23:44 +02:00
Compute-Runtime-Validation
0855219087 Revert "feature: Support for opaque IPC handles on Windows and Linux"
This reverts commit 46b1b2783b.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-08-15 02:22:02 +02:00
Mateusz Jablonski
ec36dd6275 refactor: move gmm callbacks definition to common place
- merge all the callbacks to single template class
- store callback functions in global arrays
- partially reuse callbacks on Linux

Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-08-14 16:49:29 +02:00
Neil R. Spruit
46b1b2783b feature: Support for opaque IPC handles on Windows and Linux
- Added support for creating and managing opaque IPC NT handles in the
WDDM layer.
- Introduced a new flag `shareableWithoutNTHandle` to indicate if memory
can be shared without an NT handle.
- Updated the `isShareableMemory` method to accommodate this new flag.
- Added debug variable EnableShareableWithoutNTHandle to control the
behavior of sharing memory without NT handles until requested.
- Updated Linux path to enable sharing DMA Buf FDs between processes
for use in pidfd_getfd

Related-To: NEO-15345 , NEO-15346 , NEO-15347, NEO-10380

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
2025-08-14 08:33:56 +02:00
Compute-Runtime-Validation
6880014602 Revert "refactor: store gmm callback functions in global arrays"
This reverts commit a68ea38ba1.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-08-13 23:19:58 +02:00
Mateusz Jablonski
a68ea38ba1 refactor: store gmm callback functions in global arrays
Related-To: NEO-11080
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-08-13 14:12:23 +02:00
Jakub Nowacki
c4ab767797 fix: add missing NonCopyableAndNonMovable asserts
Related-To: NEO-15630

Signed-off-by: Jakub Nowacki <jakub.nowacki@intel.com>
2025-08-13 13:13:05 +02:00
Chandio, Bibrak Qamar
6acfcb83b9 Revert "Two commits related to pStart feature"
Related-To: NEO-15156, GSD-9939

Revert "test: fix minor errors"

This reverts commit 712dc8221e.

Revert "feature: Support for pStart"

This reverts commit 47caeda487.

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-13 07:10:40 +02:00
Chandio, Bibrak Qamar
47caeda487 feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint in zeVirtualMemReserve.

If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-06 12:40:29 +02:00
Compute-Runtime-Validation
c9456cda14 Revert "feature: Support for pStart"
This reverts commit a50c0dbecf.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-08-06 02:26:13 +02:00
Chandio, Bibrak Qamar
a50c0dbecf feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint in zeVirtualMemReserve.

If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-05 10:14:01 +02:00
Lukasz Jobczyk
3e2acefac1 fix: Do not align svm gpu greater than its svm cpu
Resolves: HSD-18042781233

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-08-05 07:52:18 +02:00
Maciej Plewka
ced6c55caf fix: use alignment when allocate by win kmd
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-07-29 12:42:03 +02:00
Kindracki, Jakub Tomasz
a73d5724e3 feature: Return insufficient permissions when driver device cannot be loaded
Return ZE_RESULT_ERROR_INSUFFICIENT_PERMISSIONS when user doesn't have
permissions to access the GPU driver device file.

Related-To: NEO-8682
Signed-off-by: Kindracki, Jakub Tomasz <jakub.tomasz.kindracki@intel.com>
2025-07-28 16:31:07 +02:00
Maciej Plewka
88fb60a515 fix: do not align to 64kb when requested alignment is bigger
Related-To: NEO-14082
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-07-22 19:32:29 +02:00
Eric Mortensen
69f2cda2fa fix: add error checks & return to unMapVirtualMem
Related-To: NEO-8566

Signed-off-by: Eric Mortensen <eric.mortensen@intel.com>
2025-07-17 23:53:19 +02:00
Compute-Runtime-Validation
a585cb45b7 Revert "fix: use alignment when allocate by kmd"
This reverts commit 72492a9a18.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-07-12 07:48:44 +02:00
Maciej Plewka
72492a9a18 fix: use alignment when allocate by kmd
Related-To: NEO-14082
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-07-09 15:16:12 +02:00
Aleksandra Nizio
6975f7bb8d fix: Disable compiler cache if any IGC_ env is set
Related-To: NEO-12721
Signed-off-by: Aleksandra Nizio <aleksandra.nizio@intel.com>
2025-07-07 09:55:49 +02:00
Lukasz Jobczyk
0b6789187a fix: Apply alignment when allocate by kmd
Resolves: HSD-18042740668

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-07-02 12:31:48 +02:00
Krzysztof Gibala
7ef630d202 fix: use 'w+' mode for gdi.log to prevent errors when file does not exist
Error encountered:
```markdown
Debug Assertion Failed!
File: minkernel\crts\ucrt\inc\corecrt_internal_stdio.h
Line: 686
Expression: ("Invalid file open mode", 0)
```

Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2025-07-01 12:26:07 +02:00
Lukasz Jobczyk
6efabacbfc fix: Align GPU shared allocation once with same alignment as CPU
Resolves: HSD-18042651670

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-06-25 15:52:05 +02:00
Jaroslaw Warchulski
2375ff89bb refactor: cleanup headers
Related-To: NEO-5548
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-06-23 11:23:49 +02:00
Maciej Bielski
d667614a4f fix: set gmm LocalOnly flag regardless of extraMemoryFlags
Related-To: NEO-13428
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-06-03 14:00:34 +02:00
Maciej Plewka
577c99fe9c fix: clear residency container when failed to make resident
Related-To: NEO-14143
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-05-29 14:56:35 +02:00
Mateusz Jablonski
72e1ec3b42 fix: pass additional adapter info caps to gmmlib for wddm windows
Related-To: HSD-18041684792
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2025-05-27 12:43:31 +02:00
Lukasz Jobczyk
a0f683e42b fix: Move evict after unlock to wddm layer
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-05-27 10:52:23 +02:00
Maciej Bielski
0f8ee57f98 feature: add NEO_LOCAL_MEMORY_ALLOCATION_MODE
Allow the application to force storageInfo.localOnly and get the
out-of-memory returned if not possible.

This is a windows-only feature supported on discrete platforms.

Related-To: NEO-13428
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-05-20 14:15:17 +02:00