Commit Graph

480 Commits

Author SHA1 Message Date
Grochowski, Stanislaw
6a8b20edb8 fix: add media context helper
Related-To: NEO-16154

Signed-off-by: Grochowski, Stanislaw <stanislaw.grochowski@intel.com>
2025-10-16 15:26:08 +02:00
Chandio, Bibrak Qamar
49020f234d feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint on zeVirtualMemReserve.
If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-10-16 00:22:00 +02:00
Fabian Zwoliński
226846323f feature: add memsetAllocation helper with blitter support
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-10-10 15:12:17 +02:00
Szymon Morek
4df9783448 performance: use 2MB heaps for 2MB-aligned allocations
Related-To: NEO-16165

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-10-06 18:11:01 +02:00
Radoslaw Jablonski
54de14a9dc refactor: apply clang-format's InsertBraces rule
Formats code before InsertBraces rule is enabled.

Signed-off-by: Radoslaw Jablonski <radoslaw.jablonski@intel.com>
2025-10-06 15:32:46 +02:00
Chandio, Bibrak Qamar
cf21cbc910 feature: Complete madvise for System Allocator
Related-To: NEO-13715

Provides implmentation of getAtomicAccessAttribute using system
allocator.
Completes the implementation of the madvise feature using the
new IOCTLs in xe_drm header.

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-09-23 16:00:35 +02:00
Jaroslaw Warchulski
195bf66a49 refactor: fix typos
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-09-22 12:46:41 +02:00
Grochowski, Stanislaw
93d98c528d fix: check interrupt support when allocating and releasing
Related-To: HSD-18043299783


Signed-off-by: Grochowski, Stanislaw <stanislaw.grochowski@intel.com>
2025-09-19 10:36:18 +02:00
Szymon Morek
228da24b38 performance: align alloc size to 2MB on XeKMD/iGPU
Related-To: NEO-15905

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-08-25 15:37:59 +02:00
Chandio, Bibrak Qamar
6acfcb83b9 Revert "Two commits related to pStart feature"
Related-To: NEO-15156, GSD-9939

Revert "test: fix minor errors"

This reverts commit 712dc8221e.

Revert "feature: Support for pStart"

This reverts commit 47caeda487.

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-13 07:10:40 +02:00
Chandio, Bibrak Qamar
47caeda487 feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint in zeVirtualMemReserve.

If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-06 12:40:29 +02:00
Compute-Runtime-Validation
c9456cda14 Revert "feature: Support for pStart"
This reverts commit a50c0dbecf.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-08-06 02:26:13 +02:00
Chandio, Bibrak Qamar
a50c0dbecf feature: Support for pStart
Related-To: NEO-15156, GSD-9939

Support for start address hint in zeVirtualMemReserve.

If it fails to find pStart then it defaults to the base line
allocateWithCustomAlignment(...)

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-08-05 10:14:01 +02:00
Maciej Plewka
2c287c7c3b fix: allow to use bigger alignment than 2mb on linux
Related-To: NEO-14082
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-08-04 11:38:50 +02:00
Slawomir Milczarek
fa4fd26be2 fix: Add missing registration of allocation from shared handle to smem
Related-To: NEO-12952

Fixes debug assert triggered in unregisterAllocation()
for GPU_TIMESTAMP_DEVICE_BUFFER imported from shared handle:Y
DEBUG_BREAK_IF(allocation->getUnderlyingBufferSize() > sysMemAllocsSize);

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-08-04 09:00:11 +02:00
Neil R. Spruit
b4f37f3a98 fix: Allocate debug surface and isa as BO instead of userptr
Related-To: NEO-14269

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
2025-07-31 20:24:54 +02:00
Eric Mortensen
69f2cda2fa fix: add error checks & return to unMapVirtualMem
Related-To: NEO-8566

Signed-off-by: Eric Mortensen <eric.mortensen@intel.com>
2025-07-17 23:53:19 +02:00
Maciej Plewka
12ab2131d8 fix: use alignment when allocate by linux kmd
Related-To: NEO-14082
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-07-14 09:29:41 +02:00
Fabian Zwoliński
0bca8782c2 fix: resolve SVM allocation size mismatch for 2MB pages
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-07-08 13:32:01 +02:00
Krzysztof Sprzaczkowski
5a057bbd46 feature: Add PCI barrier mmap logic for xe
Related-To: NEO-13081
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
Signed-off-by: Krzysztof Sprzaczkowski <krzysztof.sprzaczkowski@intel.com>
2025-07-01 16:32:54 +02:00
Chandio, Bibrak Qamar
c1867ed981 feature: atomic attributes for shared system alloc
Related-To: NEO-13715, NEO-14862

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-06-23 20:14:47 +02:00
Brandon Yates
4f711cf5d8 performance: skip resource registration when debugging disabled
Related-to: NEO-15147

Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2025-06-16 22:53:28 +02:00
Brandon Yates
540fa19894 fix: mark resources for capture even when debugger is not init
Some allocations are created before debugger is initialized. This change
will ensure they get marked for capture.

Debugger Enabled check added to bind path where capture flag is set

Related-to: GSD-10856

Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2025-06-04 16:21:22 +02:00
Slawomir Milczarek
0b46fb9f0d refactor: Add allocation type parameter to ioctl helper functions
Related-To: NEO-12952

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-05-21 17:06:33 +02:00
Maciej Bielski
0f8ee57f98 feature: add NEO_LOCAL_MEMORY_ALLOCATION_MODE
Allow the application to force storageInfo.localOnly and get the
out-of-memory returned if not possible.

This is a windows-only feature supported on discrete platforms.

Related-To: NEO-13428
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-05-20 14:15:17 +02:00
Szymon Morek
23c817803d performance: enable compression for iGPU on linux
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-05-19 16:20:37 +02:00
Lukasz Jobczyk
cca51ce3e5 fix: Add shared VA surface to ulls light residency
Resolves: GSD-11126

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-05-14 08:30:55 +02:00
Lukasz Jobczyk
1d1414febc refactor: remove unused dc flush mitigation
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-05-09 08:26:26 +02:00
Szymon Morek
6ae43123f6 fix: correct usages of ULLS-related resources
Related-To: NEO-14360

Current gmm usage type of these resources is causing
them to be cached, which is incorrect.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-05-08 12:12:45 +02:00
Lukasz Jobczyk
f36e3c7d23 refactor: Disable gem close worker in ULTs
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-23 17:58:18 +02:00
Chandio, Bibrak Qamar
bed2ad1ac0 feature: memAdise for System Allocator
Related-To: NEO-13715

Implements basic functionality for zeCommandListAppendMemoryAdvise for
system allocator

Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-04-16 07:11:14 +02:00
Tomasz Biernacik
194c3058b8 performance: change usage for ringBuffer on integrated devices
Related-To: NEO-9421

Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-04-14 12:25:38 +02:00
Fabian Zwoliński
363aa8cdbd performance: align local memory Tag allocations to 2MB
Align local memory allocations of tag types to 2MB when
2MB alignment is enabled via the product helper
(is2MBLocalMemAlignmentEnabled flag).

Refactored the allocateGraphicsMemoryInDevicePool function to improve
readability and maintainability. Simplified the logic for
determining base size and final alignment by reducing redundant code.

Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-04-09 09:59:44 +02:00
Lukasz Jobczyk
5bcf500c13 fix: Extend ULLS light mutex range
If some operatioins requires ULLS light stop, execute such operations
under mutex in pair with ULLS stop to ensure no other thread will start
ULLS.

Related-To: NEO-14406, NEO-13922

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-07 17:35:04 +02:00
Lukasz Jobczyk
deca36fd32 fix: Stop ULLS light when evict resource
Related-To: NEO-14406

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-02 16:37:43 +02:00
Szymon Morek
3fff3dd77b fix: set misaligned source memory 1-way coherent
Related-To: NEO-14443

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-28 14:16:45 +01:00
Compute-Runtime-Validation
88a48f1c5b Revert "performance: Improve ULLS light residency management"
This reverts commit 35eae3f977.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-03-28 11:21:27 +01:00
Lukasz Jobczyk
35eae3f977 performance: Improve ULLS light residency management
-skip bo::wait if completion fence not needed
-do not restart exec on evict

Related-To: NEO-13922

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-24 17:48:55 +01:00
Szymon Morek
bb10290828 fix: make misaligned user memory 2-Way coherent
Related-To: NEO-9004

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-21 17:56:37 +01:00
Lukasz Jobczyk
6cb52f71b4 fix: Avoid mutex deadlock when switch ulls light ring buffer
Related-To: NEO-14406

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-19 11:47:40 +01:00
John Falkowski
4d281cf51d feature: Implement appendMemoryPrefetch for Shared System USM allocations
Related-To: NEO-12989

Signed-off-by: John Falkowski <john.falkowski@intel.com>
2025-03-13 06:26:38 +01:00
Compute-Runtime-Validation
fa2e3adad3 Revert "feature: Implement appendMemoryPrefetch for Shared System USM Allocat...
This reverts commit 97799b3faf.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-03-12 05:55:32 +01:00
Compute-Runtime-Validation
0d5baa2c30 Revert "performance: Cache timestamps on CPU"
This reverts commit 83637404bf.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2025-03-12 04:41:46 +01:00
Lukasz Jobczyk
83637404bf performance: Cache timestamps on CPU
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-11 13:40:18 +01:00
John Falkowski
97799b3faf feature: Implement appendMemoryPrefetch for Shared System USM Allocations
Related-To: NEO-12989

Signed-off-by: John Falkowski <john.falkowski@intel.com>
2025-03-11 09:12:48 +01:00
Fabian Zwoliński
f5e37e725c Revert "fix: configure ISA Pool params based on productHelper"
This reverts commit bf20ae7ae8.

Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-03-10 22:41:13 +01:00
Tomasz Biernacik
1aa418ec15 performance: override cacheable value passed to gmm on linux
Related-To: NEO-9421

Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-03-06 21:45:01 +01:00
Tomasz Biernacik
92512fdc64 fix: preserve allocation type for memory object
Related-To: NEO-9421

Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-03-05 14:48:57 +01:00
Fabian Zwoliński
bf20ae7ae8 fix: configure ISA Pool params based on productHelper
When is2MBLocalMemAlignmentEnabled returns true,
increase pool size for builtins from 64k to 2MB.

Additionally, set appropriate alignment for kernel ISA heap allocations.
Additionally, configure isaAllocationPageSize based on productHelper

Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-02-20 08:42:35 +01:00
Lukasz Jobczyk
051f7928f1 performance: tiny improvements for ULLS light
Related-To: NEO-13922

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-02-17 23:52:33 +01:00