9d47247ef0
refactor: add product helper for blit properties
...
Created a new function in ProductHelper to determine whether the
additional blit properties can be used.
Related-To: NEO-13003
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2025-05-01 18:05:48 +02:00
0c3b765942
Revert "refactor: add BlitSyncPropertiesExt to BlitSyncProperties"
...
This reverts commit b5a259aded
2025-05-01 03:23:53 +02:00
b5a259aded
refactor: add BlitSyncPropertiesExt to BlitSyncProperties
...
Added BlitSyncPropertiesExt to provide additional information for
different platform and/or blitter commands.
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2025-04-30 19:11:34 +02:00
70eb6716ae
refactor: Page align and size for prefetch
...
Resolves: NEO-12989
Signed-off-by: John Falkowski <john.falkowski@intel.com>
2025-04-30 06:46:35 +02:00
cb4443a545
refactor: Add a new getter to product helper
...
Related-To: NEO-12952
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-04-29 13:02:16 +02:00
41efee1e7c
feature: add mode to expose single root device
...
- simplify API to expose and use only single root device. Disallow
returning subdevices. This is experimental mode.
Related-To: NEO-14559
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-04-25 13:20:56 +02:00
a75f1434b0
performance: Store vm bind available in drmCsr
...
Resolves: GSD-10986
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-24 15:45:05 +02:00
a97a66506f
refactor: Add ioctl helper to get primary context properties
...
Related-To: NEO-12952
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-04-24 14:27:25 +02:00
71f81c786f
fix: correct sysman engine query
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2025-04-24 13:00:32 +02:00
c1df81c9be
refactor: Simplify handles destroy
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-24 11:13:18 +02:00
8ec5688ca1
Revert "performance: extend usage of staging buffers"
...
This reverts commit 6a4ddf5dfb
2025-04-24 11:02:27 +02:00
ab1f39f07f
refactor: Remove ioctl helper for context destruction
...
Related-To: NEO-12952
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-04-24 10:53:04 +02:00
d28fcdb55b
Revert "refactor: Simplify handles destroy"
...
This reverts commit 8776bdba2f
2025-04-24 05:51:18 +02:00
f36e3c7d23
refactor: Disable gem close worker in ULTs
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-23 17:58:18 +02:00
8776bdba2f
refactor: Simplify handles destroy
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-23 14:30:37 +02:00
53f0832614
fix: Register shared handle size on windows
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-23 13:00:27 +02:00
6a4ddf5dfb
performance: extend usage of staging buffers
...
Related-To: NEO-14026
Move enabling from xe2 to xe2_and_later
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-04-22 16:46:52 +02:00
d510f742da
fix: Pass Deallocate2 callback to gmm
...
Resolves: HSD-18041541320
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-22 12:08:56 +02:00
297d4c99e8
refactor: Add missing const identifier
...
Related-To: NEO-12952
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-04-22 10:41:28 +02:00
a2d25ca31f
feature: Add syscall wrappers for pidfdopen and pidfdgetfd
...
Related-To: NEO-12952
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-04-17 19:50:39 +02:00
3596522637
refactor: remove unused logic in ULLS controller
...
Related-To: NEO-13843
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-04-17 18:35:20 +02:00
1816c8eac4
fix: avoid joining thread in deferred deleter
...
Join thread in DllMain (which we are not aware of)
can result in hang occurring in DeferredDeleter, if the library is
freed before FreeLibraryAndExitThread call from within the worker thread,
the thread gets stuck, thus the main thread is stuck on worker->join().
Related-To: NEO-14121
Signed-off-by: Oskar Hubert Weber <oskar.hubert.weber@intel.com>
2025-04-17 16:17:42 +02:00
ee769f5983
fix: Add texture cache flush after kernels writing to images on imm cmdlists
...
- add `hasImageWriteArg` flag to KernelDescriptor,
based on image access qualifier
- add `isPostImageWriteFlushRequired` method to productHelper,
to require cache flush only on selected platforms
- if possible, add the `textureCacheInvalidationEnable` arg to the
existing PC, otherwise add a new PC
Related-To: NEO-13427, HSD-18041321008
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-04-17 16:04:31 +02:00
d9a40734ae
performance: Remove global fence from CW post sync on BMG
...
Related-To: NEO-14642
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-17 10:23:40 +02:00
331b515478
Revert "fix: avoid joining thread in deferred deleter"
...
This reverts commit 38a3667304
2025-04-16 15:18:27 +02:00
38a3667304
fix: avoid joining thread in deferred deleter
...
Join thread in DllMain (which we are not aware of)
can result in hang occurring in DeferredDeleter, if the library is
freed before FreeLibraryAndExitThread call from within the worker thread,
the thread gets stuck, thus the main thread is stuck on worker->join().
Related-To: NEO-14121
Signed-off-by: Oskar Hubert Weber <oskar.hubert.weber@intel.com>
2025-04-16 10:02:10 +02:00
bed2ad1ac0
feature: memAdise for System Allocator
...
Related-To: NEO-13715
Implements basic functionality for zeCommandListAppendMemoryAdvise for
system allocator
Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-04-16 07:11:14 +02:00
5bf8b66498
feature: disable getting fd from vmExport
...
Related-To: NEO-12680
Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-04-15 16:08:40 +02:00
06e375fdc6
refactor: Add debug break for partial make resident
...
Resolves: NEO-13711
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-15 14:59:28 +02:00
31f0fd4672
refactor: rename variable slmSize
...
Max programmable slm size is stored in RuntimeCapabilityTable as slmSize.
That is misleading name
Rename the variable slmSize to better reflect the actual meaning of the member.
Related-To: NEO-12949
Signed-off-by: Marcel Skierkowski <marcel.skierkowski@intel.com>
2025-04-14 20:00:29 +02:00
6ecf5b373e
feature: exit with warning if small bar detected on Linux
...
Return early and provide justification, otherwise SIGBUS error is
returned.
Related-To: NEO-14506
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-04-14 14:43:25 +02:00
194c3058b8
performance: change usage for ringBuffer on integrated devices
...
Related-To: NEO-9421
Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-04-14 12:25:38 +02:00
18435df04c
fix: unify deferring MOCS to PAT
...
Related-To: NEO-14643
Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-04-11 20:10:25 +02:00
363aa8cdbd
performance: align local memory Tag allocations to 2MB
...
Align local memory allocations of tag types to 2MB when
2MB alignment is enabled via the product helper
(is2MBLocalMemAlignmentEnabled flag).
Refactored the allocateGraphicsMemoryInDevicePool function to improve
readability and maintainability. Simplified the logic for
determining base size and final alignment by reducing redundant code.
Related-To: NEO-12287
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2025-04-09 09:59:44 +02:00
c7fe7dde90
fix: Correct Xe sysfs paths for ccs mode setting
...
Fix the sysfs paths for Xe KMD
Related-To: NEO-10378
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2025-04-09 06:51:18 +02:00
5bcf500c13
fix: Extend ULLS light mutex range
...
If some operatioins requires ULLS light stop, execute such operations
under mutex in pair with ULLS stop to ensure no other thread will start
ULLS.
Related-To: NEO-14406, NEO-13922
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-07 17:35:04 +02:00
df07897144
fix: forbid compression for pre-xe2 platforms
...
Related-To: NEO-9465
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-04-05 00:15:16 +02:00
f99870e716
fix: improve media handling 2
...
Related-To: NEO-14462
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2025-04-03 19:11:53 +02:00
7e7e0a000f
refactor: Add ioctl helper for context destruction
...
Related-To: NEO-11817
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-04-03 16:08:53 +02:00
c010d17842
fix: respect compression flag in capability table
...
Related-To: NEO-9465
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-04-03 15:36:55 +02:00
62baf28316
fix: remove unnecesarry WA for DG2 compression
...
Related-To: NEO-9465
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-04-03 08:04:19 +02:00
4651e72b0b
fix: Fail device init if kernel debugging is misconfigured
...
Also print error to stderr
Related-to: GSD-10780
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2025-04-02 21:06:30 +02:00
deca36fd32
fix: Stop ULLS light when evict resource
...
Related-To: NEO-14406
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-04-02 16:37:43 +02:00
3a7d7e022c
fix: Add platform support for reservation on svm heap
...
Related-To: GSD-10816
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2025-04-02 02:46:30 +02:00
2ba2970492
performance: Waiting on make resident Windows
...
Related-To: NEO-14056
No need to explicitly wait on Windows KMD during make resident as it has
a while loop that does it nevertheless. The KMD wait affects the API
overhead of zeCommandQueueExecuteCommandLists some platforms (MTL, and ARL).
Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2025-04-01 00:12:45 +02:00
831b488685
fix: improve media engine handling
...
Related-To: NEO-14462
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2025-03-31 10:40:21 +02:00
a5e19330e9
fix: lock csr before locking residency controller in trim to budget path
...
Lock on csr is needed before lock on residency controller to prevent
incorrect lock order. Csr may be locked in waitOnCpu called from trimToBudget,
which may lead to deadlocks
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-03-28 16:18:20 +01:00
3fff3dd77b
fix: set misaligned source memory 1-way coherent
...
Related-To: NEO-14443
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-28 14:16:45 +01:00
88a48f1c5b
Revert "performance: Improve ULLS light residency management"
...
This reverts commit 35eae3f977
2025-03-28 11:21:27 +01:00
b43b23b6ed
fix: Init wait utils after hwInfo init for both OS
...
Resolves: HSD-18041922513
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-27 16:45:22 +01:00
85f2734ca4
fix: correct gt_id to tile_id engine mapping
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2025-03-27 15:57:57 +01:00
a89113fa1a
Revert "fix: Fail device init if kernel debugging is misconfigured"
...
This reverts commit c122bc51f9
2025-03-26 13:27:12 +01:00
eeeed9edd8
refactor: cleanup in product helpers
...
Related-To: NEO-12681
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-03-25 21:07:55 +01:00
c122bc51f9
fix: Fail device init if kernel debugging is misconfigured
...
Also print error to stderr
Related-to: GSD-10780
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2025-03-25 20:40:25 +01:00
1230ab99aa
refactor: adjust product helper file name after pre-gen12 removal
...
Related-To: NEO-12681
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-03-25 15:57:46 +01:00
cb2add406e
fix: do not use ftrE2ECompression flag for xe2+
...
Related-To: NEO-9465
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-03-25 09:29:50 +01:00
35eae3f977
performance: Improve ULLS light residency management
...
-skip bo::wait if completion fence not needed
-do not restart exec on evict
Related-To: NEO-13922
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-24 17:48:55 +01:00
f67663d863
fix(sysman): Create Engine Handles for multiple gt w.r.t Xe driver
...
For the Xe driver, a single tile can have multiple gts. Now the Engine
handles are created for multiple gts available on the single tile as in
the case for the Xe driver.
Related-To: NEO-14401
Signed-off-by: Pratik Bari <pratik.bari@intel.com>
2025-03-24 17:14:02 +01:00
42ced7f5eb
refactor: add NotLockable param print
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2025-03-24 16:22:21 +01:00
bb10290828
fix: make misaligned user memory 2-Way coherent
...
Related-To: NEO-9004
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-21 17:56:37 +01:00
724ba20e41
fix: Parse CCS mode setting for non PVC platforms
...
Related-To: GSD-8785
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2025-03-19 12:47:46 +01:00
6cb52f71b4
fix: Avoid mutex deadlock when switch ulls light ring buffer
...
Related-To: NEO-14406
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-19 11:47:40 +01:00
2e729bcb4c
refactor: move isTimestampWaitSupportedForQueues to productHelper
...
Related-to: NEO-13163
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-03-19 09:31:33 +01:00
b9df406a46
refactor: remove minGen field and pregen12 platform cases
...
Related-To: NEO-12681
Signed-off-by: Michał Pryba <michal.pryba@intel.com>
2025-03-18 12:49:34 +01:00
36fa6d66ae
fix: lock csr in stopDirectSubmission if needed
...
Related-To: NEO-13875, NEO-14143, HSD-16026538384, HSD-16026780358
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2025-03-18 09:30:38 +01:00
a7c46b8213
feature: support L2 cache reservation
...
Related-To: NEO-12837
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-03-17 19:41:55 +01:00
9d052cd8ee
fix: pass rootDevice when creating secondary contexts
...
- fix initialization of gfxCoreHelper in drm and wddm
Related-To: NEO-7824, NEO-8171
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-03-17 16:03:27 +01:00
9c8ced8c78
fix: device ids missmatch error print
...
Related-To: NEO-12845
Signed-off-by: Wojciech Konior <wojciech.konior@intel.com>
2025-03-17 12:58:12 +01:00
d54b74e8bd
Revert "fix: Parse CCS mode setting for non PVC platforms"
...
This reverts commit 5ca78dfdd1
2025-03-17 00:30:44 +01:00
5ca78dfdd1
fix: Parse CCS mode setting for non PVC platforms
...
Related-To: GSD-8785
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2025-03-15 01:39:51 +01:00
afcbebef0b
Revert "performance: configure Xe2 compression"
...
This reverts commit ec7821ed84
2025-03-14 11:25:20 +01:00
13db35c35f
Revert "fix: set correct default value of cacheable flag"
...
This reverts commit a8d9e7ed35
2025-03-13 20:38:57 +01:00
a8d9e7ed35
fix: set correct default value of cacheable flag
...
Related-To: NEO-9421
Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-03-13 18:26:02 +01:00
4d281cf51d
feature: Implement appendMemoryPrefetch for Shared System USM allocations
...
Related-To: NEO-12989
Signed-off-by: John Falkowski <john.falkowski@intel.com>
2025-03-13 06:26:38 +01:00
e287174211
feature: Add EU stall support for xe2/xe3 core
...
Related-To: NEO-13777
Signed-off-by: shubham kumar <shubham.kumar@intel.com>
2025-03-12 23:10:24 +01:00
fa2e3adad3
Revert "feature: Implement appendMemoryPrefetch for Shared System USM Allocat...
...
This reverts commit 97799b3faf
2025-03-12 05:55:32 +01:00
0d5baa2c30
Revert "performance: Cache timestamps on CPU"
...
This reverts commit 83637404bf
2025-03-12 04:41:46 +01:00
4890150e12
feature: add method adjustMaxThreadsPerThreadGroup to product helper
...
Related-To: HSD-18028334016, HSD-14022274275
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2025-03-11 15:47:57 +01:00
a86105814d
fix: default initialize allocated memory when memory is overwritten
...
Related-To: NEO-5093
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2025-03-11 15:32:33 +01:00
83637404bf
performance: Cache timestamps on CPU
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-11 13:40:18 +01:00
97799b3faf
feature: Implement appendMemoryPrefetch for Shared System USM Allocations
...
Related-To: NEO-12989
Signed-off-by: John Falkowski <john.falkowski@intel.com>
2025-03-11 09:12:48 +01:00
f5e37e725c
Revert "fix: configure ISA Pool params based on productHelper"
...
This reverts commit bf20ae7ae8
2025-03-10 22:41:13 +01:00
ec7821ed84
performance: configure Xe2 compression
...
Related-To: NEO-9421
Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-03-10 15:40:00 +01:00
6ee39ed94c
Revert "fix: Fail device init if kernel debugging is misconfigured"
...
This reverts commit b0c92ea425
2025-03-10 12:23:07 +01:00
b0c92ea425
fix: Fail device init if kernel debugging is misconfigured
...
Also print error to stderr
Related-to: GSD-10780
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2025-03-08 05:02:42 +01:00
8e251ed274
refactor: Extended drm wrapper with primary context export / import handle
...
Related-To: NEO-12952
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2025-03-07 15:17:34 +01:00
413194bd2a
Revert "fix: do not prefer image compression on xe_lpg for linux and WSL"
...
This reverts commit 8814b6ac4f
2025-03-07 11:38:46 +01:00
8ad6a7a86b
feature: unify local memory size getter for i915 and xe
...
Previously i915 was using a sysfs node to query the amount of local
memory of a tile. For xe such sysfs node does not exist so the function
was useless.
Instead of a sysfs node, leverage the local memory size present in
MemoryInfo (queried at init-stage) so that the output is now the same
for both i915 and xe.
Related-To: NEO-11127
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2025-03-07 09:50:19 +01:00
f08b32761e
fix: avoid race when evicting resources
...
Related-To: NEO-13843
DrmMemoryOperationsHandler::mutex is used for residency
handling.
However, this mutex is not being locked during eviction when vm bind
failed.
This is causing races for example when ULLS controller wants to make
resources resident, and user thread wants to evict
them.
Fix is to explicitly obtain lock in problematic path.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-07 07:01:41 +01:00
1aa418ec15
performance: override cacheable value passed to gmm on linux
...
Related-To: NEO-9421
Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-03-06 21:45:01 +01:00
61fe9ebb8f
performance: Allow power efficient waits with ULLS light
...
Resolves: HSD-18041633458
Related-To: NEO-13922
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2025-03-06 14:20:58 +01:00
82fba79d9d
performance: set 1ms timeout for ulls controller on LNL and PTL
...
Related-To: NEO-13843
Limit scope to Windows only.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-06 09:13:58 +01:00
4c795027e3
refactor: add check if event L3 flush is needed
...
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2025-03-05 18:25:29 +01:00
92512fdc64
fix: preserve allocation type for memory object
...
Related-To: NEO-9421
Signed-off-by: Tomasz Biernacik <tomasz.biernacik@intel.com>
2025-03-05 14:48:57 +01:00
98d1d629a8
Revert "feature: Enable defer backing by default"
...
This reverts commit fffe8f8027
2025-03-05 03:35:03 +01:00
ff4da67979
fix: signal notify field before KMD wait
...
Related-To: NEO-13870
Currently all monitor fences are triggering
interrupt due to Notify Enable field.
With this change, such field is programmed
right before KMD wait.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-03-04 15:19:16 +01:00
fffe8f8027
feature: Enable defer backing by default
...
Related-To: NEO-13403
Signed-off-by: Bellekallu Rajkiran <bellekallu.rajkiran@intel.com>
2025-03-04 14:29:53 +01:00
1876a43024
performance: add low latency hint for i915
...
i915 has provided the low latency hint interface, it helps
improve the performance for light workload a lot.
Related-To: NEO-14250
Signed-off-by: Chuansheng Liu <chuansheng.liu@intel.com>
2025-03-04 11:14:04 +01:00
8814b6ac4f
fix: do not prefer image compression on xe_lpg for linux and WSL
...
Related-To: HSD-18034872015
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2025-02-28 14:20:57 +01:00
c02dc8208c
Revert "fix: do not enable compression on xe_lpg"
...
This reverts commit a6abda83a4
2025-02-27 03:15:32 +01:00
Young Jin Yoon