80f75ceace
fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-09-23 14:43:59 +02:00
3fa5504a5d
Revert "performance: Override cacheable for timestampPacketTagBuffer"
...
This reverts commit ec75f8f686
2024-09-21 04:19:24 +02:00
354bef70ac
feature: Add ioctl helper function to get fence address
...
Related-To: NEO-11817
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2024-09-20 19:30:10 +02:00
ec75f8f686
performance: Override cacheable for timestampPacketTagBuffer
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-20 16:03:50 +02:00
d7ce841081
fix: InOrderExecInfo upload to tbx
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-20 16:03:09 +02:00
4a068c8eab
fix: correclty program StateBaseAddress in global bindless mode
...
- prepare bindful ssh when kernel requires ssh heap and
SurfaceStateBaseAddress
- remove lastAppendedKernelBindlesMode - local ssh heap may be needed
for bindless kernels with scratch or misaligned buffer args
- use ssh heap gpu address to program SurfaceStateBaseAddress, global base is
used for BindlessSurfaceState and DynamicState
Related-To: NEO-7063
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-20 11:57:05 +02:00
363aca782f
refactor: remove not needed code.
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-19 18:50:16 +02:00
18a7a5f6fa
refactor: update hw cmds base from gen8 to gen12lp
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-19 18:07:46 +02:00
a890ed5648
performance: Ensure hostptrs removed before creating new one
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-19 14:34:19 +02:00
7b54ca131f
fix: avoid OOB access in StackVec::resizeImpl
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-19 13:54:24 +02:00
e4d2f16632
Revert "performance: Ensure hostptrs removed before creating new one"
...
This reverts commit ac1d203555
2024-09-18 19:31:34 +02:00
ac1d203555
performance: Ensure hostptrs removed before creating new one
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-18 14:23:16 +02:00
ebc19b4a70
feature: Add logic to disable bindless addressing via AIL
...
Add mockable Device functions to get ReleaseHelper and AILConfiguration.
Resolves: NEO-12699
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-09-18 13:49:51 +02:00
ec5beaf616
refactor: reduce csr class size
...
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-18 13:33:55 +02:00
d2bf3e4431
refactor: remove not needed volatile keywords
...
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-18 11:54:38 +02:00
25f2504bf5
fix: set eudebug extension property when debugging enabled
...
In order to debug on XE, XE_EXEC_QUEUE_SET_PROPERTY_EUDEBUG
needs to be set up.
Related-To: NEO-12691
Signed-off-by: Jitendra Sharma <jitendra.sharma@intel.com>
2024-09-18 08:32:03 +02:00
86a088e13f
feature: move L3 bank query from xe-prelim to xe-nonprelim path
...
Related-To: NEO-11125
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-17 18:14:17 +02:00
64c935a594
fix: Do not defer external hostptr destroy
...
Resolves: NEO-12567
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-17 14:54:01 +02:00
9b68736074
fix: Fix check for sysfs entry at debugger init time
...
Related-to: NEO-12656
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2024-09-17 13:42:49 +02:00
7ce0ef9e82
fix: dont create preemption allocation for secondary csr
...
Related-To: NEO-8171
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-17 13:42:05 +02:00
5912b43841
refactor: remove dead code
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-17 13:41:50 +02:00
135c0b43ae
performance: Use copy rect middle on LNL Windows
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-17 10:30:03 +02:00
4b132245d1
fix: use immediate for makeMemoryResident
...
Modified to enable immediate flag when resident boolean
is true for vm_bind
Related-To: NEO-8277
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2024-09-17 07:48:58 +02:00
73382b9b6c
refactor: remove legacy code
...
Related-To: NEO-6683
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2024-09-16 19:04:13 +02:00
d3d8b5fcc1
fix: inherit work partition allocation from primary root csr
...
Related-To: NEO-8171
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-16 18:45:16 +02:00
a7a28a5e0b
Revert "fix: disable global allocator"
...
This reverts commit db5f77d207
2024-09-16 18:45:01 +02:00
6e0aa1781c
refactor: modify kernel helper method to pass kernel data directly
...
Related-To: NEO-12639
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-09-16 16:25:13 +02:00
d5812f49d7
refactor: remove not needed vme builtin related code
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-16 15:27:49 +02:00
8e7959b243
refactor: remove not needed code
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-16 14:55:55 +02:00
ab090b515c
refactor: remove not needed code
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-16 14:20:35 +02:00
f14af782b3
fix: Correct mirroring module debug area
...
Resolves: NEO-11883
Signed-off-by: Jemale Lockett <jemale.lockett@intel.com>
2024-09-16 12:31:23 +02:00
78604bd475
refactor: remove not needed code
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-16 12:12:43 +02:00
6263b9599f
feature: Enabling Blitter offset for Remap
...
Related-To: NEO-11934
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-09-16 09:04:28 +02:00
39aa702806
fix: disable usm host recycle, PVC
...
Related-To: NEO-12633
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-16 06:37:33 +02:00
33364baae7
fix: Use prelim prefix for xe debug sysfs file name
...
Related-to: NEO-7979
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2024-09-13 23:23:22 +02:00
3bd2befe74
refactor: indirect detection helpers, VC
...
Allow for different required version for VC compiled kernels.
Define constant for detection disabled.
Related-To: NEO-12491
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-13 19:42:57 +02:00
ebfa384a74
fix: avoid calling free on non-heap object
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-13 16:34:23 +02:00
8698b5504b
fix: correctly initialize GfxCoreHelper from HwInfo
...
Related-To: NEO-11983
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-13 14:54:32 +02:00
db5f77d207
fix: disable global allocator
...
- disables bindless images
Related-To: NEO-7063, NEO-11533
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-13 14:41:31 +02:00
f58b5b6ac3
Revert "feature: Enabling Blitter Remapping for REGISTER_MEM"
...
This reverts commit d4f59c1b09
2024-09-12 23:50:59 +02:00
27c7fbc611
feature: set error description in os_interface/linux
...
Added setErrorDescription for drm_buffer_object, drm_memory_manager,
and ioctl_helper_prelim
Related-To: NEO-12456
Signed-off-by: Chandio, Bibrak Qamar <bibrak.qamar.chandio@intel.com>
2024-09-12 18:48:41 +02:00
05250e7460
fix: Remove patchtokens fallback AIL
...
Related-To: NEO-12358
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-09-12 18:26:19 +02:00
f6a89bbc03
fix: initialize debugger before creating engines
...
Related-To: NEO-12571
Signed-off-by: Jitendra Sharma <jitendra.sharma@intel.com>
2024-09-12 18:12:12 +02:00
dd631610b3
refactor: move memory tracking to memory manager
...
- remove wddm specific code
- improve total size reported to be in decimal
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-12 17:32:38 +02:00
c0d9cb4d84
Revert "feature: Enabling Blitter Remapping for REGISTER_REG"
...
This reverts commit 4f2e61841f
2024-09-12 16:43:46 +02:00
18147e22f8
fix: Remove patchtokens fallback AIL for ArcControl
...
Related-To: NEO-12358
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-09-12 14:38:40 +02:00
4a375c80e7
refactor: modernize unique_ptr initialization
...
Related-To: NEO-12634
Signed-off-by: Wojciech Konior <wojciech.konior@intel.com>
2024-09-12 14:30:59 +02:00
b7dfc5c1de
refactor: remove not used code
...
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-09-12 13:40:11 +02:00
29bd2763f1
refactor: Move debug key to correct category
...
Related-To: NEO-11817
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2024-09-12 12:49:40 +02:00
da59b88122
refactor: improve logging of allocations
...
add capability to measure total amount of allocated memory
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-12 11:00:27 +02:00
7cba813c81
refactor: improve logging by adding size.
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-11 20:33:55 +02:00
ddce122991
fix: dont program NP state in ULLS if heapless state init is enabled
...
Related-To: HSD-13012223827
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-11 19:32:18 +02:00
4f2e61841f
feature: Enabling Blitter Remapping for REGISTER_REG
...
Related-To: NEO-11934
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-09-11 19:02:16 +02:00
8bb92ff445
performance: avoid reading from gfx memory when modifying walker command
...
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-09-11 18:58:33 +02:00
487b02a2ac
feature: debug flag to disable walker split during copy operations
...
Related-To: NEO-12607
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-11 16:44:16 +02:00
c4306a13b2
fix: set debugSurface in subdevices
...
Related-To: NEO-10681
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-11 15:10:04 +02:00
571d703135
refactor: indirect detection helpers
...
Check indirect detection version from igc header for JIT.
Move required version to its own method.
This allows for different required versions per platform.
Related-To: NEO-12491
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-11 14:49:54 +02:00
7f0a0ae034
fix: Add new debug sip kernel type for heapless
...
Related-to: NEO-7979
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2024-09-11 14:32:15 +02:00
f03c2fd4a7
fix: initialize scalar field, usm pooling
...
Related-To: NEO-6893
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-11 11:44:56 +02:00
bc5237ca8a
feature: add support for query l3 bank count in xe-prelim
...
Related-To: NEO-11125
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-11 11:28:43 +02:00
ce122fb1fa
build: Add option to use xe prelim headers for debugger
...
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2024-09-11 11:20:26 +02:00
7ce4a8adc2
performance: replace virtual calls with native class methods
...
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-09-11 11:10:40 +02:00
b71bb715fc
refactor: Correct using's for idd type and postSync type and getInlineDataSize
...
Related-To: NEO-10681
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-11 10:27:24 +02:00
d4f59c1b09
feature: Enabling Blitter Remapping for REGISTER_MEM
...
Related-To: NEO-11934
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-09-11 09:14:44 +02:00
1c15fa5c70
fix: correct thread-safety in removing from bind info vector in xe path
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-11 02:49:27 +02:00
675ec13439
fix: add rootDeviceIndex for BufferObjectHandleWrapper
...
Modified sharedBoHandles to use the (boHandle, rootDeviceIndex) pair
as a key instead of boHandle, and added rootDeviceIndex variable in
the BufferObjectHandleWrapper class of drm_buffer_object.h.
Previously sharedBoHandles uses boHandle as a key. However, this will
not work with the system using multiple devices, because each devices
can return the same handle to refer different memory region.
Related-To: GSD-9024
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2024-09-10 19:27:19 +02:00
ea5b586c37
fix: move pathExists out of sys calls and do not mock it
...
Moved pathExists from SysCalls to path.h.
In ULTs, use unchanged pathExists and mock stat, getFileAttributesA instead.
Add Windows and Linux ULTs for pathExists.
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-10 19:24:45 +02:00
9bdd7b784a
fix: remove not needed cooperative kernel checks
...
Related-To: HSD-18039871488
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-10 18:32:20 +02:00
b2fc7345cf
performance: redesign usm alloc reuse mechanism
...
Dedicated pools for different allocations size ranges.
Additional reused allocations will create their own pools.
Do not reuse allocations >256MB.
Related-To: NEO-6893, NEO-12299, NEO-12349
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-10 18:12:14 +02:00
dfbad8029b
feature: add support for SIMD16 EU per DSS to xe-prelim helper
...
Related-To: NEO-12012
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-10 15:35:46 +02:00
4f1262645b
refactor: pass extra walker params
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-10 15:30:03 +02:00
beaddb55e0
fix: Minor code changes
...
Remove needless checks for module and cmdList.
Add explicit check for surfaceState in setArgImageWithMipLevel.
Explicitly initialize WddmResidencyController::csr.
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-09-10 13:31:15 +02:00
eca60f01d1
refactor: extract IoctlHelperXePrelim that would use xe prelim headers
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-10 12:04:11 +02:00
a6bf424417
refactor: determine hp copy engine once after gfx core helper is created
...
- do not determine engine on every call to getDefaultHpCopyEngine()
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-10 10:00:48 +02:00
41e24635e3
fix: correct maxMemAllocSize
...
Resolves: NEO-11857
Signed-off-by: Damian Tomczak <damian.tomczak@intel.com>
2024-09-10 09:15:18 +02:00
7ac991fa3f
fix: add workaround for incorrect DRM system info
...
Related-To: NEO-9489
Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-10 08:48:01 +02:00
7d16521c7b
performance: Correct alignment checks
...
Only use checks in debug builds.
Resolves: HSD-18039597713
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-09-10 08:43:36 +02:00
fa61b92cfb
fix: Don't use copy rect middle on LNL Windows
...
Resolves: HSD-18039890120
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-10 06:34:15 +02:00
bfaeeb01d6
feature: support SVM heap in reserveVirtualMem
...
Related-To: NEO-11981
Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-09 23:22:04 +02:00
e30b8c0300
fix: windows cl_cache fixes and improvements
...
Fixed the function that checks if a directory exists.
Added debug message in case config file creation fails.
Simplified setting pattern for searching all files in a directory.
Adding file search loop skip when found file is a directory.
Fixes : #762
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-09 19:25:52 +02:00
dd8460beba
refactor: reduce TBX download timeout for unit tests
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-09 19:05:03 +02:00
54bda0e986
fix: In Linux CL/GL sharing
...
- always issue flush request before export
Apparently it's expected to flush the object (which might convert them
from one format to another for export, or remove aux buffer uses or
anything not supported by export).
- use modifier to select tiling mode
Previously we just assumed that whatever tiling mode was picked by mesa
will match the one picked by GMMLIB but that's not always the case
and in particular on Arc and Xe it doesn't work ... Mesa picks Tile4
and GMMLIB picks Tile64 ...
Fixes : #761
Fixes : #736
Signed-off-by: Sylvain Munaut <tnt@246tNt.com>
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-06 21:40:18 +02:00
9d5f8eb587
refactor: save hpCopyEngine in Device
...
- remove loop iteration to get hpCopyEngine
Related-To: NEO-11983
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-06 17:56:53 +02:00
0f5d9fbb65
performance: replace method calls with constexpr function
...
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-09-06 15:21:42 +02:00
ba1f506c29
feature: add new region count param
...
Related-To: NEO-12138
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-06 15:14:59 +02:00
38e1614f4a
fix: create and use new allocation type for syncBuffer
...
Related-To: NEO-11533
Related-To: HSD-18039788811
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-06 14:11:33 +02:00
a54a3bf624
performance: Optimize heap handling when mitigate dc flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-06 04:33:41 +02:00
efeee0018f
fix: Set debugger supported on arl
...
Resolves: NEO-12136
Signed-off-by: Jemale Lockett <jemale.lockett@intel.com>
2024-09-05 18:23:47 +02:00
95b035a071
fix: global stateless heap creation in heapless path
...
Related-To: NEO-10681
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-05 16:56:00 +02:00
b0e7a11e9a
refactor: Improving information transfer about the copy engine
...
Related-To: NEO-11934
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-09-05 16:11:52 +02:00
bf5953c091
feature: Add ioctl helper function to set external context
...
Related-To: NEO-11817
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2024-09-05 15:21:26 +02:00
80ef56ef4a
fix: Fix residency handling when out-of-memory occurs
...
Related-To: NEO-12434 , NEO-11755
When OOM was triggered from KMD then reiterate
over allocations again since allocations which
should be resident could be evicted during trim process.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-05 13:23:37 +02:00
a8be06b92e
Revert "performance: enable indirect detection, xe hpg"
...
This reverts commit a7c4256e65
2024-09-05 03:35:23 +02:00
d842f65cf1
Revert "fix: submit dummy exec to pin memory during zeContextMakeMemoryReside...
...
This reverts commit f9b87d53e6
2024-09-05 03:28:03 +02:00
a7c4256e65
performance: enable indirect detection, xe hpg
...
Enable for xe hpg and lpg.
Related-To: NEO-12491
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-04 16:57:54 +02:00
f9b87d53e6
fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
Related-To: NEO-11879
2024-09-04 14:07:29 +02:00
32fb476f6d
refactor: debugbreak in simulation on memcopy to multi bank allocation
...
- if allocation has multiple banks, memcpy cannot write different data
for multiple banks
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-04 12:27:20 +02:00
2db6955296
performance: remove excessive ioctl call
...
Related-to: HSD-18039694684
Signed-off-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
2024-09-04 10:07:56 +02:00
1b54c8958f
fix: allow debug when heapless mode without per context VMs
...
Related-To: NEO-11791
Signed-off-by: Jitendra Sharma <jitendra.sharma@intel.com>
2024-09-04 08:56:29 +02:00
a4f68c57bb
Revert "refactor: debugbreak in simulation on memcopy to multi bank allocation"
...
This reverts commit 1c51734642
2024-09-04 05:48:55 +02:00
1c51734642
refactor: debugbreak in simulation on memcopy to multi bank allocation
...
- if allocation has multiple banks, memcpy cannot write different data
for multiple banks
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-03 20:47:50 +02:00
383d786f31
fix: correct including compiler product helper definition
...
inl file should be included only in enabler cpp files
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-03 20:20:39 +02:00
99f62ac866
Revert "feature: support SVM heap in reserveVirtualMem"
...
This reverts commit 93cde3ee12
2024-09-03 20:20:25 +02:00
37b7caa137
fix: correct program header generation for shared isa allocation
...
- when kernels share single allocation, LOAD address in program headers
should point to correct virtual address including kernel offset
Related-To: NEO-7788, GSD-9836
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-03 17:50:29 +02:00
6d7e2760dc
refactor: correct expectations in level zero tests if heapless enabled 3/n
...
Related-To: NEO-10641
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-03 15:11:59 +02:00
93cde3ee12
feature: support SVM heap in reserveVirtualMem
...
Related-To: NEO-11981
Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-03 11:38:51 +02:00
dc84b163b5
Revert "performance: Optimize heap handling when mitigate dc flush"
...
This reverts commit 9249c5c65c
2024-09-03 08:33:20 +02:00
e6abfafa16
fix: drain paging fence queue before waiting for resources
...
Related-To: NEO-12197
If ULLS controller waits for CSR lock, and driver must
wait for resources due to OOM, then draing paging fence queue
directly
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-03 07:45:25 +02:00
5569ebbe1f
Revert "feature: capture multiple cpu pagefault handler"
...
This reverts commit 44f2912195
2024-09-03 05:18:26 +02:00
b6eb4792dc
performance: return const ref instead of struct copy from getBindlessInfo
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-02 18:40:01 +02:00
9249c5c65c
performance: Optimize heap handling when mitigate dc flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-02 18:12:19 +02:00
44f2912195
feature: capture multiple cpu pagefault handler
...
Recorded multiple page fault handlers by using vector in
cpu_page_fault_manager_linux.
Added a static handlerIndex in order to track the depth of
handler logic to call appropriate previous handlers.
Related-To: NEO-11563
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2024-09-02 16:46:35 +02:00
fbabe203c1
Revert "fix: update completion data after makeResident"
...
This reverts commit 13ec7ad32a
2024-08-31 20:54:02 +02:00
d3f32358e9
Revert "performance: Optimize heap handling when mitigate dc flush"
...
This reverts commit 452f4b1dd1
2024-08-31 06:03:18 +02:00
ae3edba369
feature: limit contexts in group based on number of CCS engines
...
Related-To: NEO-12258, HSD-14023076222
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-30 19:55:31 +02:00
ce3cb71773
performance: add debug flag to control timestamp caching
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-08-30 16:32:06 +02:00
13ec7ad32a
fix: update completion data after makeResident
...
Completion data can't be updated when makeResident fails
Resources could have updated state but paging fence remains the same.
Wait on paging fence during freeing these resources might result in hang.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-30 13:29:48 +02:00
c934877790
refactor: remove not needed function
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-30 12:18:14 +02:00
df859c6d4a
fix: skip always resident allocations during trim
...
Related-To: NEO-12461
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-30 11:22:44 +02:00
452f4b1dd1
performance: Optimize heap handling when mitigate dc flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-30 10:54:54 +02:00
a0b789bf9c
fix: make removal from container thread safe
...
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-30 09:24:20 +02:00
63528e70a7
Revert "performance: Optimize heap handling when mitigate dc flush"
...
This reverts commit 1a8149e91c
2024-08-30 05:59:25 +02:00
4536a1b890
fix: unify clos support on PVC
...
add helper for matching all platforms except selected ones
add matchers for clos support
Related-To: NEO-10158
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-29 18:40:51 +02:00
78d9af04e7
Revert "fix: change mutex when destroying allocation"
...
This reverts commit 7628966f80
2024-08-29 18:14:01 +02:00
1a8149e91c
performance: Optimize heap handling when mitigate dc flush
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-29 17:03:55 +02:00
2d8397a36f
Revert "fix: skip always resident allocations during trim"
...
This reverts commit c9457bb5eb
2024-08-29 15:57:37 +02:00
0258667a6e
fix: Set control block in buffer object handle wrapper to null after deletion
...
Related-To: HSD-18039543925
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2024-08-29 12:06:59 +02:00
db611962f7
fix: improve task count handling in tbx download path
...
Related-To: HSD-18039789178
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-28 15:32:15 +02:00
496012d82f
performance: Use copy buffer rect middle builtin
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-28 15:32:00 +02:00
7628966f80
fix: change mutex when destroying allocation
...
Current mutex is not preventing destroying resources
when trim callback is currently evicting same allocation.
New mutex does.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-28 15:31:45 +02:00
482e077252
feature: add regular and hp contexts in group without dedicated hp engine
...
- if no hp copy engine available, create group with regular and hp
contexts
Related-To: NEO-11983
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-28 14:01:10 +02:00
5aa5d40937
performance: Mitigate dc flush on LNL Windows
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-28 13:35:17 +02:00
5367de1ea9
feature: enable bindless mode in L0 on BMG
...
Related-To: NEO-7063
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-08-27 17:22:32 +02:00
c9457bb5eb
fix: skip always resident allocations during trim
...
Related-To: NEO-12461
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-27 15:04:50 +02:00
734b15314b
feature: enable bindless mode in L0 on LNL
...
Related-To: NEO-7063
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-08-27 13:28:28 +02:00
0b848a5fdb
fix: Don't use copy buffer rect middle builtin
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-27 12:01:58 +02:00
9c9a80617a
Revert "performance: enable ULLS for xe2 platforms on linux"
...
This reverts commit 71c6731287
2024-08-27 11:34:44 +02:00
d9864eca7a
feature: add context group support for root device engine
...
Related-To: NEO-12257
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-27 10:07:28 +02:00
ad0d6f5435
Revert "refactor: Add dc flush mitigation infrastructure"
...
This reverts commit e4412e385a
2024-08-27 02:35:06 +02:00
da6a83faa2
feature: add support for state save area header v4
...
Related-To: NEO-8188
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-26 16:03:20 +02:00
843029d01b
fix: make syncDispatchToken one time aub writable
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-26 14:40:41 +02:00
3f6fc1d4d2
feature: switch to new aubstream createHardwareContext2 interface
...
Related-To: NEO-12257
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-26 14:10:53 +02:00
868dd7b017
feature: use global bindless allocator in L0 on MTL
...
Related-To: NEO-7063, NEO-11533
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-26 12:55:24 +02:00
fb8921df97
fix: enable file logger for ReleaseInternal configuration
...
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2024-08-26 10:54:41 +02:00
e4412e385a
refactor: Add dc flush mitigation infrastructure
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-26 10:38:56 +02:00
656788e6c1
fix: Remove UC PAT override for shared images on LNL
...
Resolves: NEO-12326
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-26 10:24:10 +02:00
df9fa343d1
feature: limit max workgroup size to 1k items
...
Resolves: NEO-11881
Signed-off-by: Damian Tomczak <damian.tomczak@intel.com>
2024-08-26 09:20:51 +02:00
e4c9013839
Revert "performance: Enable timestamp wait for queues on BMG"
...
This reverts commit 43e6a3aa03
2024-08-24 07:26:12 +02:00
5dbbaa39b9
Revert "fix: ulls controller sleep, windows"
...
This reverts commit 6455d4648c
2024-08-24 06:37:58 +02:00
956dd8e17d
Revert "fix: set properly resource params when setAllocationType"
...
This reverts commit 2e0884a301
2024-08-24 05:01:38 +02:00
8d32a3a3ad
feature: use global bindless allocator in L0 on DG2
...
Related-To: NEO-7063, NEO-11533
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-23 19:30:38 +02:00
3e96dcf969
refactor: move eu per dss topology type detection to separate file
...
Related-To: NEO-12012
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-23 18:07:43 +02:00
2e0884a301
fix: set properly resource params when setAllocationType
...
gmm params: usage, cachable and resource info
should be set properly when override allocation type
Resolves: HSD-22020344331
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2024-08-23 16:57:23 +02:00
71c6731287
performance: enable ULLS for xe2 platforms on linux
...
Related-To: NEO-9004
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-23 16:17:48 +02:00
4b3b1be191
fix: add heap to residency container instead of calling make resident
...
Related-To: NEO-11212
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
There was make resident call outside lock on csr, so in multi thread
scenarios assigned residency task count may be not correct.
Instead of calling make resident allocation is added to
residency container
2024-08-23 14:52:24 +02:00
3bb4425fb3
fix: Remove patchtokens fallback AIL for DaVinci Resolve
...
Related-To: NEO-12358
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-08-23 13:44:18 +02:00
360a5bbc96
fix: Use consistently proper size of implicit args buffer
...
Fixes discrepancy of implicit args buffer allocation and programming
Resolves: NEO-12316
Signed-off-by: Chodor, Jaroslaw <jaroslaw.chodor@intel.com>
2024-08-23 13:32:17 +02:00
aeb5e0d5ad
fix: pass vm_id to createMediaContext
...
Related-To: NEO-9777
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-23 12:53:39 +02:00
b8f181d50e
performance: remove trim candidate list
...
Related-To: NEO-11755
Removing trim candidate list reduces overhead
caused by residency handling. Allocations required
for eviction are placed in eviction container managed
by CSR.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-08-23 12:21:50 +02:00
6455d4648c
fix: ulls controller sleep, windows
...
Request higher resolution for windows periodic timers for ulls
controller sleep.
Allows for controller thread to sleep with granularity of 1ms.
Related-To: NEO-10800
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-08-23 12:05:26 +02:00
696b02bfd3
fix: improve TBX downloading after L0 Event sync
...
Related-To: HSD-18038498579
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-23 10:42:17 +02:00
70bb654c15
fix: fix compilation issues with gcc14
...
- don't populate buffer objects by direct access - use push_back method
- remove template-id from constructor definitions
- correct allocating minimum memory size for mock objects
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-22 16:10:49 +02:00
06bc53fa9d
fix: handle not recognized state save area header version
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-22 13:40:25 +02:00
556ba1b7c4
performance: Avoid data copy in getPciStats function
...
Additionally explicitly remove unused functions of Directory and
StagingBuffer classes to comply with rule of five.
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-08-22 13:30:01 +02:00
c1a5fb089b
performance: Add copy buffer rect middle builtin
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-22 10:30:17 +02:00
ff4a653c2e
fix: Remove UC PAT override for shared images on BMG
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-22 10:02:15 +02:00
df33eda6e8
Revert "fix: Remove UC PAT override for shared images on BMG"
...
This reverts commit 4d31ec72fd
2024-08-22 04:47:06 +02:00
d8ea5516b2
Revert "performance: Add copy buffer rect middle builtin"
...
This reverts commit bbb44c7a4d
2024-08-22 04:41:42 +02:00
7ac41615cd
fix: create thread with function pointer
...
don't create async thread in neo shared tests
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-21 18:02:37 +02:00
0590b34cfa
feature: refactor and rewrite setErrorDescription
...
Related-To: NEO-8379
Signed-off-by: Winston Zhang <winston.zhang@intel.com>
2024-08-21 17:26:25 +02:00
bbb44c7a4d
performance: Add copy buffer rect middle builtin
...
Resolves: NEO-12132
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-21 14:41:44 +02:00
9097b19c3c
refactor: Remove not needed specialization
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-21 09:45:47 +02:00
43e6a3aa03
performance: Enable timestamp wait for queues on BMG
...
Related-To: NEO-10526
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-21 09:40:46 +02:00
791848d441
fix: small buffer pool AIL, DG2, LNL
...
Related-To: HSD-15016646994
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-08-21 08:41:34 +02:00
6d29e40b9d
feature: add getThreadEuRatioForScratch for Xe2
...
Related-To: NEO-12105
Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-08-21 08:18:42 +02:00
ef2ae9e1b7
Revert "feature: New forward-compatibility model for zeinfo"
...
This reverts commit f1815f941d
2024-08-21 00:27:42 +02:00
f1815f941d
feature: New forward-compatibility model for zeinfo
...
Up till now, NEO ignored uknown attributes in zeinfo
which could lead to undefined behavior. With this change
NEO will emit an error whenever an unknown attribute is
encountered.
Note : old behavior can be restored using new
IgnoreZebinUnknownAttributes debug environment variable
Resolves: NEO-11762
Signed-off-by: Chodor, Jaroslaw <jaroslaw.chodor@intel.com>
2024-08-20 23:08:04 +02:00
8b1bedd1f6
fix: call processFlushResidency on aub operations handler
...
- in Os with AubDump mode
Related-To: NEO-11719
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-20 21:13:10 +02:00
f617093a6a
fix: add missing nullptr check before accessing ail helper
...
Fixes : #755
Fixes : #754
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-20 16:58:53 +02:00
d1c354d5bf
fix: Init device with first submission when metrics enabled
...
Resolves: NEO-7642
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-20 14:34:16 +02:00
9e66844a27
fix: Add AIL for Zoom and aomhost64
...
Resolves: NEO-12193
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-20 13:36:22 +02:00
f45a229802
fix: add dependency on previous binary outputs
...
Related-To: NEO-11916
Signed-off-by: Alicja Lukaszewicz <alicja.lukaszewicz@intel.com>
2024-08-20 12:45:39 +02:00
4d31ec72fd
fix: Remove UC PAT override for shared images on BMG
...
Related-To: NEO-12326
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-08-20 11:55:32 +02:00
4c3a0d8344
fix: add missing sba capture when debug enabled
...
- In global bindless mode SBA may be programmed for scratch allocation,
missing sba capturing caused issues for kernels with scratch.
- this fix adds SBA capturing after SBA command
Related-To: NEO-7063
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-08-20 09:32:17 +02:00
579af57161
refactor: don't call OsLibrary::load directly, use function pointer
...
this allows mocking this call in ULT
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-20 08:59:26 +02:00
006285105d
Revert "fix: allow using recoverable pagefaults on xekmd"
...
This reverts commit 4404d0c6b8
2024-08-20 05:38:00 +02:00
ce0ecf5939
fix: download L0 Event TBX allocation on related subdevice if needed
...
Related-To: HSD-18038498579
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-19 18:34:58 +02:00
4404d0c6b8
fix: allow using recoverable pagefaults on xekmd
...
Signed-off-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
2024-08-19 15:56:55 +02:00
5c6f3e7d2b
fix: Remove patchtokens fallback AIL for DaVinci Resolve for XE2+
...
For other platforms, this AIL will be removed in the next change.
Resolves: NEO-12358
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-08-19 15:05:02 +02:00
cb8063f71d
feature: Append recorded command list into immediate (3/N)
...
- Use correct stream for dispatch
- Add capability to append signal event
- Check available space globally in immediate append call
Related-To: NEO-10356
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2024-08-16 17:40:28 +02:00
85a42162f8
refactor: debug flag to print DirectSubmission semaphore usage
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-08-16 13:10:34 +02:00
efb8240a00
refactor: rename OsLibrary::load function to distinguish functionality
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-16 01:35:41 +02:00
9b652f4a34
Revert "feature: Improving information transfer about the copy engine"
...
This reverts commit 17ffdff4f1
2024-08-15 22:06:31 +02:00
17ffdff4f1
feature: Improving information transfer about the copy engine
...
Related-To: NEO-11934
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-08-14 11:28:29 +02:00
1317aa539b
fix: unblock xekmd recoverable pagefaults vmbind
...
Signed-off-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
2024-08-14 10:46:45 +02:00
f4ad45eafd
fix: initialize engine in AubMemoryOperationsHandler::makeResident
...
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-08-13 20:57:57 +02:00
32f80e1131
feature: add support for the cl_khr_extended_bit_ops extension
...
Related-To: NEO-10337
Signed-off-by: Ben Ashbaugh <ben.ashbaugh@intel.com>
2024-08-12 17:44:31 +02:00
27488a8315
fix: Add option to use divergent paths for barriers
...
Related-To: NEO-12159, IGC-9846, HSD-16024235164, HSD-15014782386
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-08-12 12:15:54 +02:00
b3d005b2aa
fix: setup proper gen id for metrics library on Xe2
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-12 10:48:47 +02:00
54b5adb767
fix: Add checks to align functions
...
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-08-12 10:08:15 +02:00
Maciej Plewka