Commit Graph

5920 Commits

Author SHA1 Message Date
Mateusz Jablonski
1c15fa5c70 fix: correct thread-safety in removing from bind info vector in xe path
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-11 02:49:27 +02:00
Young Jin Yoon
675ec13439 fix: add rootDeviceIndex for BufferObjectHandleWrapper
Modified sharedBoHandles to use the (boHandle, rootDeviceIndex) pair
as a key instead of boHandle, and added rootDeviceIndex variable in
the BufferObjectHandleWrapper class of drm_buffer_object.h.

Previously sharedBoHandles uses boHandle as a key. However, this will
not work with the system using multiple devices, because each devices
can return the same handle to refer different memory region.

Related-To: GSD-9024
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2024-09-10 19:27:19 +02:00
Fabian Zwoliński
ea5b586c37 fix: move pathExists out of sys calls and do not mock it
Moved pathExists from SysCalls to path.h.
In ULTs, use unchanged pathExists and mock stat, getFileAttributesA instead.
Add Windows and Linux ULTs for pathExists.

Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-10 19:24:45 +02:00
Bartosz Dunajski
9bdd7b784a fix: remove not needed cooperative kernel checks
Related-To: HSD-18039871488

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-10 18:32:20 +02:00
Dominik Dabek
b2fc7345cf performance: redesign usm alloc reuse mechanism
Dedicated pools for different allocations size ranges.
Additional reused allocations will create their own pools.
Do not reuse allocations >256MB.

Related-To: NEO-6893, NEO-12299, NEO-12349

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-10 18:12:14 +02:00
Mateusz Jablonski
dfbad8029b feature: add support for SIMD16 EU per DSS to xe-prelim helper
Related-To: NEO-12012
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-10 15:35:46 +02:00
Bartosz Dunajski
4f1262645b refactor: pass extra walker params
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-10 15:30:03 +02:00
Filip Hazubski
beaddb55e0 fix: Minor code changes
Remove needless checks for module and cmdList.
Add explicit check for surfaceState in setArgImageWithMipLevel.
Explicitly initialize WddmResidencyController::csr.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-09-10 13:31:15 +02:00
Mateusz Jablonski
eca60f01d1 refactor: extract IoctlHelperXePrelim that would use xe prelim headers
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-10 12:04:11 +02:00
Mateusz Hoppe
a6bf424417 refactor: determine hp copy engine once after gfx core helper is created
- do not determine engine on every call to getDefaultHpCopyEngine()

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-10 10:00:48 +02:00
Damian Tomczak
41e24635e3 fix: correct maxMemAllocSize
Resolves: NEO-11857

Signed-off-by: Damian Tomczak <damian.tomczak@intel.com>
2024-09-10 09:15:18 +02:00
Wenbin Lu
7ac991fa3f fix: add workaround for incorrect DRM system info
Related-To: NEO-9489

Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-10 08:48:01 +02:00
Filip Hazubski
7d16521c7b performance: Correct alignment checks
Only use checks in debug builds.

Resolves: HSD-18039597713

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-09-10 08:43:36 +02:00
Lukasz Jobczyk
fa61b92cfb fix: Don't use copy rect middle on LNL Windows
Resolves: HSD-18039890120

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-10 06:34:15 +02:00
Wenbin Lu
bfaeeb01d6 feature: support SVM heap in reserveVirtualMem
Related-To: NEO-11981

Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-09 23:22:04 +02:00
Fabian Zwoliński
e30b8c0300 fix: windows cl_cache fixes and improvements
Fixed the function that checks if a directory exists.
Added debug message in case config file creation fails.
Simplified setting pattern for searching all files in a directory.
Adding file search loop skip when found file is a directory.

Fixes: #762
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-09 19:25:52 +02:00
Bartosz Dunajski
dd8460beba refactor: reduce TBX download timeout for unit tests
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-09 19:05:03 +02:00
Mateusz Jablonski
54bda0e986 fix: In Linux CL/GL sharing
- always issue flush request before export

Apparently it's expected to flush the object (which might convert them
from one format to another for export, or remove aux buffer uses or
anything not supported by export).

- use modifier to select tiling mode

Previously we just assumed that whatever tiling mode was picked by mesa
will match the one picked by GMMLIB but that's not always the case
and in particular on Arc and Xe it doesn't work ... Mesa picks Tile4
and GMMLIB picks Tile64 ...

Fixes: #761
Fixes: #736

Signed-off-by: Sylvain Munaut <tnt@246tNt.com>
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-06 21:40:18 +02:00
Mateusz Hoppe
9d5f8eb587 refactor: save hpCopyEngine in Device
- remove loop iteration to get hpCopyEngine

Related-To: NEO-11983

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-06 17:56:53 +02:00
Zbigniew Zdanowicz
0f5d9fbb65 performance: replace method calls with constexpr function
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-09-06 15:21:42 +02:00
Bartosz Dunajski
ba1f506c29 feature: add new region count param
Related-To: NEO-12138

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-09-06 15:14:59 +02:00
Fabian Zwoliński
38e1614f4a fix: create and use new allocation type for syncBuffer
Related-To: NEO-11533
Related-To: HSD-18039788811
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-06 14:11:33 +02:00
Lukasz Jobczyk
a54a3bf624 performance: Optimize heap handling when mitigate dc flush
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-06 04:33:41 +02:00
Jemale Lockett
efeee0018f fix: Set debugger supported on arl
Resolves: NEO-12136

Signed-off-by: Jemale Lockett <jemale.lockett@intel.com>
2024-09-05 18:23:47 +02:00
Kamil Kopryk
95b035a071 fix: global stateless heap creation in heapless path
Related-To: NEO-10681
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-05 16:56:00 +02:00
Andrzej Koska
b0e7a11e9a refactor: Improving information transfer about the copy engine
Related-To: NEO-11934

Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-09-05 16:11:52 +02:00
Slawomir Milczarek
bf5953c091 feature: Add ioctl helper function to set external context
Related-To: NEO-11817

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2024-09-05 15:21:26 +02:00
Szymon Morek
80ef56ef4a fix: Fix residency handling when out-of-memory occurs
Related-To: NEO-12434 , NEO-11755

When OOM was triggered from KMD then reiterate
over allocations again since allocations which
should be resident could be evicted during trim process.

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-05 13:23:37 +02:00
Compute-Runtime-Validation
a8be06b92e Revert "performance: enable indirect detection, xe hpg"
This reverts commit a7c4256e65.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-09-05 03:35:23 +02:00
Compute-Runtime-Validation
d842f65cf1 Revert "fix: submit dummy exec to pin memory during zeContextMakeMemoryReside...
This reverts commit f9b87d53e6.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-09-05 03:28:03 +02:00
Dominik Dabek
a7c4256e65 performance: enable indirect detection, xe hpg
Enable for xe hpg and lpg.

Related-To: NEO-12491

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-09-04 16:57:54 +02:00
Maciej Plewka
f9b87d53e6 fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>

Related-To: NEO-11879
2024-09-04 14:07:29 +02:00
Mateusz Hoppe
32fb476f6d refactor: debugbreak in simulation on memcopy to multi bank allocation
- if allocation has multiple banks, memcpy cannot write different data
for multiple banks

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-04 12:27:20 +02:00
Naklicki, Mateusz
2db6955296 performance: remove excessive ioctl call
Related-to: HSD-18039694684
Signed-off-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
2024-09-04 10:07:56 +02:00
Jitendra Sharma
1b54c8958f fix: allow debug when heapless mode without per context VMs
Related-To: NEO-11791
Signed-off-by: Jitendra Sharma <jitendra.sharma@intel.com>
2024-09-04 08:56:29 +02:00
Compute-Runtime-Validation
a4f68c57bb Revert "refactor: debugbreak in simulation on memcopy to multi bank allocation"
This reverts commit 1c51734642.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-09-04 05:48:55 +02:00
Mateusz Hoppe
1c51734642 refactor: debugbreak in simulation on memcopy to multi bank allocation
- if allocation has multiple banks, memcpy cannot write different data
for multiple banks

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-03 20:47:50 +02:00
Mateusz Jablonski
383d786f31 fix: correct including compiler product helper definition
inl file should be included only in enabler cpp files

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-03 20:20:39 +02:00
Compute-Runtime-Validation
99f62ac866 Revert "feature: support SVM heap in reserveVirtualMem"
This reverts commit 93cde3ee12.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-09-03 20:20:25 +02:00
Mateusz Hoppe
37b7caa137 fix: correct program header generation for shared isa allocation
- when kernels share single allocation, LOAD address in program headers
should point to correct virtual address including kernel offset

Related-To: NEO-7788, GSD-9836

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-09-03 17:50:29 +02:00
Kamil Kopryk
6d7e2760dc refactor: correct expectations in level zero tests if heapless enabled 3/n
Related-To: NEO-10641
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-09-03 15:11:59 +02:00
Wenbin Lu
93cde3ee12 feature: support SVM heap in reserveVirtualMem
Related-To: NEO-11981

Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
2024-09-03 11:38:51 +02:00
Compute-Runtime-Validation
dc84b163b5 Revert "performance: Optimize heap handling when mitigate dc flush"
This reverts commit 9249c5c65c.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-09-03 08:33:20 +02:00
Szymon Morek
e6abfafa16 fix: drain paging fence queue before waiting for resources
Related-To: NEO-12197

If ULLS controller waits for CSR lock, and driver must
wait for resources due to OOM, then draing paging fence queue
directly

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-09-03 07:45:25 +02:00
Compute-Runtime-Validation
5569ebbe1f Revert "feature: capture multiple cpu pagefault handler"
This reverts commit 44f2912195.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-09-03 05:18:26 +02:00
Mateusz Jablonski
b6eb4792dc performance: return const ref instead of struct copy from getBindlessInfo
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-02 18:40:01 +02:00
Lukasz Jobczyk
9249c5c65c performance: Optimize heap handling when mitigate dc flush
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-09-02 18:12:19 +02:00
Young Jin Yoon
44f2912195 feature: capture multiple cpu pagefault handler
Recorded multiple page fault handlers by using vector in
cpu_page_fault_manager_linux.

Added a static handlerIndex in order to track the depth of
handler logic to call appropriate previous handlers.

Related-To: NEO-11563
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2024-09-02 16:46:35 +02:00
Compute-Runtime-Validation
fbabe203c1 Revert "fix: update completion data after makeResident"
This reverts commit 13ec7ad32a.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-08-31 20:54:02 +02:00
Compute-Runtime-Validation
d3f32358e9 Revert "performance: Optimize heap handling when mitigate dc flush"
This reverts commit 452f4b1dd1.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-08-31 06:03:18 +02:00