Commit Graph

4947 Commits

Author SHA1 Message Date
Kamil Kopryk
3a09ea3436 Revert "refactor: reduce batch buffer struct size"
This reverts commit 97ecf58577.

Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-19 16:06:57 +01:00
Maciej Bielski
134c718a25 fix: support zeEventPool IPC handles from single process
For all execution paths where needed, use `BufferObjectHandleWrapper`
instances for registration of BO-handles and try to obtain shared
ownership. This allows both sides of IPC communication to be implemented
in the same process and avoid the double-free problem on a BufferObject
of the same handle.

Currently there are two pairs of such calls:
* `zeEventPoolGetIpcHandle()` + `zeEventPoolOpenIpcHandle()`
* `zeMemGetIpcHandle()` + `zeMemOpenIpcHandle()`

The capability of executing both sides from the same process is useful
for testing but not only.

Related-To: NEO-9837
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2024-01-19 14:49:38 +01:00
Zbigniew Zdanowicz
b5f698e0c5 feature: add umonitor and umwait synchronization function
Related-To: NEO-9737

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-01-19 14:20:19 +01:00
Dunajski, Bartosz
b266f1f3cc refactor: improve implicit scaling interface
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-19 14:09:04 +01:00
Mateusz Jablonski
93e941fd73 refactor: simplify engine mapping array
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-01-19 12:51:12 +01:00
Kamil Kopryk
d7d3a6b76d fix: use full address to sip if needed
Related-To: NEO-7621
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-19 12:28:46 +01:00
Mateusz Jablonski
028a5ee2fc fix: correct calculating highest enabled dual subslice
when no DSS is exposed then calculate highest enabled subslice instead

Related-To: NEO-9614
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-01-19 10:48:15 +01:00
Yoon, Young Jin
9c7578f5f4 fix: change numa_library to read default policy
Changed NumaLibrary to read default policy instead of using
the address-based policy, and remove unnecessary argument.

Removed numaif.h from the repo as it is no longer required.

Related-To: NEO-8276
Signed-off-by: Yoon, Young Jin <young.jin.yoon@intel.com>
2024-01-19 08:31:41 +01:00
Yoon, Young Jin
a084b1cf42 fix: change numa library string for SLES
Modified libnuma.so.1 to be loaded instead of libnuma.so for
SLES compatibility

Related-To: NEO-8276
Signed-off-by: Yoon, Young Jin <young.jin.yoon@intel.com>
2024-01-19 08:22:17 +01:00
Mateusz Jablonski
a673347378 fix: don't allocate preemption surface for BCS engines
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-01-19 07:59:24 +01:00
Dunajski, Bartosz
3a5e6c0117 fix: cl_intel_subgroup_split_matrix_multiply_accumulate support on PVC
Related-To: GSD-7696

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-18 19:40:59 +01:00
Filip Hazubski
b533024b70 fix: Ensure correct evaluation order in gfx_partition.cpp
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-01-18 19:12:33 +01:00
Brandon Yates
f56eeb0eb7 fix: Use debug SIP when debugging is enabled
Disable wMTP when debug is enabled

Related-to: NEO-10085

Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2024-01-18 18:58:16 +01:00
Dunajski, Bartosz
7fbf724c72 refactor: update Implicit Scaling interface
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-18 16:52:48 +01:00
Dominik Dabek
e0ccf22557 fix: indirect access in external functions
Read indirect_stateless_count in module external functions.

If greater than 0, mark all kernels that have the has_stack_calls flag
set from this module as having indirect accesses.

Related-To: NEO-7712

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-18 15:29:41 +01:00
Lukasz Jobczyk
af5977766d performance: Push cmd buffer alloc to the front of reusable list
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-18 12:28:22 +01:00
Kacper Nowak
c238f731af fix: Skip mapping copy engines for unsupported ones
Based on the info retrieved from product helper, skip mapping returned
copy engines from KMD to disabled ones.
- Unify logic for EngineInfo ctors (remove redundant code).
Related-To: NEO-8356
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2024-01-18 09:49:14 +01:00
Brandon Yates
976d112188 performance: optimize copy in allocateDebugMetadata
Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2024-01-18 08:07:02 +01:00
Kamil Kopryk
696be48cd4 refactor: add preemption xe only file to xehpg and xehpc sources
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-17 18:32:37 +01:00
Lukasz Jobczyk
d2eb29660d performance: Refactor cmd buffer reuse for cmd lists
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-17 17:28:17 +01:00
Dunajski, Bartosz
ec40fdc382 fix: PVC dpas caps
Related-To: NEO-10083

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-17 16:28:57 +01:00
Kamil Kopryk
97ecf58577 refactor: reduce batch buffer struct size
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-17 14:04:00 +01:00
Jitendra Sharma
aa191b6f88 feature: Set runalone mode for contexts with online debugging
Related-To: NEO-9139

Signed-off-by: Jitendra Sharma <jitendra.sharma@intel.com>
2024-01-17 09:01:30 +01:00
Warchulski, Jaroslaw
f7dc17e6a2 fix: set mmapPtr in every allocation in multiGraphicAllocation
Related-To: GSD-7360
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
2024-01-16 15:18:44 +01:00
Naklicki, Mateusz
a28a2d305e fix: align NEO code to new uAPI header
PMU is removed from XeKMD as it is likely to change in the future.

Related-To: NEO-8324

Co-authored-by: Francois Dugast <francois.dugast@intel.com>
Co-authored-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
Signed-off-by: Francois Dugast <francois.dugast@intel.com>
Signed-off-by: Naklicki, Mateusz <mateusz.naklicki@intel.com>
2024-01-16 13:36:32 +01:00
Kamil Kopryk
36dcfc0b42 feature: add stateless heapless builtins
Related-To: NEO-7621
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-16 11:11:31 +01:00
Mateusz Jablonski
556645e0c5 fix: add unrecoverable to avoid OOB access
Related-To: NEO-9860
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-01-16 00:12:11 +01:00
Lukasz Jobczyk
9215f3acb5 performance: Remove tlb flush on DG2 Linux
Resolves: NEO-7116

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-15 23:20:16 +01:00
John Falkowski
10ef2a28ff fix: correct for default hierachry
Resolves: NEO-10006

Signed-off-by: John Falkowski <john.falkowski@intel.com>
2024-01-15 22:15:49 +01:00
Mateusz Jablonski
7b40b01f54 feature: add debug key for toggling bit in 57bit GPU VA for specific allocations
Related-To: NEO-9419
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-01-15 19:37:00 +01:00
Dunajski, Bartosz
dfc69c746a feature: create InOrderExecInfo for standalone CB Event
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-15 16:56:52 +01:00
Kamil Kopryk
cc1e3965ce refactor: Improve builtins compilation
Related-To: NEO-7621
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-15 14:56:52 +01:00
Maciej Plewka
b348eaf29f fix: use required walk order
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>

Related-To: NEO-10014
2024-01-15 13:44:56 +01:00
Dominik Dabek
997bdfa010 performance: add windows thread priority debug key
Set windows thread priority to "above normal" on wddm init if flag is
set.

Related-To: NEO-8215

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-15 08:14:46 +01:00
Compute-Runtime-Validation
9b0c64abef Revert "performance: Enable ULLS on WSL"
This reverts commit 42c2b6b0e2.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-01-15 06:08:44 +01:00
Compute-Runtime-Validation
37bfde9e4d Revert "refactor: Improve builtins compilation"
This reverts commit 21bc398340.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-01-13 05:10:20 +01:00
Dominik Dabek
b3b402cad2 feature(zebin): read indirect detection version
Read indirect detection version intel compat notes from zebin.

This is to prepare for enabling indirect access optimization in AOT
built kernels.

Related-To: NEO-7712

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-12 14:20:52 +01:00
Mateusz Hoppe
a972cdaa6b fix: initialize device caps before creating engines
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-01-12 14:09:30 +01:00
Fabian Zwolinski
a3bd629aff fix: store image implicit args in bindless slot 1
bindless slot 0: image
bindless slot 1: image implicit args
bindless slot 2: redescribed image

Redescribed image moved one slot higher.
Separate allocation is created for new bindless slot.

Related-To: NEO-9740
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
2024-01-12 13:09:06 +01:00
Lukasz Jobczyk
42c2b6b0e2 performance: Enable ULLS on WSL
Related-To: NEO-10037

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-12 12:03:53 +01:00
Fabian Zwolinski
903e581b5f fix: add support for bindless implicit args
Support for:
global_base and const_base in bindless addressing mode.

Related-To: NEO-9855
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
2024-01-12 01:27:17 +01:00
Lukasz Jobczyk
2bda9f0b58 fix: Release usage when put cmd buffer to reusable list
Resolves: NEO-10004
Related-To: NEO-7116

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-11 18:40:38 +01:00
Kamil Kopryk
21bc398340 refactor: Improve builtins compilation
Related-To: NEO-7621

- simplify logic
- correct names
- remove inconsistent foreach
foreach(GENERATED_BUILTINS_IMAGES ${GENERATED_BUILTINS_IMAGES})

Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-11 15:20:01 +01:00
Dongwon Kim
8dda7e3936 feature: adding device ids of 4 more DG2 variants
Related-To: NEO-9775

Signed-off-by: Dongwon Kim <dongwon.kim@intel.com>
2024-01-11 09:56:16 +01:00
Brandon Yates
ba0db2488a refactor: Implement Xe Resoure Registration (2/x)
Refactor drm_debug.cpp into IoctlHelper

Related-to: NEO-9161

Signed-off-by: Brandon Yates <brandon.yates@intel.com>
2024-01-11 08:26:29 +01:00
Brandon Yates
d3baab00db feature: Register resources for Xe at vm creation (1/x)
Add interfaces to IoctlHelperXe for registering resources.
Introduce new debug key EnableXeResourceRegistration to attach
resources to vm_create ioctl.

Related-to: NEO-9161
Signed-off-by: Brandon Yatse <brandon.yates@intel.com>
2024-01-11 08:15:50 +01:00
Kamil Kopryk
0aee72f1fc refactor: disable instantiation-after-specialization clang warning
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-10 13:50:25 +01:00
Zbigniew Zdanowicz
eec553ea6a fix: set ulls ring start state according to returned value from kmd call
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-01-10 12:57:34 +01:00
Mateusz Hoppe
31edeb0765 feature: set HP flag when creating HardwareContextController
- for highPriority context

Related-To: NEO-7824

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-01-10 12:46:29 +01:00
Katarzyna Cencelewska
5d2d3ed899 refactor: modify sip kernel helpers
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2024-01-09 17:09:10 +01:00