Commit Graph

1029 Commits

Author SHA1 Message Date
Michal Mrozek
62faecf6d5 Optimize virtual calls #2.
Optimize frequently used virtual cost.
Compiler cannot inline those which causes overhead.

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-12-16 16:26:59 +01:00
Bartosz Dunajski
e040c8c6bb Initial compression support for L0 Device allocations
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-16 15:55:13 +01:00
Michal Mrozek
b4ad6e011f Restore assert.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-12-16 13:37:26 +01:00
Michal Mrozek
dc44b13b53 Optimize getRootDeviceIndex.
Virtual functions are not easily optimizable by compiler,
so making this normal function.
This function is called heavily so it needs to be highly optimized.

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-12-16 11:53:12 +01:00
Bartosz Dunajski
8b4a7dac8f Respect Uncompressed hint when allocating L0 Image
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-16 00:51:38 +01:00
Bartosz Dunajski
175d4d332f L0 compression hints parsing support
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-15 16:51:29 +01:00
Zbigniew Zdanowicz
c7693650de Fix partition count after command list reset
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-15 11:11:26 +01:00
Bartosz Dunajski
8288fa76cb Initial support for compressed L0 Images
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-14 17:29:24 +01:00
Kacper Nowak
80ed37faf6 Return debug ZeBin on getDebugInfo in Level Zero
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-12-14 16:29:42 +01:00
Igor Venevtsev
fe250d99b1 Disable L3 caches for debug on ATS and DG2
Resolves: NEO-6320

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-12-14 13:59:09 +01:00
Mateusz Hoppe
d8ea439dab Store non canonical SBA addresses
- fixes reading SBA addresses error

Related-To: NEO-6221

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-12-13 16:33:48 +01:00
Krystian Chmielewski
7e08e56d50 Zebin: allow undef symbols
Skip undefined symbols when decoding ELF symbol table
instead of treating them as error in zebin path in
order to support dynamic linking scenarios.

Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-12-13 15:31:56 +01:00
Lukasz Jobczyk
616580637b Reuse command buffers in L0 command list
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-12-13 14:52:45 +01:00
Filip Hazubski
64aec8dc4e Rename functions
Rename getEngines to getAllEngines
Rename engines to allEngines
Rename getEngineGroups to getRegularEngineGroups
Rename engineGroups to regularEngineGroups

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-12-13 14:27:02 +01:00
Lukasz Jobczyk
3fd938a124 Destroy allocations list when reset device
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-12-13 13:16:14 +01:00
Raiyan Latif
abb91a7dae Return error in canAccessPeer when P2P appendMemoryCopy fails
Signed-off-by: Raiyan Latif <raiyan.latif@intel.com>
2021-12-10 10:19:53 +01:00
Joshua Santosh Ranjan
06be26fd1e Add uuid support using inband information
Added chipset specific uuid retrieving functionality
This is used by zeDeviceGetProperties


Related-To: LOCI-2636

Signed-off-by: Joshua Santosh Ranjan <joshua.santosh.ranjan@intel.com>
2021-12-10 08:02:33 +01:00
Michal Mrozek
1c018bf57e Do not split copies when using copy engine.
- no need to do so, BCS handles misaligned offsets and sizes.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-12-09 22:02:36 +01:00
Lukasz Jobczyk
b2f286fc4a Reuse command buffers in L0 command queue
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-12-09 15:52:36 +01:00
Zbigniew Zdanowicz
bac79244d5 Add multi tile event signal capability
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-09 12:13:23 +01:00
Filip Hazubski
cf4ce308d9 Rename function
Rename multiDeviceCapable to implicitScalingCapable
Rename isMultiDeviceCapable to isImplicitScalingCapable

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-12-09 11:14:08 +01:00
Barigou, Youcef
ac2b1d403b - Fix memProperties flags to be set to zero
Signed-off-by: Barigou, Youcef <youcef.barigou@intel.com>
2021-12-08 23:51:26 +01:00
Filip Hazubski
1107fdfe55 Rename function and remove unused parameter
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-12-08 22:47:40 +01:00
Zbigniew Zdanowicz
882814751f Add multi tile support for event reset commands
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-08 17:51:06 +01:00
Zbigniew Zdanowicz
f47814fb32 Remove not needed virtual methods from event class
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-08 12:43:46 +01:00
Jim Snow
2dfb7df63b Add RTDispatchGlobals allocation for ray tracing
If a kernel has ray tracing calls, we allocate and initialize
per-device RTDispatchGlobals if needed, and hand off pointer to
the same into a running kernel via an implicit parameter.

Related-To: NEO-5384
Signed-off-by: Jim Snow <jim.m.snow@intel.com>
2021-12-08 09:44:13 +01:00
Bartosz Dunajski
7c610ed5bb Add new Engine Group types
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-07 15:28:15 +01:00
Bartosz Dunajski
f20236c7f2 Initial PVC support
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>

Related-To: NEO-5542
2021-12-07 10:22:41 +01:00
Compute-Runtime-Validation
b7cee61bde Revert "Fail build program in shared system USM + stateful access case"
This reverts commit 0ad8afc0b3.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2021-12-07 01:00:59 +01:00
Filip Hazubski
2098b0c3fa Refactor Device::engineGroups to store only available engine groups
Simplify logic around engine groups.
Remove no longer needed code.
Ensure correct device is used when verifying engine groups.

Related-To: NEO-6219

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-12-06 18:27:31 +01:00
Lukasz Jobczyk
09d2ffb9ed Add missing cache flush
Resolves: NEO-6505

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-12-06 17:28:12 +01:00
Kamil Kopryk
0ad8afc0b3 Fail build program in shared system USM + stateful access case
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-6075

After this change driver will fail clBuildProgram/zeModuleCreate api calls
whenever stateful access is discovered and device has shared system usm caps
enabled.This is required since in this case allocation greater than 4GB
will not work.
If user still wants to use stateful addressing mode,
-cl-opt-smaller-than-4GB-buffers-only / -ze-opt-smaller-than-4GB-buffers-only
build option should be passed as build option, but then user can not use
buffers greater than 4GB.
2021-12-06 15:10:16 +01:00
Zbigniew Zdanowicz
d497392b55 Add command buffer estimation for append wait on events operation
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-06 12:04:59 +01:00
Bartosz Dunajski
68aea5bf62 Rename compression flags and helpers
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-03 18:09:02 +01:00
Zbigniew Zdanowicz
631933e374 Remove needless partition offset register reconfiguration
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-03 14:28:30 +01:00
Lukasz Jobczyk
c455c0f9c6 Remove "Update Device::engineGroups"
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-12-03 10:16:40 +01:00
Mateusz Jablonski
3de256b17b Correct L0 kernel tests
respect memory copies for patching ISA
remove tests for nullptr kernel ISA

Related-To: NEO-5081, IGC-4707
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-12-03 07:47:50 +01:00
Zbigniew Zdanowicz
47dbe359bf Add command encoder for store data command
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-02 20:56:07 +01:00
Zbigniew Zdanowicz
3e1023fa1a Unify memory layout for all multi tile post sync operations
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-12-02 18:00:40 +01:00
Bartosz Dunajski
55959d4d1d Helper method to check if allocation is compressed
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-02 16:13:53 +01:00
Bartosz Dunajski
7b55d38e34 Refactor [1/n]: Make compression preference allocation property
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-12-02 15:24:35 +01:00
Filip Hazubski
4461b8ea3f Refactor: Update Device::engineGroups to store only available engine groups
Simplify logic around engine groups.
Remove no longer needed code.

Related-To: NEO-6219

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-12-02 15:10:22 +01:00
Filip Hazubski
f00cae09d6 Return error when incorrect group ordinal is given on command list creation
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-11-29 19:42:53 +01:00
Bartosz Dunajski
ee29dc5c13 Fix L0 device caps
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-11-26 15:05:08 +01:00
Zbigniew Zdanowicz
e857979406 Refactor multi context device checker
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-25 20:17:14 +01:00
Zbigniew Zdanowicz
ca256a3f54 Initialize command list partition count for multi tile device
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-24 14:22:51 +01:00
Zbigniew Zdanowicz
357f650b8b Unify code for check is implicit scaling enabled
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-24 12:41:00 +01:00
Aravind Gopalakrishnan
5a2792a74f Remove needless event handle getter
Signed-off-by: Aravind Gopalakrishnan <aravind.gopalakrishnan@intel.com>
2021-11-23 22:07:13 +01:00
Mateusz Hoppe
b11d7cd7b0 Add debug key for compiler internal options injection
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-11-23 15:41:11 +01:00
Zbigniew Zdanowicz
2b60cadf1e Use implicit scaling conditions to check for multi context device
Related-To: NEO-6262

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-11-23 15:27:48 +01:00