Commit Graph

3173 Commits

Author SHA1 Message Date
Maciej Bielski
134c718a25 fix: support zeEventPool IPC handles from single process
For all execution paths where needed, use `BufferObjectHandleWrapper`
instances for registration of BO-handles and try to obtain shared
ownership. This allows both sides of IPC communication to be implemented
in the same process and avoid the double-free problem on a BufferObject
of the same handle.

Currently there are two pairs of such calls:
* `zeEventPoolGetIpcHandle()` + `zeEventPoolOpenIpcHandle()`
* `zeMemGetIpcHandle()` + `zeMemOpenIpcHandle()`

The capability of executing both sides from the same process is useful
for testing but not only.

Related-To: NEO-9837
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2024-01-19 14:49:38 +01:00
Zbigniew Zdanowicz
b5f698e0c5 feature: add umonitor and umwait synchronization function
Related-To: NEO-9737

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-01-19 14:20:19 +01:00
Dunajski, Bartosz
b266f1f3cc refactor: improve implicit scaling interface
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-19 14:09:04 +01:00
Kamil Kopryk
f1f426c15b refactor: correct spelling
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-19 08:25:50 +01:00
Dominik Dabek
e0ccf22557 fix: indirect access in external functions
Read indirect_stateless_count in module external functions.

If greater than 0, mark all kernels that have the has_stack_calls flag
set from this module as having indirect accesses.

Related-To: NEO-7712

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-18 15:29:41 +01:00
Mateusz Jablonski
5392841b39 test: correct initialization of max os context count in L0 tests
Related-To: NEO-9860
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-01-16 13:07:48 +01:00
Dunajski, Bartosz
e354c01acc feature: allow waiting for standalone CB Event
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-16 11:59:46 +01:00
Kamil Kopryk
36dcfc0b42 feature: add stateless heapless builtins
Related-To: NEO-7621
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2024-01-16 11:11:31 +01:00
John Falkowski
10ef2a28ff fix: correct for default hierachry
Resolves: NEO-10006

Signed-off-by: John Falkowski <john.falkowski@intel.com>
2024-01-15 22:15:49 +01:00
Dunajski, Bartosz
dfc69c746a feature: create InOrderExecInfo for standalone CB Event
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-15 16:56:52 +01:00
Dunajski, Bartosz
9309d7d865 feature: initial support of zexCounterBasedEventCreate 2
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-15 11:47:36 +01:00
Compute-Runtime-Validation
1cc4c6c10f Revert "feature: initial support of zexCounterBasedEventCreate"
This reverts commit d8f8b70dd7.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2024-01-15 05:41:10 +01:00
Dunajski, Bartosz
d8f8b70dd7 feature: initial support of zexCounterBasedEventCreate
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-12 15:11:00 +01:00
Warchulski, Jaroslaw
d1061cd923 fix: don't unregister csr clients in EventImp::reset()
Related-To: GSD-7129
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com>
2024-01-12 14:35:20 +01:00
Dominik Dabek
b3b402cad2 feature(zebin): read indirect detection version
Read indirect detection version intel compat notes from zebin.

This is to prepare for enabling indirect access optimization in AOT
built kernels.

Related-To: NEO-7712

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-12 14:20:52 +01:00
Fabian Zwolinski
a3bd629aff fix: store image implicit args in bindless slot 1
bindless slot 0: image
bindless slot 1: image implicit args
bindless slot 2: redescribed image

Redescribed image moved one slot higher.
Separate allocation is created for new bindless slot.

Related-To: NEO-9740
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
2024-01-12 13:09:06 +01:00
Dunajski, Bartosz
aaef241111 refactor: allow creating Event without pool object
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-12 10:08:17 +01:00
Lu, Wenbin
0db5b630c9 fix: do not force root device when opening IPC handles
Related-To: NEO-9422

Signed-off-by: Lu, Wenbin <wenbin.lu@intel.com>
2024-01-12 09:38:57 +01:00
Fabian Zwolinski
903e581b5f fix: add support for bindless implicit args
Support for:
global_base and const_base in bindless addressing mode.

Related-To: NEO-9855
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
2024-01-12 01:27:17 +01:00
Dunajski, Bartosz
6abce2b29d feature: zexEventGetDeviceAddress support
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-11 16:22:11 +01:00
Dunajski, Bartosz
b9fe6a3f18 feature: allow patching CB Events on non-inOrder regular cmd lists
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-11 15:19:45 +01:00
Dunajski, Bartosz
3ef96a157c test: move in-order cmdlist test to new file
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-11 12:30:57 +01:00
Dunajski, Bartosz
b18acc26b7 feature: new API to create and export counter-based Event
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-11 09:42:38 +01:00
He, Wenju
47ed5947c7 test: align testBindlessImageSampled's mode with testBindlessImages
Also fix outputValidated to be false if any of the tests fail.

Related-To: NEO-7063
Signed-off-by: He, Wenju <wenju.he@intel.com>
2024-01-10 10:15:45 +01:00
Mateusz Jablonski
a73fb4d2fe fix: correct reporing kernel private size on L0
unify the logic across APIs

Related-To: NEO-9944
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-01-09 09:54:05 +01:00
Dunajski, Bartosz
2082038475 fix: fallback empty counter based pool flags to immediate mode
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-05 19:05:40 +01:00
He, Wenju
bbb8193be7 test: Add read_image test with sampler to zello_bindless_kernel
This is helpful to debug sampler support in default and bindless modes.

Related-To: NEO-7063
Signed-off-by: He, Wenju <wenju.he@intel.com>
2024-01-05 15:10:26 +01:00
Mateusz Hoppe
425ae43ed1 feature: use high priority csr from secondary contexts
Related-To: NEO-7824

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-01-05 08:26:11 +01:00
Dunajski, Bartosz
57900c5455 refactor: improve single slice dispatch mode handling
Related-To: NEO-8210

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-04 15:24:09 +01:00
Lukasz Jobczyk
d472cf0a5d fix: Restore handle fence completion when reusing cmd buffer
Related-To: NEO-7116

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-04 12:11:39 +01:00
Dunajski, Bartosz
cd7775f4e2 refactor: add helper to get cmd list type
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-04 10:20:34 +01:00
Dunajski, Bartosz
9d1837fd7e feature: counter based events flags error handling
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-04 09:23:52 +01:00
Dunajski, Bartosz
c03fe171f8 fix: add missing API to extension lookup map
Related-To: NEO-7966

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-03 16:44:39 +01:00
Dunajski, Bartosz
144a78019f feature: initial support for counter based event flags 2
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-01-03 10:01:27 +01:00
Compute-Runtime-Validation
7fa29ba8b5 Revert "feature: initial support for counter based event flags"
This reverts commit f530cf3cc2.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2023-12-30 00:25:47 +01:00
Dunajski, Bartosz
87857a6558 feature: add new PVC device id
Related-To: NEO-9736

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2023-12-29 19:06:33 +01:00
Dunajski, Bartosz
f530cf3cc2 feature: initial support for counter based event flags
Related-To: NEO-8145

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2023-12-29 13:59:21 +01:00
Mateusz Hoppe
31e9b5e9fa feature: add support for secondary contexts in group
Related-To: NEO-7824

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2023-12-28 13:31:08 +01:00
Dunajski, Bartosz
8ca8d72a4c fix: remove explicit template instantiation
Related-To: NEO-9888

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2023-12-28 11:29:03 +01:00
Dunajski, Bartosz
8360d90fa3 refactor: improve PostSync handling
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2023-12-27 15:29:50 +01:00
Dunajski, Bartosz
df66a0276f refactor: remove not used logic to check dynamic postsync layout
Related-To: NEO-8210

Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2023-12-27 13:12:11 +01:00
Dominik Dabek
2fe3804cc2 performance(ocl): add usm allocation pooling flag
EnableDeviceUsmAllocationPool and EnableHostUsmAllocationPool for device
and host allocations respectively.

Pool size will be set to flag value * MB.

Allocation size threshold to be pooled is 1MB.

Pools are created per context.

Related-To: NEO-9700

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2023-12-27 11:42:01 +01:00
Compute-Runtime-Validation
f2c9d7172a Revert "fix: store image implicit args in bindless slot 1"
This reverts commit b6d572ddb8.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
2023-12-23 12:01:42 +01:00
Dominik Dabek
239831f097 fix: return error for 0 size usm allocations
according to both level zero and opencl specs, usm allocations with
size=0 should return invalid/unsupported buffer size errors

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2023-12-22 17:26:39 +01:00
Dunajski, Bartosz
d6560c5bba refactor: pass additional in-order params to PatchCmd helper
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2023-12-21 19:21:56 +01:00
Kacper Nowak
18fb432552 refactor: Stop using hard-coded BCS engine as default one
Do not rely on presence of BCS0 engine.

Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2023-12-21 17:34:57 +01:00
Mateusz Jablonski
0f5389b452 refactor: rename alias PARSE -> Parse
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-21 16:17:15 +01:00
Fabian Zwolinski
880ab8e5c3 fix: correct img destruction order in zello_image_view
Signed-off-by: Fabian Zwolinski <fabian.zwolinski@intel.com>
2023-12-21 14:53:47 +01:00
Mateusz Hoppe
024f3ffdf5 test: add zello_atomic_inc
- run 2 cmdlists with dependency that atomically increment buffer element
- collect timestamps
- allow inverse submission order

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2023-12-21 10:03:20 +01:00
Mateusz Jablonski
a4888b39c6 build: add clang-tidy restriction for Enum case
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-21 08:58:51 +01:00