John Falkowski
01017a5df3
L0: add support for deferred memory free as per ContextImp::freeMemExt
...
Signed-off-by: John Falkowski <john.falkowski@intel.com >
2023-01-12 21:05:02 +01:00
Warchulski, Jaroslaw
191d4de033
Cleanup includes 28
...
Cleaned up files:
opencl/source/command_queue/command_queue.h
opencl/source/command_queue/gpgpu_walker.h
shared/source/helpers/memory_properties_helpers.h
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com >
2023-01-11 17:47:33 +01:00
Warchulski, Jaroslaw
4794648978
Cleanup includes 26
...
Cleaned up files:
opencl/source/command_queue/csr_selection_args.h
opencl/source/event/event.h
shared/source/helpers/engine_control.h
shared/source/sku_info/definitions/sku_info.h
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com >
2023-01-11 09:10:45 +01:00
Kamil Kopryk
0dbf92d401
Refactor: reduce global productHelper getter usage
...
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com >
2023-01-04 16:35:20 +01:00
Warchulski, Jaroslaw
0eac749fcc
Cleanup includes 19
...
Cleaned up files:
opencl/source/api/cl_types.h
shared/source/compiler_interface/external_functions.h
shared/source/compiler_interface/linker.h
shared/source/device_binary_format/elf/elf.h
shared/source/helpers/preamble.h
shared/source/memory_manager/definitions/storage_info.h
shared/source/memory_manager/memory_manager.h
shared/source/memory_manager/os_agnostic_memory_manager.h
shared/source/program/program_info.h
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com >
2023-01-03 11:02:05 +01:00
Warchulski, Jaroslaw
9f3fc6858e
Cleanup includes 16
...
Cleaned up files:
shared/source/built_ins/built_ins.h
shared/source/command_container/command_encoder.h
shared/source/helpers/hw_helper.h
shared/source/memory_manager/allocation_properties.h
shared/source/xe_hpc_core/hw_cmds.h
shared/test/common/test_macros/test_excludes.h
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com >
2022-12-29 15:12:37 +01:00
Warchulski, Jaroslaw
f275eea6ec
Cleanup includes 14
...
Cleaned up files:
shared/source/device/device.h
Related-To: NEO-5548
Signed-off-by: Warchulski, Jaroslaw <jaroslaw.warchulski@intel.com >
2022-12-23 10:46:34 +01:00
Compute-Runtime-Validation
429755e0f4
Revert "Check for context in appendMemoryCopy"
...
This reverts commit 32bab85f7e .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-12-21 05:38:37 +01:00
Jaime Arteaga
32bab85f7e
Check for context in appendMemoryCopy
...
Confirm the allocations used in an appendMemoryCopy operation
belong to the same context as the list.
Related-To: LOCI-1996
Resolves: NEO-6162
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com >
2022-12-20 00:13:36 +01:00
Kamil Diedrich
b36aa626bc
Add support for USM shared in WSL for dGPU
...
This patch force KMD allocation path for USM shared
Additionally we force 64kb page from lock which is
required to properly program GPU VA
Related-To: NEO-6913
Signed-off-by: Kamil Diedrich kamil.diedrich@intel.com
2022-12-19 11:09:55 +01:00
Compute-Runtime-Validation
5a29cf8508
Revert "Check for context in appendMemoryCopy"
...
This reverts commit afd0784c16 .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-12-16 03:28:06 +01:00
Jaime Arteaga
afd0784c16
Check for context in appendMemoryCopy
...
Confirm the allocations used in an appendMemoryCopy operation
belong to the same context as the list.
Related-To: LOCI-1996
Resolves: NEO-6162
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com >
2022-12-15 23:42:10 +01:00
Kamil Kopryk
232b886056
Rename HwInfoConfig to ProductHelper
...
Related-To: NEO-6853
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com >
2022-12-14 14:39:52 +01:00
Compute-Runtime-Validation
c54c3d796c
Revert "Set isLockable if size small enough for cpu memcpy"
...
This reverts commit 41a80072b9 .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-12-12 09:24:14 +01:00
Szymon Morek
41a80072b9
Set isLockable if size small enough for cpu memcpy
...
Signed-off-by: Szymon Morek <szymon.morek@intel.com >
2022-12-09 16:33:32 +01:00
Slawomir Milczarek
5c1b50bccf
Add memory prefetch modes for single and multiple subdevices
...
Single-subdevice prefetch for cmd list copy-only (with bcs) and acc mode.
Multi-subdevice prefetch (default) for shared allocation with multiple BOs.
Related-To: NEO-6740
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com >
2022-12-07 15:25:32 +01:00
Lukasz Jobczyk
7c572b4090
Do not free SVM alloc under SVM manager lock
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-12-02 12:36:10 +01:00
Lukasz Jobczyk
dbc6ac2743
Set alignment for SVM_CPU properties on xe_hpc and later
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-12-02 12:35:54 +01:00
Compute-Runtime-Validation
083471a158
Revert "Set alignment for SVM_CPU properties"
...
This reverts commit db89d2ce6b .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-12-02 08:17:13 +01:00
Lukasz Jobczyk
db89d2ce6b
Set alignment for SVM_CPU properties
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-12-01 10:45:47 +01:00
Lukasz Jobczyk
7ea11f9e44
Remove 2MB alignment from host part of shared allocation
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-11-30 17:04:24 +01:00
Maciej Plewka
4b42b066f8
Use dedicated using type for TaskCount
...
Related-To: NEO-7155
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com >
2022-11-28 16:44:44 +01:00
Compute-Runtime-Validation
7b195d6b8e
Revert "Add support for USM shared in WSL for dGPU"
...
This reverts commit 44d8a6ae2b .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-11-25 08:42:15 +01:00
Kamil Diedrich
44d8a6ae2b
Add support for USM shared in WSL for dGPU
...
This patch force KMD allocation path for USM shared
Additionally we force 64kb page from lock which is
required to properly program GPU VA
Related-To: NEO-6913
Signed-off-by: Kamil Diedrich kamil.diedrich@intel.com
2022-11-23 12:41:25 +01:00
Lukasz Jobczyk
e197736b6f
Ensure base ptr is passed to PageFaultManager::removeAllocation
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-11-17 16:12:31 +01:00
Compute-Runtime-Validation
083168dafb
Revert "Add support for USM shared in WSL for dGPU"
...
This reverts commit b0c97e49ea .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-11-16 10:09:42 +01:00
Kamil Diedrich
b0c97e49ea
Add support for USM shared in WSL for dGPU
...
This patch force KMD allocation path for USM shared
Related-To: NEO-6913
Signed-off-by: Kamil Diedrich kamil.diedrich@intel.com
2022-11-14 13:56:22 +01:00
Lukasz Jobczyk
ff500e0de6
Add support for external hostptr in shared allocations
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-11-09 14:48:01 +01:00
Maciej Plewka
1458602efc
Store indirect residency at command queue level
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com >
2022-09-22 14:07:19 +02:00
Compute-Runtime-Validation
643e21631c
Revert "Store indirect residency at command queue level"
...
This reverts commit ffad5c6c09 .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-09-20 18:12:12 +02:00
Maciej Plewka
ffad5c6c09
Store indirect residency at command queue level
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com >
Related-To: NEO-7211
2022-09-19 17:01:20 +02:00
Dominik Dabek
16798467ac
Add api specific config for allocation cache
...
Currently disabled for both opencl and level zero
Related-To: NEO-6893
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com >
2022-09-05 21:15:18 +02:00
Dominik Dabek
2d949a9f3d
Fix device allocation cache
...
Do not use aligned size when storing allocation
Trim allocation cache before deleting devices
Related-To: NEO-6893
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com >
2022-08-26 11:15:56 +02:00
Mateusz Jablonski
3d9b5d441a
Add UNRECOVERABLE_IF to avoid nullptr dereference
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com >
2022-08-09 15:44:49 +02:00
Milczarek, Slawomir
3e22f30ed5
clEnqueueMigrateMemINTEL with memory prefetch for KMD migrated shared allocation
...
Related-To: NEO-6740
Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com >
2022-07-14 17:35:22 +02:00
Dominik Dabek
cdfe2ce8ad
Feature: Flag for device usm allocation reusing
...
With flag enabled, when app calls freeSVMAlloc on device usm allocation,
don't free it immediately but save it,
and try to use it on subsequent allocations.
This allocation cache will be trimmed if an allocation fails.
Related-To: NEO-6893
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com >
2022-06-13 20:02:52 +02:00
Artur Harasimiuk
819e0f5515
style: configure readability-identifier-naming.LocalVariableCase
...
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com >
2022-05-16 12:39:44 +02:00
Dominik Dabek
8d1ad5a4f3
Refactor: use stack vector for root device indices
...
Stack vector will not cause dynamic allocations in most circumstances
ie. number of root device indices not more than 16
Related-To: NEO-6837
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com >
2022-04-14 14:05:42 +02:00
Compute-Runtime-Validation
7a3976ad64
Revert "Force 64KB page size for cpu alignment in dual storage allocation"
...
This reverts commit 7ff6a5c1fa .
Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com >
2022-04-07 00:45:07 +02:00
Kamil Diedrich
7ff6a5c1fa
Force 64KB page size for cpu alignment in dual storage allocation
...
There is no need to force 2MB alignment for CPU allocation in dual
storage usage. Additionaly for WSL this will allow to avoid usage of
malloc in driver path.
Relates-To: NEO-6620
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com >
2022-04-06 15:28:17 +02:00
Jaime Arteaga
c0e2251ceb
Skip adding allocations to remote devices if not allocated there
...
When making graphics allocations resident in multi-GPU scenarios,
we should make them resident only if there's an allocation for that
device. So return appropriate null pointer and skip it.
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com >
2022-03-16 23:58:07 +01:00
Jaime Arteaga
a010fb3634
Dont close shared handle on imported allocations
...
Related-To: LOCI-2272
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com >
2022-03-06 04:35:47 +01:00
Lukasz Jobczyk
0634aa3f1b
Create resource with given address
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-02-24 17:06:19 +01:00
Lukasz Jobczyk
c405fb5c2c
Use shared mutex for unified memory manager
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com >
2022-02-23 19:00:38 +01:00
Bartosz Dunajski
4b0d986876
Move AllocationType enum out of GraphicsAllocation class
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com >
2022-02-04 17:49:09 +01:00
Milczarek, Slawomir
2be98a1e62
Create kmd migrated allocation with initial placement
...
Implements ZE_HOST_MEM_ALLOC_FLAG_BIAS_INITIAL_PLACEMENT
for zeMemAllocShared with KMD migrated allocation.
Signed-off-by: Milczarek, Slawomir <slawomir.milczarek@intel.com >
2022-02-01 15:42:10 +01:00
Dominik Dabek
a5067d6b0b
Remove duplicate check in residency container
...
Remove find in SVMAllocsManager
addInternalAllocationsToResidencyContainer,
not needed, CSR resolves duplicates at makeResident calls
Co-authored-by: Michal Mrozek <michal.mrozek@intel.com >
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com >
2022-01-26 17:09:31 +01:00
Jaime Arteaga
dbf0f90186
Return pageSize in getMemAllocProperties
...
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com >
2022-01-25 18:26:13 +01:00
Michal Mrozek
6df17f5a30
[3/n] Optimize indirect allocations handling.
...
Add new debug variable to trigger new mode.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com >
2022-01-25 16:40:56 +01:00
Michal Mrozek
52d636394c
[1/n] Improve indirect allocations handling.
...
Add new functions that would treat all indirect allocations as single pack.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com >
2022-01-25 06:27:33 +01:00