intel/compute-runtime
1
0
Fork 0
mirror of https://github.com/intel/compute-runtime.git synced 2026-01-03 06:49:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
20,292 Commits 43 Branches 655 Tags
314b04d97ba21033b93676bcf1c44bb4e36c357c
Commit Graph

820 Commits

Author SHA1 Message Date
Compute-Runtime-Validation
484210d656 Revert "fix: limit usm device reuse based on used memory" 
This reverts commit 1252b10ba9.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-12-05 23:17:51 +01:00
Fabian Zwoliński
d2ce3badfc fix: bindlessHeapsHelper handle unavailable external heap 
This PR handles the situation in which a component
has reserved a front window space for itself in the external heap,
so that the Compute Runtime cannot access this area.

In such a situation, we perform the following steps:
1. reserve 4GB chunk in heapStandard
2. split our chunk into 2 parts: heapFrontWindow, heapRegular
3. from this point on, map all linearStream allocations in reserved 4GB
chunk

Patch applies to Windows and WSL.
Patch only applies when the bindless global allocator is enabled.

Related-To: HSD-16025889919
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
 2024-12-05 14:18:01 +01:00
Dominik Dabek
1252b10ba9 fix: limit usm device reuse based on used memory 
Calculate available memory for usm device reuse based as (total device
memory - used memory) * fraction for reuse.

Use sys mem allocs for devices without local memory.

Related-To: NEO-12902

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-12-04 08:11:23 +01:00
Mateusz Jablonski
2039b1c41b refactor: remove not needed code 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2024-11-28 16:16:30 +01:00
Dominik Dabek
e55aa958b7 fix: track usm reuse usage in multiple contexts 
Add tracking of memory used for usm reuse mechanism when multiple cl
contexts are used.
Tracking for device added to NEO::Device, for host added to
NEO::MemoryManager.

This fixes usm reuse using x% of memory per each context instead of
globally.

Related-To: NEO-13308

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-11-26 16:00:45 +01:00
Mateusz Jablonski
db6fe7892c fix: remove destroyed allocations from eviction lists 
mark explicitly made resident allocations

Related-To: NEO-13246, GSD-10319
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2024-11-25 22:19:54 +01:00
Wenbin Lu
2ba80ce114 feature: support physical host memory 
Related-To: NEO-11981

Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
 2024-11-20 08:19:52 +01:00
Lukasz Jobczyk
5b3d244e97 refactor: Add AIL for hostptrs drain 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2024-11-19 15:13:30 +01:00
Dominik Dabek
471615926f fix: adjust limiting device usm reuse 
if limiting, disable device usm reuse (set max size to 0)

do not reserve vector for allocation infos if reuse is disabled

Related-To: NEO-12924

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-11-15 14:37:27 +01:00
Bartosz Dunajski
7bf22ed33e feature: counter based allocation peer sharing 
Related-To: NEO-13079

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
 2024-11-13 15:01:32 +01:00
Lukasz Jobczyk
7f3896d05f performance: Ensure hostptrs removed before creating new one 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2024-11-12 13:55:15 +01:00
Szymon Morek
8aa5331bc1 fix: wait for latest known usage of indirect usm 
Related-To: GSD-9989

Signed-off-by: Szymon Morek <szymon.morek@intel.com>
 2024-11-04 16:24:30 +01:00
Alicja Lukaszewicz
654fdc1345 feature: add query for additional device properties 
Related-To: NEO-12590

Signed-off-by: Alicja Lukaszewicz <alicja.lukaszewicz@intel.com>
 2024-10-29 20:40:27 +01:00
Bartosz Dunajski
7f5e6b4124 Revert "fix: Enable 64k pages for TSB allocation" 
This reverts commit eed69f45ed.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
 2024-10-28 16:02:34 +01:00
Dominik Dabek
741101551e fix: add infrastructure to limit device usm reuse max memory used 
Related-To: NEO-12924

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-10-25 21:54:41 +02:00
Jaroslaw Warchulski
2ba5ee2f6b Revert "fix: use full size for HEAP_EXTENDED initialization" 
This reverts commit 5afc63df93.

Related-To: GSD-8948
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
 2024-10-22 19:27:31 +02:00
Maciej Bielski
45e78fea76 fix: use productHelper in getPatIndexInfoString() on Windows 
Fix the PAT-index reporting in logger as currently on Windows reported
values are simply wrong.

The changed logic dependends on `RootDeviceEnvironment` and in order to
avoid introducing such dependencies into logger.[ch] the
`logAllocation()` is no longer a member of `FileLogger` but
a free-function instead (and a separate .cpp file). This is important
because the source files `logger.[ch]` are also used by ocloc library
and there is no point to contaminate ocloc code structure with
unnecessary dependencies.

Related-To: NEO-9421
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
 2024-10-22 19:27:13 +02:00
Wenbin Lu
a8a40d2afd feature: support SVM heap in reserveVirtualMem 
Related-To: NEO-11981

Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
 2024-10-22 16:47:14 +02:00
Bartosz Dunajski
eed69f45ed fix: Enable 64k pages for TSB allocation 
Related-To: HSD-18040274716

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
 2024-10-22 15:12:42 +02:00
Lukasz Jobczyk
8a647f6a39 Revert "performance: Ensure hostptrs removed before creating new one" 
This reverts commit 5b2f2f3d83.

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2024-10-21 10:36:06 +02:00
Jaroslaw Warchulski
5afc63df93 fix: use full size for HEAP_EXTENDED initialization 
Related-To: GSD-8948
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
 2024-10-18 18:14:34 +02:00
Bartosz Dunajski
52e9a6e07f feature: Initial CB events IPC support 
Related-To: NEO-11925

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
 2024-10-16 13:33:59 +02:00
Jaroslaw Warchulski
5626295e61 fix: don't split HEAP_EXTENDED among root devices 
Related-To: GSD-8948
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
 2024-10-15 15:01:29 +02:00
Bartosz Dunajski
f430279d62 fix: change doorbell type 
Related-To: NEO-12870

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
 2024-10-14 14:58:11 +02:00
Mateusz Hoppe
5ae2552b4b fix: track shifted contextIds in bitset in bindlessHeapsHelper 
- bitset is 64 bit in size, context ids may go beyond that limit
when multiple devices are available
- this change subtracts contextId of first context for a given root
device - tracked state dirty contexts ids are now zero-based

Resolves: GSD-10025

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2024-10-09 10:32:29 +02:00
Lukasz Jobczyk
5b2f2f3d83 performance: Ensure hostptrs removed before creating new one 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2024-10-08 13:04:56 +02:00
Dominik Dabek
9159e2acd4 fix: limit max size for allocation reuse 
Limit max size for allocation reuse mechanism to 256MB.

Related-To: NEO-6893

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-10-08 11:52:47 +02:00
Compute-Runtime-Validation
60afb83b3b Revert "performance: Ensure hostptrs removed before creating new one" 
This reverts commit a890ed5648.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-10-08 07:45:55 +02:00
Dominik Dabek
3685852ce0 Revert "performance: device usm sets localOnly... 
Required"

This reverts commit a479afdbc8.

Related-To: NEO-12879

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-10-07 11:59:37 +02:00
Compute-Runtime-Validation
41df1a6f47 Revert "feature: support SVM heap in reserveVirtualMem" 
This reverts commit bfaeeb01d6.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-10-03 14:53:50 +02:00
Dominik Dabek
752f313808 fix: limit allocation cache memory wastage 
Allocations over a certain size will be checked for memory utilization
when chosen for reuse.
If utilization is below a threshold, they will not be reused.

Related-To: NEO-6893

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-10-01 09:49:19 +02:00
Maciej Plewka
80f75ceace fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
 2024-09-23 14:43:59 +02:00
Lukasz Jobczyk
a890ed5648 performance: Ensure hostptrs removed before creating new one 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2024-09-19 14:34:19 +02:00
Compute-Runtime-Validation
e4d2f16632 Revert "performance: Ensure hostptrs removed before creating new one" 
This reverts commit ac1d203555.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-09-18 19:31:34 +02:00
Lukasz Jobczyk
ac1d203555 performance: Ensure hostptrs removed before creating new one 
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
 2024-09-18 14:23:16 +02:00
Michal Mrozek
dd631610b3 refactor: move memory tracking to memory manager 
- remove wddm specific code
- improve total size reported to be in decimal

Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
 2024-09-12 17:32:38 +02:00
Michal Mrozek
da59b88122 refactor: improve logging of allocations 
add capability to measure total amount of allocated memory
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
 2024-09-12 11:00:27 +02:00
Dominik Dabek
f03c2fd4a7 fix: initialize scalar field, usm pooling 
Related-To: NEO-6893

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-09-11 11:44:56 +02:00
Dominik Dabek
b2fc7345cf performance: redesign usm alloc reuse mechanism 
Dedicated pools for different allocations size ranges.
Additional reused allocations will create their own pools.
Do not reuse allocations >256MB.

Related-To: NEO-6893, NEO-12299, NEO-12349

Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
 2024-09-10 18:12:14 +02:00
Wenbin Lu
bfaeeb01d6 feature: support SVM heap in reserveVirtualMem 
Related-To: NEO-11981

Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
 2024-09-09 23:22:04 +02:00
Fabian Zwoliński
38e1614f4a fix: create and use new allocation type for syncBuffer 
Related-To: NEO-11533
Related-To: HSD-18039788811
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
 2024-09-06 14:11:33 +02:00
Compute-Runtime-Validation
d842f65cf1 Revert "fix: submit dummy exec to pin memory during zeContextMakeMemoryReside... 
This reverts commit f9b87d53e6.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-09-05 03:28:03 +02:00
Maciej Plewka
f9b87d53e6 fix: submit dummy exec to pin memory during zeContextMakeMemoryResident call 
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>

Related-To: NEO-11879
 2024-09-04 14:07:29 +02:00
Mateusz Hoppe
32fb476f6d refactor: debugbreak in simulation on memcopy to multi bank allocation 
- if allocation has multiple banks, memcpy cannot write different data
for multiple banks

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2024-09-04 12:27:20 +02:00
Compute-Runtime-Validation
a4f68c57bb Revert "refactor: debugbreak in simulation on memcopy to multi bank allocation" 
This reverts commit 1c51734642.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-09-04 05:48:55 +02:00
Mateusz Hoppe
1c51734642 refactor: debugbreak in simulation on memcopy to multi bank allocation 
- if allocation has multiple banks, memcpy cannot write different data
for multiple banks

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
 2024-09-03 20:47:50 +02:00
Compute-Runtime-Validation
99f62ac866 Revert "feature: support SVM heap in reserveVirtualMem" 
This reverts commit 93cde3ee12.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-09-03 20:20:25 +02:00
Wenbin Lu
93cde3ee12 feature: support SVM heap in reserveVirtualMem 
Related-To: NEO-11981

Signed-off-by: Wenbin Lu <wenbin.lu@intel.com>
 2024-09-03 11:38:51 +02:00
Mateusz Jablonski
b6eb4792dc performance: return const ref instead of struct copy from getBindlessInfo 
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
 2024-09-02 18:40:01 +02:00
Compute-Runtime-Validation
956dd8e17d Revert "fix: set properly resource params when setAllocationType" 
This reverts commit 2e0884a301.

Signed-off-by: Compute-Runtime-Validation <compute-runtime-validation@intel.com>
 2024-08-24 05:01:38 +02:00