58707e0cf7
Revert "refactor: migration to std::make_unique C++17"
...
This reverts commit 4cf685cb7d
2025-01-09 01:41:36 +01:00
4cf685cb7d
refactor: migration to std::make_unique C++17
...
Signed-off-by: Semenov Herman (Семенов Герман) <GermanAizek@yandex.ru>
2025-01-08 17:20:00 +01:00
2815d4167d
fix: don't use staging for map allocations
...
Related-To: NEO-13572
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2025-01-07 13:30:11 +01:00
1135c1033e
fix: set staging buffer writeable for aub and tbx
...
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-12-23 13:35:01 +01:00
6843632298
refactor: move SWTagsManager::currentCallCount to protected scope
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-12-19 12:31:44 +01:00
ee0648c365
refactor: use virtualFileSystem in FileLogger ULTs
...
restored the possibility of different writing modes in the FileLogger
mocked writeToFile in TestFileLogger
Related-To: NEO-7006
Signed-off-by: Marcel Skierkowski <marcel.skierkowski@intel.com>
2024-12-18 19:01:39 +01:00
b1dea19fbd
refactor: move tag initialization to allocator [1/n]
...
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-12-17 17:53:13 +01:00
e61d04a881
fix(ocl): track buffer pool count per device
...
Track amount of created buffer pools per device. Do not allocate extra
pools if limit is reached. New contexts will have pooling disabled if
limit is reached on device.
Related-To: NEO-13461
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-12-16 11:38:05 +01:00
e27a6dc280
refactor: use virtualFileSystem in ULTs
...
reducing the number of tests that have interactions with filesystem.
writeDataToFile() saves filename and content in std::map.
fileExistsHasSize() checks if file was previously written to virtualFileSystem
loadDataFromVirtualFile() fetches data from std::map based on filename
Related-To: NEO-7006
Signed-off-by: Marcel Skierkowski <marcel.skierkowski@intel.com>
2024-12-13 17:57:07 +01:00
6c4eb322b1
performance: introduce staging reads from image
...
Related-To: NEO-12968
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-12-11 14:43:45 +01:00
5f8e761541
fix: HeapAllocator - ensure getBaseAddress returns initial base address
...
getBaseAddress was incorrectly returning pLeftBound which changes after
memory allocation.
Added baseAddress field to store and return initial address value.
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-12-10 10:52:36 +01:00
58e45afd39
Revert "fix: HeapAllocator - ensure getBaseAddress returns initial base address"
...
This reverts commit ffec97acc5
2024-12-08 14:35:22 +01:00
ffec97acc5
fix: HeapAllocator - ensure getBaseAddress returns initial base address
...
getBaseAddress was incorrectly returning pLeftBound which changes after
memory allocation.
Added baseAddress field to store and return initial address value.
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-12-05 20:42:16 +01:00
d2ce3badfc
fix: bindlessHeapsHelper handle unavailable external heap
...
This PR handles the situation in which a component
has reserved a front window space for itself in the external heap,
so that the Compute Runtime cannot access this area.
In such a situation, we perform the following steps:
1. reserve 4GB chunk in heapStandard
2. split our chunk into 2 parts: heapFrontWindow, heapRegular
3. from this point on, map all linearStream allocations in reserved 4GB
chunk
Patch applies to Windows and WSL.
Patch only applies when the bindless global allocator is enabled.
Related-To: HSD-16025889919
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-12-05 14:18:01 +01:00
16684d8803
fix: reuse staging buffers from other csr
...
Related-To: NEO-13247
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-11-18 16:39:57 +01:00
7bf22ed33e
feature: counter based allocation peer sharing
...
Related-To: NEO-13079
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-11-13 15:01:32 +01:00
72efceb8a3
fix: try to lower alignment in heap allocator when it is too big
...
Related-To: GSD-8948
Signed-off-by: Jaroslaw Warchulski <jaroslaw.warchulski@intel.com>
2024-11-13 09:14:12 +01:00
1199e19df5
performance: enable image writes through staging chunks
...
Related-To: NEO-12968
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-11-07 13:43:25 +01:00
a25e973205
performance: write image through staging chunks
...
Related-To: NEO-12968
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-11-06 16:45:22 +01:00
2febf0597e
fix: remove incorrect code
...
- freed pointer cannot overlap with freed chunks, therefore there is no way
to merge it with freed chunks if they overlap
Signed-off-by: Mrozek, Michal <michal.mrozek@intel.com>
2024-11-05 18:58:41 +01:00
fe82425fa9
performance: Prefer to assign new gpu va rather than reuse
...
Resolves: NEO-10734
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-11-05 10:16:03 +01:00
5d62be2bea
performance: enable staging buffer for write image
...
Related-To: NEO-12968
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-11-05 06:06:07 +01:00
aca7875dfd
Revert "performance: Prefer to assign new gpu va rather than reuse"
...
This reverts commit 0f2f3c3764
2024-10-31 05:06:43 +01:00
cf58be4142
performance: use staging buffer when writing to an image
...
Related-To: NEO-12968
Also, don't import usm/mapped allocations for image
operations
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-10-30 17:02:13 +01:00
0f2f3c3764
performance: Prefer to assign new gpu va rather than reuse
...
Resolves: NEO-10734
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-10-30 16:48:49 +01:00
45e78fea76
fix: use productHelper in getPatIndexInfoString() on Windows
...
Fix the PAT-index reporting in logger as currently on Windows reported
values are simply wrong.
The changed logic dependends on `RootDeviceEnvironment` and in order to
avoid introducing such dependencies into logger.[ch] the
`logAllocation()` is no longer a member of `FileLogger` but
a free-function instead (and a separate .cpp file). This is important
because the source files `logger.[ch]` are also used by ocloc library
and there is no point to contaminate ocloc code structure with
unnecessary dependencies.
Related-To: NEO-9421
Signed-off-by: Maciej Bielski <maciej.bielski@intel.com>
2024-10-22 19:27:13 +02:00
7b54ca131f
fix: avoid OOB access in StackVec::resizeImpl
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-19 13:54:24 +02:00
ebfa384a74
fix: avoid calling free on non-heap object
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-09-13 16:34:23 +02:00
dd631610b3
refactor: move memory tracking to memory manager
...
- remove wddm specific code
- improve total size reported to be in decimal
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-12 17:32:38 +02:00
da59b88122
refactor: improve logging of allocations
...
add capability to measure total amount of allocated memory
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-12 11:00:27 +02:00
7cba813c81
refactor: improve logging by adding size.
...
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2024-09-11 20:33:55 +02:00
38e1614f4a
fix: create and use new allocation type for syncBuffer
...
Related-To: NEO-11533
Related-To: HSD-18039788811
Signed-off-by: Fabian Zwoliński <fabian.zwolinski@intel.com>
2024-09-06 14:11:33 +02:00
c934877790
refactor: remove not needed function
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2024-08-30 12:18:14 +02:00
fb8921df97
fix: enable file logger for ReleaseInternal configuration
...
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2024-08-26 10:54:41 +02:00
556ba1b7c4
performance: Avoid data copy in getPciStats function
...
Additionally explicitly remove unused functions of Directory and
StagingBuffer classes to comply with rule of five.
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-08-22 13:30:01 +02:00
0590b34cfa
feature: refactor and rewrite setErrorDescription
...
Related-To: NEO-8379
Signed-off-by: Winston Zhang <winston.zhang@intel.com>
2024-08-21 17:26:25 +02:00
3ccab79ed8
test: dir create
...
Related-To: NEO-11500
Signed-off-by: Oskar Hubert Weber <oskar.hubert.weber@intel.com>
2024-08-05 13:58:25 +02:00
c3312f21f7
feature: dont initialize in-order TS nodes
...
Related-To: NEO-11925
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-07-23 13:31:23 +02:00
f8867ac3ac
fix: Minor code improvements
...
Add explicit pointer checks to CommandQueue::blitEnqueueAllowed.
Explicitly check result of getDeviceArgValueIdx during ocloc compile.
Explicitly remove unused StagingBufferManager functions.
Move chunkCopyFunc by reference.
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2024-07-19 09:24:37 +02:00
ed7fc9acc9
performance: use staging buffer as a pool
...
Related-To: NEO-11501
Currently whole staging buffer is consumed even if
size of the transfer is smaller than that buffer.
This commit changes that, so single staging buffer
might be utilized by several smaller transfers
as long as they don't exceed total size
Signed-off-by: Morek, Szymon <szymon.morek@intel.com>
2024-07-18 12:54:00 +02:00
dbd96372be
performance: adjust staging buffer usage
...
Related-To: NEO-11928
Don't copy through staging buffer if dst usm allocation
was not used before and transfer would be splitted.
Also, don't use staging buffers for mapped ocl buffers.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-07-10 10:19:18 +02:00
96c9956d50
refactor: remove debug break
...
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2024-07-04 11:00:54 +02:00
a7ddf7848b
fix: fatbinary generation with "-out_dir"
...
Directories are created if needed before generating fatbinary.
Related-To: NEO-11500
Signed-off-by: Oskar Hubert Weber <oskar.hubert.weber@intel.com>
2024-07-02 13:33:53 +02:00
29e3eb512c
performance: non-usm copy through staging buffers
...
Related-To: NEO-11501
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-06-25 07:18:53 +02:00
34e5e18fa6
fix: delete move assignment operator
...
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-05-31 18:59:51 +02:00
de789ac7e5
Revert "performance: remove page size limit for sharing ISAs"
...
This reverts commit e7c036a91b
2024-05-12 09:00:32 +02:00
e7c036a91b
performance: remove page size limit for sharing ISAs
...
Related-To: NEO-9403
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-05-10 08:56:49 +02:00
10ed479b16
performance: share inter-module ISA allocations
...
Related-To: NEO-10258
Currently each module has it's own GA
for kernel ISA's. This change allows new modules to
reuse existing allocation.
Signed-off-by: Szymon Morek <szymon.morek@intel.com>
2024-05-09 08:43:55 +02:00
b499973658
refactor: removing unnecessary lock
...
Related-To: NEO-8196
Lock in the constructor should not affect the flow of the code
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2024-04-23 17:39:50 +02:00
74dcb5a9e3
feature: initial support for sync dispatch token allocation
...
Related-To: NEO-8171
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2024-03-26 12:07:58 +01:00
fe377b6597
feature: add out cmd pointer to store data imm encoder
...
Related-To: NEO-10385
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-03-07 12:52:08 +01:00
bbe1043f08
feature: initial support for pooling in-order counter allocations
...
Related-To: NEO-10507
Signed-off-by: Dunajski, Bartosz <bartosz.dunajski@intel.com>
2024-03-01 12:08:02 +01:00
964f0166d7
fix: Reuse freed chunk from left even if not aligned
...
Related-To: NEO-10416, NEO-10418, NEO-10437
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2024-02-21 12:31:54 +01:00
b58717b9e3
feature: Add support for legacy acronyms in ocloc's fatbinary
...
Expands support for deprecated acronyms to fatbinary. Previously,
these were allowed only in single-target builds.
Related-To: NEO-10190
Signed-off-by: Chodor, Jaroslaw <jaroslaw.chodor@intel.com>
2024-02-15 10:14:49 +01:00
233f898b59
fix: split freed chunk from right
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
Related-To: NEO-10280
2024-02-13 16:14:39 +01:00
486cc71b76
refactor: Add GDI profiling
...
Resolves: NEO-9236
Related-To: NEO-10036
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-02-07 18:44:11 +01:00
f6ca565323
Revert "feature: enable use of waitpkg intrinsic"
...
This reverts commit 2d15517fbe
2024-02-06 16:30:26 +01:00
620ad5fa89
fix: change freed chunk size when ptr is aligned
...
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
Related-To: NEO-9945
2024-01-30 12:22:28 +01:00
fa9c79fb63
Revert "refactor: Add GDI profiling"
...
This reverts commit 524ae7713a
2024-01-30 10:47:34 +01:00
dcab4863d5
performance(ocl): calculate max buffer pool count
...
Set max buffer pool count to use at most 2 percent of device total memory.
Related-To: NEO-9690
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-30 07:04:36 +01:00
524ae7713a
refactor: Add GDI profiling
...
Resolves: NEO-9236
Related-To: NEO-10036
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-29 11:36:04 +01:00
a25eedb5ac
feature: add print of cpu flags and address size upon detection
...
Related-To: NEO-9737
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-01-24 11:03:30 +01:00
6e434e0424
performance(ocl): increase buffer pool size
...
increase pool size to 2MB and threshold to 1MB
add limit to the number of pools, set to 2
Related-To: NEO-9690
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-24 10:55:29 +01:00
2d15517fbe
feature: enable use of waitpkg intrinsic
...
Related-To: NEO-9737
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-01-24 10:46:28 +01:00
7bbe57c671
feature: add debug info for logging pat indexes
...
Related-To: HSD-18031172224
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2024-01-23 13:34:35 +01:00
e949ba7144
Revert "refactor: Add GDI profiling"
...
This reverts commit 8d56f8fb6b
2024-01-23 06:13:02 +01:00
8d56f8fb6b
refactor: Add GDI profiling
...
Resolves: NEO-9236
Related-To: NEO-10036
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2024-01-22 14:24:08 +01:00
b5f698e0c5
feature: add umonitor and umwait synchronization function
...
Related-To: NEO-9737
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2024-01-19 14:20:19 +01:00
af1620a308
fix(ocl): allocation info from pool svm ptr
...
Fix querying allocation info from pooled svm ptr.
Handle requested allocation alignment.
Refactor sorted vector usage.
Do not associate device with host pool allocation.
Related-To: NEO-9700
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2024-01-05 15:20:01 +01:00
2fe3804cc2
performance(ocl): add usm allocation pooling flag
...
EnableDeviceUsmAllocationPool and EnableHostUsmAllocationPool for device
and host allocations respectively.
Pool size will be set to flag value * MB.
Allocation size threshold to be pooled is 1MB.
Pools are created per context.
Related-To: NEO-9700
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2023-12-27 11:42:01 +01:00
7418cff844
feature: add debug flags and instrumentation of waitpkg calls
...
Related-To: NEO-9737
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2023-12-22 08:34:13 +01:00
de93bc6928
refactor: correct naming of enum class constants 10/n
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-19 11:30:39 +01:00
7e795cd3c1
feature: Adding support for OCL C support queries to ocloc
...
Feature needed for automated OCL C compilation with ocloc as backend.
Added queries :
* CL_DEVICE_EXTENSIONS
* CL_DEVICE_EXTENSIONS_WITH_VERSION
* CL_DEVICE_PROFILE
* CL_DEVICE_OPENCL_C_ALL_VERSIONS
* CL_DEVICE_OPENCL_C_FEATURES
Sample command line:
ocloc query -device skl CL_DEVICE_OPENCL_C_FEATURES
Related-To: GSD-7420
Signed-off-by: Chodor, Jaroslaw <jaroslaw.chodor@intel.com>
2023-12-18 15:19:16 +01:00
fa44cc13a6
feature: add wrappers to waitpkg intrinsics
...
Related-To: NEO-9737
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2023-12-14 13:52:18 +01:00
9024e4a548
feature: add detection of cpu waitpkg support
...
Related-To: NEO-9737
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2023-12-13 15:28:35 +01:00
88db02e5a8
Revert "performance(ocl): set buffer pool size to 2MB"
...
This reverts commit b2cfd1877e
2023-12-13 15:18:02 +01:00
2146cd07ee
refactor: SortedVectorBasedAllocationTracker
...
Move code out to base class. This will allow to use the sorted vector
class with different values than only SvmData.
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2023-12-13 12:47:04 +01:00
01dd503e47
refactor: correct naming of MemoryPool enum values
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-13 07:51:39 +01:00
b182917d9d
refactor: correct naming of allocation types
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-11 16:23:37 +01:00
a2994e9b29
Revert "performance(ocl): set pool allocator threshold 1MB"
...
This reverts commit fc1d93af8e
2023-12-09 07:02:42 +01:00
c8c3f862f4
refactor: Add key to force zero copy without coherency
...
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2023-12-07 07:56:54 +01:00
fc1d93af8e
performance(ocl): set pool allocator threshold 1MB
...
Increase pool allocator threshold to 1MB
Remove stack allocations based on threshold in tests.
Related-To: NEO-9690
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2023-12-06 19:55:48 +01:00
da957d1a37
refactor: correct naming of enum class constants 1/n
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-05 14:26:42 +01:00
6849d33326
refactor: remove redundant definitions KB/MB/GB
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-05 08:55:18 +01:00
b2cfd1877e
performance(ocl): set buffer pool size to 2MB
...
Increase small buffer pool allocator size to 2MB
Related-To: NEO-9690
Signed-off-by: Dominik Dabek <dominik.dabek@intel.com>
2023-12-05 00:35:55 +01:00
c3d3a4db1f
refactor: correct variable naming
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-04 13:45:53 +01:00
b92b5892b8
refactor: correct variable naming
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-01 08:34:19 +01:00
c3ac7b78bd
refactor: correct variable naming
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-12-01 02:18:46 +01:00
c9664e6bad
refactor: rename global debug manager to debugManager
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-11-30 13:00:59 +01:00
36194c4e7d
refactor: correct variable namings
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-11-29 23:49:03 +01:00
140532f8b6
fix: fix issues with clang-tidy on Windows
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-11-16 12:30:11 +01:00
cec6492cd9
fix: fix issues with ubsan in shared and ocl
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-11-13 12:40:57 +01:00
c160e6ff93
fix: sporadic in software tags test
...
Related-To: NEO-9272
Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2023-11-09 15:50:34 +01:00
781533565e
fix: fix issues with ubsan in shared and OCL tests
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-11-09 12:39:29 +01:00
4a5d9eeae7
refactor: do not trigger debug break when mkdir fails with EEXIST
...
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2023-11-02 12:26:32 +01:00
036d1e4814
refactor: correct variable naming
...
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2023-10-30 12:48:51 +01:00
c4a24d8f31
fix: Avoiding races when modifying queue and Tag data
...
Related-To: NEO-8196
Signed-off-by: Andrzej Koska <andrzej.koska@intel.com>
2023-10-25 14:20:57 +02:00
ac5f64f5c6
fix: fix compilation error in clang on Windows (2/n)
...
Signed-off-by: Jablonski, Mateusz <mateusz.jablonski@intel.com>
2023-10-24 15:59:06 +02:00
90987bd878
feature: add minimal interface for software tag injection
...
* Add new Software Tag `ArbitraryString`
* Add minimal interface for injecting software tags
Related-To: NEO-5550
Signed-off-by: Marek Kozlowski <marek.kozlowski@intel.com>
2023-10-20 01:49:33 +02:00
af7bcbf99c
Revert "refactor: split CpuInaccessible MemoryPool types to Device and System"
...
This reverts commit 2e8cf5fdf5
2023-10-17 10:03:14 +02:00
Compute-Runtime-Validation