Commit Graph

120 Commits

Author SHA1 Message Date
Slawomir Milczarek 2a1069eda2 Configure 2MB alignment for allocations on standard heap 64k
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-01-22 11:56:33 +01:00
Krzysztof Gibala c27d8c8dfd Wait for all gpuAllocation in clMemBlockingFreeINTEL call
Related-To: NEO-5422
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-01-20 10:28:32 +01:00
Krzysztof Gibala ae1e5a91b4 Unlock multi device setup for shared allocation
Related-To: NEO-5422
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-01-15 11:08:11 +01:00
Igor Venevtsev cb13a5184d Check for supported CPU VA size in GfxPartition initialization
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-01-14 16:55:59 +01:00
Slawomir Milczarek 068cb09c90 Add function to check for USM host allocations in SVM Allocs Manager
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-01-12 15:41:24 +01:00
Krzysztof Gibala 3385500396 Use createHostUnifiedMemoryAllocation in clHostMemAllocINTEL
Unlock multi device setup for host allocation

Related-To: NEO-5422
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-01-05 17:16:59 +01:00
Mateusz Hoppe b9aee10679 Initialize internal heaps with at least minAddress from Wddm
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-04 13:13:13 +01:00
Mateusz Jablonski 1b7d7afc07 Refactor USM properties
store reference to std of root device indices and device bitfields
store NEO::Device in USM properties

Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-30 11:36:56 +01:00
Slawomir Milczarek b2cae02f66 Add kernel fixture with stateless indirect access
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-12-15 13:23:37 +01:00
Slawomir Milczarek ff069c1171 Enable AUB memory dumps of USM allocations
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-12-01 11:24:41 +01:00
Slawomir Milczarek b4444c7660 Move close shared handle to the upper layer on Linux
Related-To: NEO-5274

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-11-23 11:45:05 +01:00
Mateusz Hoppe 0f42ef1ed7 Differentiate between users ISA and internal ISA allocation
Related-To: NEO-5240

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-11-16 13:16:30 +01:00
Jaime Arteaga 6f582adf5a Only add indirect USM allocations to container once
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-11-06 21:46:52 +01:00
Katarzyna Cencelewska e060536a32 Add check in allocateGraphicsMemory64kb to not use cpuPtr
when isRenderCompressed

Related-To: NEO-4532
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2020-11-06 17:14:07 +01:00
Bartosz Dunajski 3ed2823d45 Revert "Always reserve 48 bit window on 57 bit CPU"
This reverts commit 8f10db0c7ff13a72526141269ad09142a5d74e5f.

Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-06 14:12:46 +01:00
Krzysztof Gibala 3d9a180c12 Implement local memory path for all devices in buffer
Related-To: NEO-4589
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2020-11-05 15:01:58 +01:00
Mateusz Hoppe 4d2750161d Move OsAgnosticMemoryManager to shared
Resolves: NEO-5188
-move MockGraphicsAllocation to shared

Change-Id: I17e90af48183f003151fab075a46e40d7df3f160
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-11-02 21:02:53 +01:00
Lukasz Jobczyk 045632f355 Add new unified shared memory model
Related-To: NEO-3312

Change-Id: I640fb8d120729fa8bb2a23ff65c74c41ef27260d
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-11-02 19:23:40 +01:00
Bartosz Dunajski d35806fdd8 Improve returning global and max alloc memory size
Change-Id: I2f22481412184f01652b7e49bc30a57c56e6204b
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-30 15:58:42 +01:00
Mateusz Hoppe d539a7f8e4 Adjust AllocationProperties for SBA tracking buffer
Change-Id: I00d9d40c854c45775254b017997c53f17559daa4
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-29 15:48:25 +01:00
Igor Venevtsev 67a31d0975 Check for supported CPU VA size in GfxPartition initialization
Resolves: NEO-5220

Change-Id: I081b0c693e9d7a468be81e12d7f816fada5da21d
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2020-10-27 13:19:56 +01:00
Andrzej Swierczynski e4adb7efbf Change RequirementsStatus from enum to enum class
Related-To: NEO-5167

Change-Id: Iecf6ac74b5f757e90c36ef84a0f65339bf58e3f9
Signed-off-by: Andrzej Swierczynski <andrzej.swierczynski@intel.com>
2020-10-26 12:56:41 +01:00
Mateusz Hoppe 63d5c2b42a Assign INTERNAL_FRONT_WINDOW heap for DebugModuleArea allocation
Related-To: NEO-4550

Change-Id: Ic3209a5777245f0d1c6231cb0ce22d5327372a65
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-22 11:48:37 +02:00
Lukasz Jobczyk 5205d34894 Create multi graphics allocations with bo mmap
Change-Id: I97e3e3ddc8ae0f5a8ad9246befc9b2abc9c8c0f8
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-21 17:30:32 +02:00
Mateusz Hoppe 19d3fa73bd Rename flag to use32BitFrontWindow
Change-Id: I3ecffcce2586f7164577edd3ae4d473ac68a3185
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-21 12:38:33 +02:00
Filip Hazubski d27374b468 Move aub related files to aub directory
Additionally remove dependencies on opencl code from aub and tbx code.

Related-To: NEO-3964

Change-Id: Ie81b7d274e2f22b6090df0e07c45123618af5cae
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-10-16 12:05:58 +02:00
Mateusz Hoppe 4623cb3f85 Create module debug area allocation
Related-To: NEO-4550

Change-Id: I1aa151134cb51a7d4f578de3b08cdd51aefc58f2
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-16 11:21:39 +02:00
Jaime Arteaga 6614698997 Add multi-device support to events
Change-Id: I544d2409fa5ad7c2b64f7bfd081469e80d4f9c73
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-10-15 12:54:51 -07:00
Mateusz Hoppe 067ae67954 Introduce FRONT_WINDOW heaps inside INTERNAL heaps
Related-To: NEO-4550

Change-Id: I1979afb20881bcad7999af3ac5fd4f407b85ccc7
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-15 17:18:31 +02:00
Lukasz Jobczyk 2d781e5934 Add missing USM host allocation flag
Change-Id: I5658d5574fd522cff072adcc679f04805daabf12
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-15 12:12:55 +02:00
Bartosz Dunajski 27f9a95af2 Refactor: Common helper for Blit and CPU memory transfers
Change-Id: Icc61f82517e75e3066e441494af3bf9a7ffbbeef
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-12 18:29:42 +02:00
Mateusz Hoppe 0e935b0e10 Add allowCapture flag to BufferObject
Related-To: NEO-5026

Change-Id: I69a9f270272a13fccdd1d8dd8b13ad03ef93cb79
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-10-09 17:04:43 +02:00
Lukasz Jobczyk a939c89d91 Create internal BOs with map offset
Resolves: NEO-5097

Change-Id: I842f3d482420373cc630d5bfc034e229fa2cb30c
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-10-09 16:38:03 +02:00
Bartosz Dunajski fb0651521d Linker: Fix incremental patching for local memory allocations
Change-Id: Ib85e4a2abc8a62477003853aa0c35f8107444f4e
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-10-09 09:13:42 +02:00
Igor Venevtsev bd9695a19a Get rid of UNRECOVERABLE_IF in MemoryManager constructor
Related-To: NEO-5053

Change-Id: Ibf955c760e61e34c4d38cbb5071ef712bae1c518
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2020-10-07 11:18:56 +02:00
Andrzej Swierczynski bdf8c5fc90 Extend UnifiedMemoryProperties constructor to take device bitfield
Related-To: NEO-4722

Change-Id: Ice185f1792635922e9bb89cd7329e6501bc585e0
Signed-off-by: Andrzej Swierczynski <andrzej.swierczynski@intel.com>
2020-10-06 16:35:08 +02:00
Jaime Arteaga 9f9bf38d64 Copy user buffers when not accepted by Kernel
When performing copy operations to or from buffers allocated by the
user, it could happen that the buffer address is not accepted by
kernel, even though the buffer is valid. In those ocassions, then
allocate a new graphics allocation and copy the user buffer.

Change-Id: I6b1b6f2ef5fea0acf32c868bc87eafe8746f9a79
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-10-02 10:03:18 +02:00
Maciej Plewka e34c319ed7 Special address pool at External heap begining
Change-Id: I7da6e67010ff7a819aec25abea9213b6e43e348e
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-09-29 07:51:12 +02:00
Bartosz Dunajski 8db8b09339 Use dedicated helper to detect ISA placement requirement
Change-Id: I701c64b52fddfef1e493f4adaef4edc28f5ffdf0
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-09-22 13:30:12 +02:00
Mateusz Hoppe eb287d87d7 Register Allocations
Related-To: NEO-4964

Change-Id: I792dd7f7d6d594f51701ec7a40b2c0d36531b02b
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-09-18 10:34:02 +02:00
Lukasz Jobczyk a528908cbd Unbind unused resources when running out of memory
Resolves: NEO-5052

Change-Id: I3a07221b800317c79e65396443933d13d334a274
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-09-17 12:59:45 +02:00
Maciej Dziuban 97ec64d22c Optimize first access to shared allocations
Change-Id: Ia3ce5f1e448128e7c9dfffb9ad49aaee15bdf948
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5059
2020-09-15 12:59:07 +02:00
Maciej Dziuban 7c7cfb1099 Delete unneeded memory transfer for USM
Change-Id: I7b11a132b621069febd5b851f9e29e7177d8d395
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5059
2020-09-14 16:13:58 +02:00
Zbigniew Zdanowicz 7d506e3608 Add debug flag to enable compression in L0 USM allocations
Related-To: NEO-5069

Change-Id: Icbfeb8d72cd764bb3c90d5c699998455f81dd3ee
Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-09-14 12:47:33 +02:00
Jaime Arteaga 2527015bb8 Validate rootDeviceIndex before retrieving multiGraphicsAllocation
Change-Id: I4a5f6e8ae333e8daed13053fb2049fc5757736b5
Signed-off: Gengbin Zheng <gengbin.zheng@intel.com>
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-09-09 14:06:19 +02:00
Jaime Arteaga 5c1e60208e Share USM host pointers among devices (2)
Dont pin and instantiate buffer objects associated with a USM
allocation for device >0 at allocation time, but instead, just
do a USERPTR ioctl, as with the allocation associated with
device 0.

Change-Id: Ib37f379df177d14e9d2781a3ed6335cd9550cc87
Signed-off: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-09-04 12:10:06 +02:00
Vinod Tipparaju 083edd1a3e Thread safety violation fixes - Events & USM
Change-Id: I57de59f204d9fd4407be768d0b14bf579dae967d
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2020-09-03 08:54:34 +02:00
Krzysztof Gibala dcf708f2d2 Add proper ULTs to test createMultiGraphicsAllocation function
Related-To: NEO-4589
Change-Id: Ic78dee29f7715a6e5eff5b5c28f337452921d5b3
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2020-08-31 14:49:16 +02:00
Maciej Plewka a779e44b52 Support for dsh and ssh on external heap in L0
Related-To: NEO-4724

Change-Id: I85c2effea8a99bebaf9e3db33129641f37dcabe5
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-08-30 06:56:52 +02:00
Krzysztof Gibala 1c0e2430c5 Add createMultiGraphicsAllocation function in memory_manager
Related-To: NEO-4589
Change-Id: I0019437e565c06ac2494630182c4df685487853d
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2020-08-28 14:24:34 +02:00