Commit Graph

457 Commits

Author SHA1 Message Date
Krystian Chmielewski 41f3bd00ff Remove PatchTokens from KernelInfo
Use KernelDescriptor instead of patchTokens stored in KernelInfo's
patchInfo.
Removed: SPatchMediaInterfaceDescriptorLoad, SPatchAllocateLocalSurface,
SPatchMediaVFEState(slot 0), SPatchMediaVFEState(slot 1),
SPatchInterfaceDescriptorData, SPatchSamplerStateArray,
SPatchBindingTableState, SPatchDataParameterBuffer,
SPatchDataParameterStream, SPatchThreadPayload,
SPatchKernelAttributesInfo, SPatchAllocateStatelessPrivateSurface,
SPatchAllocateSyncBuffer,
SPatchAllocateStatelessConstantMemorySurfaceWithInitialization,
SPatchAllocateStatelessGlobalMemorySurfaceWithInitialization,
SPatchAllocateSystemThreadSurface.

Related-To: NEO-4729
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-03-09 17:09:13 +01:00
Mateusz Hoppe c994bf6f00 Fix pagefault Cpu transfers in TBX mode
Related-To: NEO-5286

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-03-08 19:22:02 +01:00
Bartosz Dunajski 047a93fde6 Update getExtraMmioList method
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-03-08 11:25:40 +01:00
Maciej Dziuban 1350aa52fb Pass DispatchInfo to estimation functions
Related-To: NEO-5546

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-03-05 12:47:55 +01:00
Lukasz Jobczyk 8fa97ed4a8 Fix shared buffer object size
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-03-02 14:08:47 +01:00
Mateusz Hoppe f00a2c9422 Add UseBindlessDebugSip debug variable
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-03-01 15:41:12 +01:00
Mateusz Hoppe 8f87dfaf0c Add Debug API handlers
Related-To: NEO-4554


Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-03-01 15:26:43 +01:00
Daria Hinz 13fe8ed7f1 Revert "Correct POST_SYNC for L0 Events"
This reverts commit 04d1a3255357a7778a530f054700e211d94f3b6d.

Signed-off-by: Daria Hinz <daria.hinz@intel.com>
2021-02-24 10:16:22 +01:00
Slawomir Milczarek ef3678e005 Add checks for default cache policy
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-02-19 14:16:14 +01:00
Daria Hinz 64d772d366 Fix for adding MI_SEMAPHORE_WAIT & reset L0 Event
Signed-off-by: Daria Hinz <daria.hinz@intel.com>
2021-02-18 18:33:21 +01:00
Bartosz Dunajski 15f3353351 Pass additional allocation parameters to aub_stream
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-17 14:20:08 +01:00
Lukasz Jobczyk 9d3b759d29 Do not call GEM_WAIT while direct submission active
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-17 13:22:29 +01:00
Bartosz Dunajski 584da13ff8 aub_stream interfaces update
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-16 16:03:04 +01:00
Mateusz Hoppe 6dd0f0c728 Relocate debug data
Related-To: NEO-4769

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-02-16 14:59:30 +01:00
Zbigniew Zdanowicz c35f560971 Refactor internal interface
Related-To: NEO-5244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-02-15 13:24:00 +01:00
Maciej Dziuban 98ff3cc0a9 Do not use blitter for local->local SVM and USM copies
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5549
2021-02-11 16:24:57 +01:00
Pawel Cieslak 8a700c5187 Move non-ult shared files to single directory
Add SKIP_SHARED_UNIT_TESTS flag

Related-To: NEO-5201
Signed-off-by: Pawel Cieslak <pawel.cieslak@intel.com>
2021-02-10 21:03:13 +01:00
Jaime Arteaga 1aca16a7ac Add experimental_properties for indirect access
Read zebin experimental properties indicating whether a kernel has
indirect access and if so, ignore calls to zeKernelSetIndirectAccess.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-02-10 14:23:43 +01:00
Kacper Nowak afbead513d Reuse SS allocations on freeGraphicMemory
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-02-09 16:00:42 +01:00
Lukasz Jobczyk 083f8ae02c Add immediate extension to new residency model
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-08 14:53:11 +01:00
Igor Venevtsev 3df6110a17 Add extra parameters to setArgStateful()
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-02-05 12:24:27 +01:00
Mateusz Jablonski 2eb8b7e9d3 Minor correction in cmake file
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-04 16:20:52 +01:00
Zbigniew Zdanowicz e4eb6d4c64 Reorganize files
Related-To: NEO-5244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-02-04 10:22:08 +01:00
Bartosz Dunajski 580fdd757c Improve buffer surface state programming
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-02 14:42:18 +01:00
Mateusz Jablonski 2b0b2231a7 Windows: Use timestamp frequency from adapter info
Related-To: NEO-5435
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-01 20:14:44 +01:00
Mateusz Hoppe 0ca1cdc565 Add State Sip end WA
Related-To: NEO-5479

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-02-01 19:15:57 +01:00
Kamil Diedrich 93f15c05f6 Add flush prior to blit operation
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-02-01 15:10:28 +01:00
Bartosz Dunajski c2e333fe38 Update compression encoding interface + test traits
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-29 13:57:15 +01:00
Lukasz Jobczyk 8ed14d0c9f Use ZE_AFFINITY_MASK for neo devices
Resolves: NEO-5438

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-29 11:13:29 +01:00
Maciej Plewka 2eaf830aff Fix unmap unalignment part at end of mmap allocation
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-29 09:43:58 +01:00
Igor Venevtsev bb72beac6b Add extra parameters to programStateBaseAddress()
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-01-28 16:03:17 +01:00
Maciej Plewka 5cf4530748 Munmap unaligned part from mmap
Releated-To: NEO-5397

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-28 10:43:38 +01:00
Mateusz Jablonski 4417537eb5 Add function to adjust timestamps on Windows
Resolves: NEO-5435
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-01-26 17:46:04 +01:00
Maciej Dziuban 566a761aaa Optimize copying buffers with misaligned pointers
Resolves: NEO-5476
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-01-26 12:47:22 +01:00
Maciej Plewka 9290637a8e Don't override global bindless heap base
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-26 12:26:36 +01:00
Filip Hazubski 4c289c1031 Update ULTs
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-01-26 11:30:30 +01:00
Slawomir Milczarek 2a1069eda2 Configure 2MB alignment for allocations on standard heap 64k
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-01-22 11:56:33 +01:00
Mateusz Hoppe 5d2ea72db6 Handle relocations from zeBin
Related-To: NEO-5323

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-21 13:16:38 +01:00
Jaroslaw Chodor 4c50a9e147 Zebin - Improving binding table generation
Allowing N:1 kernel_arg:bti mappings

Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-01-20 18:37:45 +01:00
Mateusz Hoppe ffb6e955b1 Decode relocations in ELF
Related-To: NEO-4769, NEO-5323

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-19 16:02:25 +01:00
Adam Cetnerowski abd78c68e2 ULT renaming: misc
Related-To: NEO-2236

Signed-off-by: Adam Cetnerowski <adam.cetnerowski@intel.com>
2021-01-18 19:09:34 +01:00
Adam Cetnerowski b09c147cb0 ULT renaming: Helpers tests
Related-To: NEO-2236

Signed-off-by: Adam Cetnerowski <adam.cetnerowski@intel.com>
2021-01-18 18:47:14 +01:00
Adam Cetnerowski eeb2995885 ULT renaming: Device Binary Format tests
Related-To: NEO-2236

Signed-off-by: Adam Cetnerowski <adam.cetnerowski@intel.com>
2021-01-18 16:45:41 +01:00
Maciej Plewka 24a88d22aa Fix scratch in bindless mode
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-18 15:46:18 +01:00
Adam Cetnerowski 024012c66c ULT renaming: Utilities tests
Related-To: NEO-2236

Signed-off-by: Adam Cetnerowski <adam.cetnerowski@intel.com>
2021-01-18 12:29:46 +01:00
Igor Venevtsev cb13a5184d Check for supported CPU VA size in GfxPartition initialization
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-01-14 16:55:59 +01:00
Filip Hazubski 2d033f5dea Update UltDeviceFactory
Use MockMemoryManager by default in UltDeviceFactory.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-01-13 17:22:23 +01:00
Filip Hazubski 90fd102fe5 Update MockDevice
Remove mockMemoryManager and mockCompilerInterface variables.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-01-12 14:44:05 +01:00
Mateusz Jablonski 5a5ad64f5d Ocloc compile: support gen families exposed in help
fix typo in method name

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-01-11 19:11:56 +01:00
Mateusz Hoppe 6f69bd3560 Initialize SIP kernel in Device::create()
Related-To: NEO-4878

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-08 15:46:23 +01:00
Maciej Dziuban ebbd042f1c Add root CSR to engine groups
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5120
2021-01-08 12:35:01 +01:00
Jaime Arteaga 444b9594af Expand adjustPipelineSelect parameters
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-01-07 18:01:07 +01:00
Adam Cetnerowski 0e52c6b08d ULT renaming: Compiler Interface tests
Related-To: NEO-2236

Signed-off-by: Adam Cetnerowski <adam.cetnerowski@intel.com>
2021-01-07 06:30:24 +01:00
Adam Cetnerowski a3097ae21a ULT renaming: Debug Settings tests
Related-To: NEO-2236

Signed-off-by: Adam Cetnerowski <adam.cetnerowski@intel.com>
2021-01-06 07:27:51 +01:00
Igor Venevtsev 92f067b9aa Add CpuInfo::isCpuFlagPresent() method
Related-To: NEO-5276

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-01-05 14:23:08 +01:00
Mateusz Hoppe 0eb10d7505 Switch to new compiler interface to get system routine
Related-To: NEO-4773
2021-01-04 15:36:15 +01:00
Maciej Plewka 3ca77a6cbe Program sba for global bindless heaps
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-04 14:23:47 +01:00
Young Jin Yoon e09ac446c4 Mask bit 0 of timestamp for event profiling
Related-to: LOCI-1161
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2020-12-31 23:51:12 +01:00
Mateusz Jablonski 1b7d7afc07 Refactor USM properties
store reference to std of root device indices and device bitfields
store NEO::Device in USM properties

Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-30 11:36:56 +01:00
Maciej Plewka bb825acfff Mark heap as dirty when base address has changed
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-12-29 17:19:51 +01:00
Mateusz Hoppe ed1e3de54a Revert "Switch to new compiler interface to get system routine"
This reverts commit 09bdd2ad09.

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-23 15:50:57 +01:00
Mateusz Hoppe 09bdd2ad09 Switch to new compiler interface to get system routine
Related-To: NEO-4773

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-22 17:20:30 +01:00
Jaime Arteaga 1091a5d78b Extend kernel encoder interface test
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-12-22 10:25:23 +01:00
Slawomir Milczarek 6986d5de0b Add helper functions for memory compression to CSR
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-12-21 17:43:03 +01:00
Konstanty Misiak e665111013 Verify debug manager state in UltConfigListener
Signed-off-by: Konstanty Misiak <konstanty.misiak@intel.com>
2020-12-18 14:18:36 +01:00
Kamil Kopryk 2a8bdaf28c Code cleanup
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
2020-12-17 13:44:09 +01:00
Daria Hinz 1ef9a1c35f Add extended functionality for timestamps at Event
Related-To: NEO-4584
Signed-off-by: Daria Hinz <daria.hinz@intel.com>
2020-12-17 10:53:16 +01:00
Krystian Chmielewski 4948c39d39 Remove executionEnvironment from KernelInfo
Related-To: NEO-3739
2020-12-16 14:56:57 +01:00
Jim Snow 37cd49330c Implement ZE_CACHE_CONFIG_FLAG_LARGE_DATA for zeKernelSetCacheConfig
Signed-off-by: Jim Snow <jim.m.snow@intel.com>
2020-12-16 07:00:13 +01:00
Pawel Wilma d94e2bf149 Refactoring of per-DSS backed buffer programming
Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-12-14 22:22:47 +01:00
Pawel Wilma 9bd0c69913 Add ClearColor allocation support for blitter
Related-To: NEO-5175

Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-12-14 18:22:05 +01:00
Artur Harasimiuk 05ab806126 cmake: refactor unit tests targets dependencies
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2020-12-14 14:57:42 +01:00
Filip Hazubski b0ed0dcc9b Generate spirv builtins without specifying a device
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-12-11 16:57:44 +01:00
Mateusz Hoppe 0747cb80f5 Sip programming changes
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-11 15:05:30 +01:00
Maciej Plewka 830bcd6987 Scratch using bindless heaps
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-12-11 09:38:44 +01:00
Jaroslaw Chodor 993ea27e25 Adding platform info for FCL
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2020-12-10 16:31:46 +01:00
Mateusz Jablonski 350ec9f16b Pass root device index to get proper kernel info
Related-To: NEO-5001
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-09 19:11:43 +01:00
Mateusz Jablonski b6a20f9b23 Move mock_gmm and mock_gdi to shared
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-09 13:45:57 +01:00
Mateusz Jablonski 9183a9b638 Correct shared tests
create mock_gmm target if not exists

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-08 19:31:57 +01:00
Kacper Nowak 4804eca86d Refactoring Level Zero ULTs in order to use standalone spirv builtins
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2020-12-08 09:19:05 +01:00
Mateusz Jablonski c8d1e082dd Update getKernelInfo method
add root device index parameter to return proper kernel info

Related-To: NEO-5001
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-08 09:14:44 +01:00
Filip Hazubski edbda8e8b2 Pass HwInfo to computeSlmValues function
Resolves: NEO-5215, NEO-5216

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-12-07 20:23:28 +01:00
Filip Hazubski ce4b6dbcd8 Update builtins hash
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-12-03 16:41:45 +01:00
Kamil Diedrich 79d4af28de Switch to c++17
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2020-12-03 15:15:32 +01:00
Mateusz Hoppe 8198a739c8 Refactor Sip Kernel usage
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-03 10:43:53 +01:00
Young Jin Yoon da779d067f Support the AND operation in EncodeMathMMIO
Related-to: LOCI-1161
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2020-12-03 01:56:22 +01:00
Maciej Plewka 7a5c9d39b5 Encode dispatch kernel with global bindless heaps
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-12-02 17:30:15 +01:00
Jaime Arteaga be90b9ff93 Add support for ZE_DEVICE_MEM_ALLOC_FLAG_BIAS_UNCACHED
Add support for device and shared allocations that use the
ZE_DEVICE_MEM_ALLOC_FLAG_BIAS_UNCACHED flag, whether the
kernel using the memory is stateless or statefull.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-12-02 10:43:45 +01:00
Bartosz Dunajski ce53035ebc Unit tests fixes
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-12-02 09:40:20 +01:00
Jobczyk, Lukasz 343fd602fa Add method to submit kernel on single subdevice
Signed-off-by: Jobczyk, Lukasz <lukasz.jobczyk@intel.com>
2020-12-01 22:15:05 +01:00
Maciej Dziuban 94be510c18 Add initial placement hints for USM in OpenCL
Related-To: NEO-5059
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2020-12-01 18:30:26 +01:00
Filip Hazubski 6c4b1f951c Do not force cl_khr_3d_image_writes extension when compiling kernels
Update usage of SUPPORTED_IMAGES flag and do not use images when disabled.
Use SUPPORTED_2_0 only on fully OCL 2.1 conformant platforms.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-11-27 17:20:46 +01:00
Bartosz Dunajski 93ba4e646b Improve EncodeDispatchKernel
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-27 16:39:34 +01:00
Krzysztof Gibala baea633bdd Correct logic in MultiRootDeviceFixture
Related-To: NEO-4589

Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2020-11-27 16:22:39 +01:00
Bartosz Dunajski 8dfea40242 HwInfoConfig cleanup
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-23 15:28:10 +01:00
Sebastian Luzynski 556b6cd457 Add concurrent kernel execution type
Related-To: NEO-4940
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2020-11-20 16:12:42 +01:00
Krzysztof Gibala f2a73ef0f5 Enable memory transfer between buffers in enqueueCopyBuffer
Unlock enqueueCopyBuffer flow, for multi device setup

Related-To: NEO-4589
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2020-11-19 14:03:44 +01:00
Mateusz Jablonski 920d873657 Improve VS solution tree
Move shared specific targets to neo shared folder
Move opencl specific targets to opencl runtime folder

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-11-19 13:53:51 +01:00
Vinod Tipparaju 240563099c Clean up code for nullptr device check during cmdlist create
Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2020-11-19 04:24:34 +01:00
Maciej Plewka 28de4068c9 Read bindless offset from patch token
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-11-18 17:04:00 +01:00