Commit Graph

1073 Commits

Author SHA1 Message Date
Lukasz Jobczyk 2358173e65 Fix reserved size in shared BOs
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-03-11 13:54:50 +01:00
Filip Hazubski 6a4ed40a16 Correct Host Mem Capabilities values
Related-To: NEO-5054

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-03-11 08:54:59 +01:00
Mateusz Hoppe 516a905712 Mark Scratch and Private allocations for capture
Related-To: NEO-5237

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-03-10 14:04:57 +01:00
Filip Hazubski dca33e10ec Move hw_info_config files to shared
Related-To: NEO-5161

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-03-10 12:49:06 +01:00
Krzysztof Gibala 4abe4a96b8 Add multiGraphicsAllocation to CSR
Related-To: NEO-5508
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-03-10 12:42:01 +01:00
Zbigniew Zdanowicz 779253c49c Add new flag to USM memory manager
Related-To: NEO-5498

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-03-10 11:47:34 +01:00
Slawomir Milczarek bca7b54728 Allocation shareable to use standard64KB heap
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-03-10 11:39:16 +01:00
Katarzyna Cencelewska d9172c9b7f 1Mb alignment support in OsAgnostic path
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-03-10 10:56:25 +01:00
Maciej Dziuban 66cff28002 Do not use threadDims for indirect dispatches
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-03-10 08:04:34 +01:00
Krystian Chmielewski 41f3bd00ff Remove PatchTokens from KernelInfo
Use KernelDescriptor instead of patchTokens stored in KernelInfo's
patchInfo.
Removed: SPatchMediaInterfaceDescriptorLoad, SPatchAllocateLocalSurface,
SPatchMediaVFEState(slot 0), SPatchMediaVFEState(slot 1),
SPatchInterfaceDescriptorData, SPatchSamplerStateArray,
SPatchBindingTableState, SPatchDataParameterBuffer,
SPatchDataParameterStream, SPatchThreadPayload,
SPatchKernelAttributesInfo, SPatchAllocateStatelessPrivateSurface,
SPatchAllocateSyncBuffer,
SPatchAllocateStatelessConstantMemorySurfaceWithInitialization,
SPatchAllocateStatelessGlobalMemorySurfaceWithInitialization,
SPatchAllocateSystemThreadSurface.

Related-To: NEO-4729
Signed-off-by: Krystian Chmielewski <krystian.chmielewski@intel.com>
2021-03-09 17:09:13 +01:00
Jaime Arteaga e491bca8cb Revert "Enable new residency model by default"
This reverts commit 489b78f0b5.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-03-08 21:04:12 +01:00
Mateusz Hoppe c994bf6f00 Fix pagefault Cpu transfers in TBX mode
Related-To: NEO-5286

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-03-08 19:22:02 +01:00
Bartosz Dunajski 8b89fb8541 Capability to exclude Engine on SubDevice
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-03-08 11:32:13 +01:00
Bartosz Dunajski 047a93fde6 Update getExtraMmioList method
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-03-08 11:25:40 +01:00
Maciej Dziuban c361570fab Make work partition allocation resident
Related-To: NEO-5546

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-03-08 10:32:42 +01:00
Katarzyna Cencelewska 34c873c3aa Update description of ForceAuxTranslationMode
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-03-05 17:58:05 +01:00
Maciej Dziuban 1350aa52fb Pass DispatchInfo to estimation functions
Related-To: NEO-5546

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-03-05 12:47:55 +01:00
Kacper Nowak 234b401aab Moved devices.inl and devices_base.inl to shared for future shared use in ocloc
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-03-04 13:03:45 +01:00
Zbigniew Zdanowicz 24b928303b Rename fields in AllocationProperties
Related-To: NEO-5498

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-03-02 18:32:37 +01:00
Lukasz Jobczyk 8fa97ed4a8 Fix shared buffer object size
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-03-02 14:08:47 +01:00
Slawomir Milczarek 049166688c Introduced standard heap with 2MB alignment on Linux
Related-To: NEO-5507

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-03-02 14:03:37 +01:00
Bartosz Dunajski 9c164a01a6 AuxTranslationMode fallback path
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-03-02 12:09:04 +01:00
Mateusz Hoppe f00a2c9422 Add UseBindlessDebugSip debug variable
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-03-01 15:41:12 +01:00
Mateusz Hoppe 8f87dfaf0c Add Debug API handlers
Related-To: NEO-4554


Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-03-01 15:26:43 +01:00
Mateusz Jablonski da5f7b9216 Add debug keys to scratch register write after walker
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-26 16:13:57 +01:00
Mateusz Jablonski 35064c3dea Allow for hex input in file with debug keys
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-26 16:04:26 +01:00
Zbigniew Zdanowicz 3e4be8d78e Add new allocation type
Related-To: NEO-5244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-02-26 12:57:12 +01:00
Spruit, Neil R 464e4fd1b1 Fix GMM usage in 1D image allocation on windows
Properly use the gmm resource created for the Image allocation
instead of the gmm resource created in allocateGraphicsMemoryWithAlignment
in the windows wddm memory manager by removing the call to
allocateGraphicsMemoryWithAlignment for 1D images.

Invalid ULT testing this functionality has been removed.

Related-To: LOCI-1845
Signed-off-by: Spruit, Neil R <neil.r.spruit@intel.com>
2021-02-26 11:58:27 +01:00
Maciej Dziuban b11f367db4 Add missing getter methods
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-02-25 12:02:05 +01:00
Jaime Arteaga 722a80079b Add experimental_properties for indirect access (2)
Add support to OpenCL to also make use of indirect access properties
provided by IGC and to make use of DisableIndirectAccess debug key.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-02-25 11:41:24 +01:00
Daria Hinz 13fe8ed7f1 Revert "Correct POST_SYNC for L0 Events"
This reverts commit 04d1a3255357a7778a530f054700e211d94f3b6d.

Signed-off-by: Daria Hinz <daria.hinz@intel.com>
2021-02-24 10:16:22 +01:00
Lukasz Jobczyk 4894411889 Add debug flag to print BOs for submit
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-23 19:45:42 +01:00
Mateusz Hoppe 66f4c75aea Adding DisableDeepBind debug flag
Related-To: NEO-4946

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-02-23 19:19:24 +01:00
Slawomir Milczarek ef3678e005 Add checks for default cache policy
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-02-19 14:16:14 +01:00
Lukasz Jobczyk a23f211113 Disable gem close worker on direct submission
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-19 13:38:38 +01:00
Kamil Diedrich edf066a54b Return proper clDevice for given media adapter
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-02-18 21:29:15 +01:00
Daria Hinz 64d772d366 Fix for adding MI_SEMAPHORE_WAIT & reset L0 Event
Signed-off-by: Daria Hinz <daria.hinz@intel.com>
2021-02-18 18:33:21 +01:00
Mateusz Jablonski df1e7792c6 Restore GPU breakpoint improvement
handle user confirmations in gpu modes: always, only before, only after
handle multiple confirmations when pausing on each enqueue
move tests to mt_tests


Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-17 22:56:31 +01:00
Piotr Zdunowski a555f28bf8 Don't unregister trim callback during process shutdown.
Resolves: NEO-4668

Signed-off-by: Piotr Zdunowski <piotr.zdunowski@intel.com>
2021-02-17 17:29:19 +01:00
Lukasz Jobczyk 489b78f0b5 Enable new residency model by default
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-17 16:42:30 +01:00
Maciej Dziuban f7d105f2e2 Create work partition allocation
Related-To: NEO-5546
Resolves: NEO-5561
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-02-17 15:28:42 +01:00
Lukasz Jobczyk 1844875b9d Disable timeout while waiting when direct submission active
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-17 14:46:19 +01:00
Bartosz Dunajski 15f3353351 Pass additional allocation parameters to aub_stream
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-17 14:20:08 +01:00
Lukasz Jobczyk 9d3b759d29 Do not call GEM_WAIT while direct submission active
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-17 13:22:29 +01:00
Lukasz Jobczyk 0f78357e93 Add option to pass bound BOs to exec
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-17 13:09:01 +01:00
Bartosz Dunajski 584da13ff8 aub_stream interfaces update
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-16 16:03:04 +01:00
Mateusz Hoppe 6dd0f0c728 Relocate debug data
Related-To: NEO-4769

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-02-16 14:59:30 +01:00
Filip Hazubski a0d3e8b352 Simplify stepping conversion
Related-To: NEO-5475

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-02-16 11:52:17 +01:00
Lukasz Jobczyk ed5bbe2d43 Disable new residency model
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-16 11:08:47 +01:00
Filip Hazubski 7d01074ee4 Update aub/tbx stepping handling
For the stepping value use hardware value.

Resolves: NEO-5475

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-02-15 13:57:39 +01:00
Zbigniew Zdanowicz c35f560971 Refactor internal interface
Related-To: NEO-5244

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2021-02-15 13:24:00 +01:00
Mateusz Hoppe 06bcc67e38 Clean log file from incorrect entries
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-02-15 13:05:29 +01:00
Mateusz Jablonski 1494205e28 Revert "Improve GPU breakpoint support"
This reverts commit a6d898a026.

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-12 14:11:50 +01:00
Slawomir Milczarek ca84fdd64a Add helper function stub to get number of cache regions
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-02-12 11:01:07 +01:00
Filip Hazubski ae484993e2 Update builtins generation
Use revision id when generating cpp files.
Related-To: NEO-5167

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-02-11 14:36:58 +01:00
Katarzyna Cencelewska 9d0422cf69 Add hwInfo to sampler setArg and appendSamplerStateParams
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2021-02-11 14:21:13 +01:00
Slawomir Milczarek 7dad49ccf4 Add new setters and getters for cache policies
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-02-11 14:07:06 +01:00
Maciej Dziuban 2cd6809d1e Do not use blitter for clEnqueueCopyBuffer
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-02-11 12:42:43 +01:00
Bartosz Dunajski fcf6ecfad7 Pass HwInfo to getExtraMmioList
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-11 09:38:56 +01:00
Lukasz Jobczyk 7c99739b89 Check if direct submission enable in OsContext
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-11 09:05:50 +01:00
Jaime Arteaga 1aca16a7ac Add experimental_properties for indirect access
Read zebin experimental properties indicating whether a kernel has
indirect access and if so, ignore calls to zeKernelSetIndirectAccess.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-02-10 14:23:43 +01:00
Sebastian Luzynski 0526910f6f Check if additional flag is required
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2021-02-10 13:51:05 +01:00
Lukasz Jobczyk 199ae23def Use CONTEXT_CREATE_EXT
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-10 13:28:59 +01:00
Lukasz Jobczyk c5a7481999 Enable new residency model by default
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-09 16:40:46 +01:00
Kacper Nowak afbead513d Reuse SS allocations on freeGraphicMemory
Signed-off-by: Kacper Nowak <kacper.nowak@intel.com>
2021-02-09 16:00:42 +01:00
Bartosz Dunajski 33ec9b258a Improve aub/tbx extra mmio list handling
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-09 15:31:46 +01:00
Bartosz Dunajski db7a10f6cc FtrSVM transfer support
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-08 15:42:14 +01:00
Lukasz Jobczyk 083f8ae02c Add immediate extension to new residency model
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-08 14:53:11 +01:00
Vinod Tipparaju bb138e87c1 Fix to optimize SBA dispatch during submissions.
Move the SBA dirty flag inside csr so it is common across command queues.

Related-To: LOCI-1982

Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2021-02-08 12:13:09 +01:00
Mateusz Jablonski a6d898a026 Improve GPU breakpoint support
handle user confirmations in gpu modes: always, only before, only after
handle multiple confirmations when pausing on each enqueue

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-06 16:31:05 +01:00
Igor Venevtsev 3df6110a17 Add extra parameters to setArgStateful()
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-02-05 12:24:27 +01:00
Slawomir Milczarek d399613f25 Add support for L3 cache information
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-02-05 10:28:02 +01:00
Michal Mrozek 5132fde93f simplify code.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-02-04 18:20:56 +01:00
Maciej Plewka 51e073af73 Revert "Extra checks for gen12lp"
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-02-04 18:02:30 +01:00
Lukasz Jobczyk 049e77b235 Check if KMD migration is supported
Related-To: NEO-3312

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-02-04 11:49:46 +01:00
Sebastian Luzynski 22c25a231e Extra checks for gen12lp
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2021-02-04 11:23:15 +01:00
Bartosz Dunajski 83a278d6f9 Add new AuxTranslationMode
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-03 10:57:33 +01:00
Filip Hazubski 5618d4dfa4 Correct image initialization for linear storage allocations 2/2
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-02-02 17:12:18 +01:00
Bartosz Dunajski 580fdd757c Improve buffer surface state programming
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-02-02 14:42:18 +01:00
Jaime Arteaga 97dba1eb00 Print execution buffer flags in hexadecimal format
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-02-02 12:04:27 +01:00
Mateusz Jablonski 2b0b2231a7 Windows: Use timestamp frequency from adapter info
Related-To: NEO-5435
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-02-01 20:14:44 +01:00
Mateusz Hoppe 0ca1cdc565 Add State Sip end WA
Related-To: NEO-5479

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-02-01 19:15:57 +01:00
Kamil Diedrich 93f15c05f6 Add flush prior to blit operation
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2021-02-01 15:10:28 +01:00
Michal Mrozek cfe23873cf Fix async flag.
Signed-off-by: Michal Mrozek <michal.mrozek@intel.com>
2021-01-29 17:02:03 +01:00
Bartosz Dunajski c2e333fe38 Update compression encoding interface + test traits
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-29 13:57:15 +01:00
Lukasz Jobczyk 8ed14d0c9f Use ZE_AFFINITY_MASK for neo devices
Resolves: NEO-5438

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-29 11:13:29 +01:00
Maciej Plewka 2eaf830aff Fix unmap unalignment part at end of mmap allocation
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-29 09:43:58 +01:00
Bartosz Dunajski b57c1b9650 Improve Image surface state encoding for compression
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-28 16:39:42 +01:00
Igor Venevtsev bb72beac6b Add extra parameters to programStateBaseAddress()
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-01-28 16:03:17 +01:00
Lukasz Jobczyk adfa3c6bcb Fill exec object with additional flag
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-28 15:32:04 +01:00
Maciej Plewka 5cf4530748 Munmap unaligned part from mmap
Releated-To: NEO-5397

Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-28 10:43:38 +01:00
Maciej Dziuban 160e5ec112 OpenCL Queue Families extension 12/n
Fix engine selection for copy engines

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Relate-To: NEO-5120
2021-01-27 21:27:43 +01:00
Mateusz Hoppe 3ab932b101 Add initial support for context debug
Related-To: NEO-5478

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-27 12:50:26 +01:00
Bartosz Dunajski eb1ea19360 Update topology query
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-27 11:40:37 +01:00
Mateusz Jablonski 4417537eb5 Add function to adjust timestamps on Windows
Resolves: NEO-5435
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-01-26 17:46:04 +01:00
Bartosz Dunajski 4ffcf88a92 Move query topology translation logic to new method
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-26 14:48:07 +01:00
Maciej Dziuban 566a761aaa Optimize copying buffers with misaligned pointers
Resolves: NEO-5476
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2021-01-26 12:47:22 +01:00
Maciej Plewka 9290637a8e Don't override global bindless heap base
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-26 12:26:36 +01:00
Lukasz Jobczyk d79611d2ff Remove redundant flag
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-26 11:49:22 +01:00
Bartosz Dunajski e4c8db2159 Move query topology method to new file
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-26 09:10:52 +01:00
Maciej Plewka 8c2cb54a3f Set correct bindless offset in arg descriptor
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-22 15:56:13 +01:00
Slawomir Milczarek 2a1069eda2 Configure 2MB alignment for allocations on standard heap 64k
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-01-22 11:56:33 +01:00
Vinod Tipparaju 494a59c7df Fix to dispatch MEDIA_VFE_STATE with updated scratchSpacePointer & Size
Minor fix to reset scratch space size and indirect params during cmdList reset

Signed-off-by: Vinod Tipparaju <vinod.tipparaju@intel.com>
2021-01-21 14:29:34 +01:00
Mateusz Hoppe 5d2ea72db6 Handle relocations from zeBin
Related-To: NEO-5323

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-21 13:16:38 +01:00
Slawomir Milczarek d19d8e0829 Use last compression memory state for non-applicable cases
Related-To: NEO-5107

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-01-21 11:09:17 +01:00
Lukasz Jobczyk 18bfc3be8b Revert "Extend ZE_AFFINITY_MASK to OCL"
This reverts commit 452b53fb4d02ebf4205018b9fd982422e2d85f30.

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-21 10:31:40 +01:00
Lukasz Jobczyk dd0601a873 Revert "Cover empty affinity mask case"
This reverts commit 40639366d5212bd77a4946dd2e78217ef4b5d043.
2021-01-20 19:02:55 +01:00
Jaroslaw Chodor 4c50a9e147 Zebin - Improving binding table generation
Allowing N:1 kernel_arg:bti mappings

Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-01-20 18:37:45 +01:00
Krzysztof Gibala c27d8c8dfd Wait for all gpuAllocation in clMemBlockingFreeINTEL call
Related-To: NEO-5422
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-01-20 10:28:32 +01:00
Lukasz Jobczyk 0646e03cc0 Cover empty affinity mask case
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-20 10:12:36 +01:00
Filip Hazubski 65aecc84f1 Add __IMAGE_SUPPORT__ option for compilation
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-01-19 16:21:57 +01:00
Mateusz Hoppe ffb6e955b1 Decode relocations in ELF
Related-To: NEO-4769, NEO-5323

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-19 16:02:25 +01:00
Lukasz Jobczyk d9b6280511 Extend ZE_AFFINITY_MASK to OCL
Resolves: NEO-5438

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-19 14:10:44 +01:00
Pawel Cieslak 7bef7f7476 Flush stdout in debug helpers
Signed-off-by: Pawel Cieslak <pawel.cieslak@intel.com>
2021-01-18 16:55:16 +01:00
Maciej Plewka 24a88d22aa Fix scratch in bindless mode
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-18 15:46:18 +01:00
Krzysztof Gibala ae1e5a91b4 Unlock multi device setup for shared allocation
Related-To: NEO-5422
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-01-15 11:08:11 +01:00
Igor Venevtsev cb13a5184d Check for supported CPU VA size in GfxPartition initialization
Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-01-14 16:55:59 +01:00
Filip Hazubski 3b9bd0b7e4 Correct image initialization for linear storage allocations
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-01-14 16:02:56 +01:00
Bartosz Dunajski 90f96f083c Add const suffix
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-14 14:12:16 +01:00
Piotr Maciejewski 4a5599b1ee L0 Metrics Api: multi adapter support
Switching to Metrics Discovery adapter interface.
2021-01-13 22:45:59 +01:00
Filip Hazubski 2d033f5dea Update UltDeviceFactory
Use MockMemoryManager by default in UltDeviceFactory.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2021-01-13 17:22:23 +01:00
Bartosz Dunajski a8fe9b7630 Add const suffix
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-13 16:39:23 +01:00
Bartosz Dunajski 646b551da0 Helper to override platform name
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-13 11:22:44 +01:00
Lukasz Jobczyk 40390f7775 Add simple kernel tunning variant
Related-To: NEO-5327

Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2021-01-13 11:09:22 +01:00
Slawomir Milczarek 068cb09c90 Add function to check for USM host allocations in SVM Allocs Manager
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2021-01-12 15:41:24 +01:00
Mateusz Jablonski 5a5ad64f5d Ocloc compile: support gen families exposed in help
fix typo in method name

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2021-01-11 19:11:56 +01:00
Jaroslaw Chodor b0c915c61d Optimizing binary size
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2021-01-11 11:48:53 +01:00
Mateusz Hoppe 6f69bd3560 Initialize SIP kernel in Device::create()
Related-To: NEO-4878

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-08 15:46:23 +01:00
Maciej Dziuban ebbd042f1c Add root CSR to engine groups
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
Related-To: NEO-5120
2021-01-08 12:35:01 +01:00
Jaime Arteaga 444b9594af Expand adjustPipelineSelect parameters
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2021-01-07 18:01:07 +01:00
Bartosz Dunajski 14438484d2 Improve AdditionalKernelExecInfo implementation
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2021-01-07 11:40:45 +01:00
Krzysztof Gibala 3385500396 Use createHostUnifiedMemoryAllocation in clHostMemAllocINTEL
Unlock multi device setup for host allocation

Related-To: NEO-5422
Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2021-01-05 17:16:59 +01:00
Igor Venevtsev 92f067b9aa Add CpuInfo::isCpuFlagPresent() method
Related-To: NEO-5276

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2021-01-05 14:23:08 +01:00
Mateusz Hoppe 0eb10d7505 Switch to new compiler interface to get system routine
Related-To: NEO-4773
2021-01-04 15:36:15 +01:00
Maciej Plewka 3ca77a6cbe Program sba for global bindless heaps
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2021-01-04 14:23:47 +01:00
Mateusz Hoppe b9aee10679 Initialize internal heaps with at least minAddress from Wddm
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2021-01-04 13:13:13 +01:00
Young Jin Yoon e09ac446c4 Mask bit 0 of timestamp for event profiling
Related-to: LOCI-1161
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2020-12-31 23:51:12 +01:00
Lukasz Jobczyk 239f37da64 Introduce kernel tunning under debug flag
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-12-30 14:05:55 +01:00
Jaime Arteaga bd49ff63af Fix typos in debug_variables_base.inl
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-12-30 12:04:00 +01:00
Mateusz Jablonski 1b7d7afc07 Refactor USM properties
store reference to std of root device indices and device bitfields
store NEO::Device in USM properties

Related-To: NEO-3691
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-30 11:36:56 +01:00
Maciej Plewka bb825acfff Mark heap as dirty when base address has changed
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-12-29 17:19:51 +01:00
Maciej Dziuban 544dd141ec Refactor addEngineToEngineGroup functions
This change replaces HwHelper::addEngineToEngineGroup with getEngineGroupType,
so we're able to map EngineType to EngineGroupType without pushing engines.

Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2020-12-29 15:46:01 +01:00
Matias Cabral 7ac97fd929 Use independent Elf UUID generation
Signed-off-by: Matias Cabral <matias.a.cabral@intel.com>
2020-12-24 01:56:51 +01:00
Mateusz Hoppe ed1e3de54a Revert "Switch to new compiler interface to get system routine"
This reverts commit 09bdd2ad09.

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-23 15:50:57 +01:00
Jitendra Sharma 7c70a14bc4 Implement ZE_ENABLE_PCI_ID_DEVICE_ORDER environment variable
Signed-off-by: Jitendra Sharma <jitendra.sharma@intel.com>
2020-12-23 12:08:43 +01:00
Mateusz Hoppe 09bdd2ad09 Switch to new compiler interface to get system routine
Related-To: NEO-4773

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-22 17:20:30 +01:00
Katarzyna Cencelewska ff3d4799ca Refactor cmake
Signed-off-by: Katarzyna Cencelewska <katarzyna.cencelewska@intel.com>
2020-12-22 00:41:43 +01:00
Slawomir Milczarek 6986d5de0b Add helper functions for memory compression to CSR
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-12-21 17:43:03 +01:00
Bartosz Dunajski 7abd1c97ab Debug flag to override profiling timer resolution
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-12-21 13:41:22 +01:00
Mateusz Hoppe 1dcbbfa21d Link device binary format files to shared lib
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-21 12:55:58 +01:00
Daria Hinz 1ef9a1c35f Add extended functionality for timestamps at Event
Related-To: NEO-4584
Signed-off-by: Daria Hinz <daria.hinz@intel.com>
2020-12-17 10:53:16 +01:00
Krystian Chmielewski 4948c39d39 Remove executionEnvironment from KernelInfo
Related-To: NEO-3739
2020-12-16 14:56:57 +01:00
Jim Snow 37cd49330c Implement ZE_CACHE_CONFIG_FLAG_LARGE_DATA for zeKernelSetCacheConfig
Signed-off-by: Jim Snow <jim.m.snow@intel.com>
2020-12-16 07:00:13 +01:00
Slawomir Milczarek b2cae02f66 Add kernel fixture with stateless indirect access
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-12-15 13:23:37 +01:00
Pawel Wilma d94e2bf149 Refactoring of per-DSS backed buffer programming
Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-12-14 22:22:47 +01:00
Artur Harasimiuk 7716988dbb cmake cleanup: removing unused targets
Signed-off-by: Artur Harasimiuk <artur.harasimiuk@intel.com>
2020-12-14 19:00:11 +01:00
Pawel Wilma 9bd0c69913 Add ClearColor allocation support for blitter
Related-To: NEO-5175

Signed-off-by: Pawel Wilma <pawel.wilma@intel.com>
2020-12-14 18:22:05 +01:00
Filip Hazubski b0ed0dcc9b Generate spirv builtins without specifying a device
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-12-11 16:57:44 +01:00
Mateusz Hoppe 0747cb80f5 Sip programming changes
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-11 15:05:30 +01:00
Mateusz Hoppe 778a4acca3 Initialize debugger structs
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-11 12:40:59 +01:00
Maciej Plewka 830bcd6987 Scratch using bindless heaps
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-12-11 09:38:44 +01:00
Jaime Arteaga d46bb59508 Migrate shared-allocations made resident with makeMemoryResident
Shared-allocations are currently migrated to GPU by the page-fault
manager when calling executeCommandLists. Allocations to migrate are
taken from the lists container. However, if a shared-allocation
has been made resident with zeContextMakeMemoryResident(), it is not
added to the list container, and hence it is not migrated to device.

So, add a container of resident allocations to the driver and migrate
them along with the other allocations.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-12-11 03:27:42 +01:00
Jaroslaw Chodor 993ea27e25 Adding platform info for FCL
Signed-off-by: Jaroslaw Chodor <jaroslaw.chodor@intel.com>
2020-12-10 16:31:46 +01:00
Mateusz Jablonski c8d1e082dd Update getKernelInfo method
add root device index parameter to return proper kernel info

Related-To: NEO-5001
Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-12-08 09:14:44 +01:00
Filip Hazubski edbda8e8b2 Pass HwInfo to computeSlmValues function
Resolves: NEO-5215, NEO-5216

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-12-07 20:23:28 +01:00
Filip Hazubski 23d4967f79 Correct generating extensions list for compiler
Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-12-03 15:15:49 +01:00
Kamil Diedrich 79d4af28de Switch to c++17
Signed-off-by: Kamil Diedrich <kamil.diedrich@intel.com>
2020-12-03 15:15:32 +01:00
Mateusz Hoppe 8198a739c8 Refactor Sip Kernel usage
Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-12-03 10:43:53 +01:00
Young Jin Yoon da779d067f Support the AND operation in EncodeMathMMIO
Related-to: LOCI-1161
Signed-off-by: Young Jin Yoon <young.jin.yoon@intel.com>
2020-12-03 01:56:22 +01:00
Maciej Plewka 7a5c9d39b5 Encode dispatch kernel with global bindless heaps
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-12-02 17:30:15 +01:00
Jaime Arteaga be90b9ff93 Add support for ZE_DEVICE_MEM_ALLOC_FLAG_BIAS_UNCACHED
Add support for device and shared allocations that use the
ZE_DEVICE_MEM_ALLOC_FLAG_BIAS_UNCACHED flag, whether the
kernel using the memory is stateless or statefull.

Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>
2020-12-02 10:43:45 +01:00
Jobczyk, Lukasz 343fd602fa Add method to submit kernel on single subdevice
Signed-off-by: Jobczyk, Lukasz <lukasz.jobczyk@intel.com>
2020-12-01 22:15:05 +01:00
Maciej Dziuban 94be510c18 Add initial placement hints for USM in OpenCL
Related-To: NEO-5059
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2020-12-01 18:30:26 +01:00
Maciej Dziuban b5c899cd18 Fix disabled unit test
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2020-12-01 17:52:34 +01:00
macabral 720ba46548 Register kernel Elf for debugging purpose
Signed-off-by: macabral <matias.a.cabral@intel.com>
2020-12-01 17:16:14 +01:00
Slawomir Milczarek ff069c1171 Enable AUB memory dumps of USM allocations
Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-12-01 11:24:41 +01:00
Kamil Kopryk 0d94f289b4 Add adjustAddressWidthFor Canonize helper
Signed-off-by: Kamil Kopryk <kamil.kopryk@intel.com>
Related-To: NEO-5285
2020-11-30 16:02:23 +01:00
Zbigniew Zdanowicz 4602220e62 Add manager of imported host pointers
Related-To: NEO-5126

Signed-off-by: Zbigniew Zdanowicz <zbigniew.zdanowicz@intel.com>
2020-11-30 13:28:25 +01:00
Filip Hazubski 6c4b1f951c Do not force cl_khr_3d_image_writes extension when compiling kernels
Update usage of SUPPORTED_IMAGES flag and do not use images when disabled.
Use SUPPORTED_2_0 only on fully OCL 2.1 conformant platforms.

Signed-off-by: Filip Hazubski <filip.hazubski@intel.com>
2020-11-27 17:20:46 +01:00
Bartosz Dunajski 93ba4e646b Improve EncodeDispatchKernel
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-27 16:39:34 +01:00
Krzysztof Gibala baea633bdd Correct logic in MultiRootDeviceFixture
Related-To: NEO-4589

Signed-off-by: Krzysztof Gibala <krzysztof.gibala@intel.com>
2020-11-27 16:22:39 +01:00
Lukasz Jobczyk 0829e4484e Lock exec path if default memory operations handler is used
Signed-off-by: Lukasz Jobczyk <lukasz.jobczyk@intel.com>
2020-11-27 14:49:03 +01:00
Maciej Plewka ded70b803d Use common compile bindless flag
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-11-27 14:28:55 +01:00
Maciej Plewka d4c5ee63f2 Dont return value from dispatchBlitCommands
Signed-off-by: Maciej Plewka <maciej.plewka@intel.com>
2020-11-27 14:10:32 +01:00
Sebastian Luzynski ddbaf82f04 Add appendProgramVFEState function
Signed-off-by: Sebastian Luzynski <sebastian.jozef.luzynski@intel.com>
2020-11-27 13:35:50 +01:00
Bartosz Dunajski 53b4cee150 Debug flag to force device id.
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-27 09:10:48 +01:00
Bartosz Dunajski 60d0d4d67f Move remaining SBA files to shared
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-26 17:11:57 +01:00
Slawomir Milczarek e6a18aac73 Add query system info implementation stub on Linux
Related-To: NEO-4998

Signed-off-by: Slawomir Milczarek <slawomir.milczarek@intel.com>
2020-11-26 16:31:00 +01:00
Bartosz Dunajski beb04bd2f8 Improve HostMemCapabilities helper method.
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-26 13:54:35 +01:00
Igor Venevtsev cff80e38b8 Do not program MiFlushDw command as a timestamp operation for blitter
Resolves: NEO-4906

Signed-off-by: Igor Venevtsev <igor.venevtsev@intel.com>
2020-11-26 13:26:13 +01:00
Bartosz Dunajski e8178ae493 Add appendExtraMemoryProperties method
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-26 09:53:55 +01:00
Bartosz Dunajski 2ee8bad91f Add appendExtraCacheSettings method
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-25 14:08:35 +01:00
Bartosz Dunajski 8a703c082e Add encodeExtraCacheSettings method
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-25 12:27:20 +01:00
Bartosz Dunajski bf61dcc849 setupTimestampPacket method cleanup
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-24 18:53:14 +01:00
Bartosz Dunajski ae3ad3e8bc Add method to adjust TimestampPacket
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-24 17:35:22 +01:00
Bartosz Dunajski c5fb745260 Update PipeControlArgs helper
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-24 17:06:23 +01:00
Bartosz Dunajski 7ce2f0db38 Program pipe_control->tlb_invalidate under debug flag
Signed-off-by: Bartosz Dunajski <bartosz.dunajski@intel.com>
2020-11-24 14:29:29 +01:00
Maciej Dziuban 14f92cc7a1 OpenCL Queue Families extension 1/n
Basic implementation, some things will be tweaked in future commits

Related-To: NEO-5120
Signed-off-by: Maciej Dziuban <maciej.dziuban@intel.com>
2020-11-24 11:48:18 +01:00
Mateusz Jablonski 720326fd6a Reorganize VS solution tree
Move scripts targets to neo scripts folder
Move spirv targets to shared builtins folder
Move compute_runtime_mockable_extra to ze_intel_gpu folder

Signed-off-by: Mateusz Jablonski <mateusz.jablonski@intel.com>
2020-11-23 19:06:20 +01:00
Mateusz Hoppe 8aacad1854 Create DebuggerL0 only when debugging is supported
Related-To: NEO-5239

Signed-off-by: Mateusz Hoppe <mateusz.hoppe@intel.com>
2020-11-23 18:28:45 +01:00