Masked Vector Load and Store Intrinsics.
authorElena Demikhovsky <elena.demikhovsky@intel.com>
Sun, 23 Nov 2014 08:07:43 +0000 (08:07 +0000)
committerElena Demikhovsky <elena.demikhovsky@intel.com>
Sun, 23 Nov 2014 08:07:43 +0000 (08:07 +0000)
commitae1ae2c3a179851437ed2f4ac3d83a0f024e5861
treec03cb369617ea9722efc3424445b8b20e21187b6
parent4f5aa5994e1ace1da714bd2faacfc8f0dbaef4f7
Masked Vector Load and Store Intrinsics.
Introduced new target-independent intrinsics in order to support masked vector loads and stores. The loop vectorizer optimizes loops containing conditional memory accesses by generating these intrinsics for existing targets AVX2 and AVX-512. The vectorizer asks the target about availability of masked vector loads and stores.
Added SDNodes for masked operations and lowering patterns for X86 code generator.
Examples:
<16 x i32> @llvm.masked.load.v16i32(i8* %addr, <16 x i32> %passthru, i32 4 /* align */, <16 x i1> %mask)
declare void @llvm.masked.store.v8f64(i8* %addr, <8 x double> %value, i32 4, <8 x i1> %mask)

Scalarizer for other targets (not AVX2/AVX-512) will be done in a separate patch.

http://reviews.llvm.org/D6191

git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@222632 91177308-0d34-0410-b5e6-96231b3b80d8
32 files changed:
include/llvm/Analysis/TargetTransformInfo.h
include/llvm/CodeGen/ISDOpcodes.h
include/llvm/CodeGen/SelectionDAG.h
include/llvm/CodeGen/SelectionDAGNodes.h
include/llvm/IR/IRBuilder.h
include/llvm/IR/Intrinsics.h
include/llvm/IR/Intrinsics.td
include/llvm/Target/TargetSelectionDAG.td
lib/Analysis/TargetTransformInfo.cpp
lib/CodeGen/SelectionDAG/DAGCombiner.cpp
lib/CodeGen/SelectionDAG/LegalizeIntegerTypes.cpp
lib/CodeGen/SelectionDAG/LegalizeTypes.h
lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp
lib/CodeGen/SelectionDAG/SelectionDAG.cpp
lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp
lib/CodeGen/SelectionDAG/SelectionDAGBuilder.h
lib/CodeGen/SelectionDAG/SelectionDAGDumper.cpp
lib/IR/Function.cpp
lib/IR/IRBuilder.cpp
lib/IR/Verifier.cpp
lib/Target/X86/X86ISelLowering.cpp
lib/Target/X86/X86InstrAVX512.td
lib/Target/X86/X86InstrSSE.td
lib/Target/X86/X86TargetTransformInfo.cpp
lib/Transforms/Vectorize/LoopVectorize.cpp
test/CodeGen/X86/masked_memop.ll [new file with mode: 0644]
test/Transforms/LoopVectorize/X86/mask1.ll [new file with mode: 0644]
test/Transforms/LoopVectorize/X86/mask2.ll [new file with mode: 0644]
test/Transforms/LoopVectorize/X86/mask3.ll [new file with mode: 0644]
test/Transforms/LoopVectorize/X86/mask4.ll [new file with mode: 0644]
utils/TableGen/CodeGenTarget.cpp
utils/TableGen/IntrinsicEmitter.cpp