BSD Commit Log Search

[VPlan] Move FOR splice cost into VPInstruction::FirstOrderRecurrenceSplice (#129645)

After #124093 we now support fixed-order recurrences with EVL tail
folding by replacing VPInstruction::FirstOrderRecurrenceSplice with a VP
splice intrinsic.

However the costing for the splice is currently done in
VPFirstOrderRecurrencePHIRecipe, so when we add the VP splice intrinsic
we end up costing it twice.

This fixes it by splitting out the cost for the splice into
FirstOrderRecurrenceSplice so that it's not duplicated when we replace
it.

We still have to keep the VF=1 checks in VPFirstOrderRecurrencePHIRecipe
since the splice might end up dead and discarded, e.g. in the test
@pr97452_scalable_vf1_for.

[VPlan] Use VPInstruction for VPScalarPHIRecipe. (NFCI) (#129767)

Now that all phi nodes manage their incoming blocks through the
VPlan-predecessors, there should be no need for having a dedicate
recipe, it should be sufficient to allow PHI opcodes in VPInstruction.

Follow-ups will also migrate VPWidenPHIRecipe and possibly others,
building on top of https://github.com/llvm/llvm-project/pull/129388.

PR: https://github.com/llvm/llvm-project/pull/129767

Merge branch 'main' into users/meinersbur/flang_runtime_remove-FLANG_INCLUDE_RUNTIME

Update OB name from `type` to `callee_type`.

Created using spr 1.3.6-beta.1

[𝘀𝗽𝗿] changes introduced through rebase

Created using spr 1.3.6-beta.1

[skip ci]

Update LTO compilation CodeGen flag for call-graph-section.

Created using spr 1.3.6-beta.1

[𝘀𝗽𝗿] changes introduced through rebase

Created using spr 1.3.6-beta.1

[skip ci]

Merge branch 'main' of https://github.com/llvm/llvm-project into remove-old-res-middle

.

Created using spr 1.3.5-bogner

Merge branch 'main' into users/vitalybuka/spr/ir-optimize-cfi-in-writecombinedglobalvaluesummary

[VPlan] Remove dead code in VPWidenPHIRecipe::print (NFC).

All incoming models for VPWidenPHIRecipe are modled in VPlan, remove
code trying to print the orignial phi.

release note

Created using spr 1.3.5-bogner

[LoopVectorize] Further improve cost model for early exit loops (#126235)

Following on from #125058, this patch takes into account the
work done in the vector early exit block when assessing the
profitability of vectorising the loop. I have renamed
areRuntimeChecksProfitable to isOutsideLoopWorkProfitable and
we now pass in the early exit costs. As part of this, I have
added the ExtractFirstActive opcode to VPInstruction::computeCost.

It's worth pointing out that when we assess profitability of the
loop we calculate a minimum trip count and compare that against
the *maximum* trip count. However, since the loop has an early
exit the runtime trip count can still end up being less than the
minimum. Alternatively, we may never take the early exit at all
at runtime and so we have the opposite problem of over-estimating
the cost of the loop. The loop vectoriser cannot simultaneously
take two contradictory positions and so I feel the only sensible
thing to do is be conservative and assume the loop will be more
expensive than loops without early exits.

    [4 lines not shown]

Merge remote-tracking branch 'origin/main' into users/ccc03-08-_astmatcher_templateargumentcountis_support_functiondecl_

[VPlan] Clean up unused header (NFC) (#130599)

We use VPlanPatternMatch, and not PatternMatch: clean up the
PatternMatch include to avoid confusion.

Rebase, address comments

Created using spr 1.3.5

Merge branch 'main' into users/kparzysz/spr/o03-cancel-directive-name

Merge branch 'main' into users/ylzsx/r-tls-noie

Merge branch 'main' into users/kparzysz/spr/o02-metadirective-flush

Rebase

Created using spr 1.3.5

[VPlan] Remove dead AnyOf reduction case in VPReductionRecipe. NFCI (#130048)

From what I understand, we only create VPReductionRecipes for in-loop
reductions, and we don't currently support in-loop AnyOf reductions.

We only create VPReductionRecipes in the !PhiR->isInLoop() section of
adjustRecipesForReductions, and this comment from the initial patch
seems to confirm this
https://reviews.llvm.org/D108136#anchor-inline-1038338, so I think we
can remove this check in the condition logic.

I checked compiling SPEC 2017 with -prefer-inloop-predicates and the
added assertion doesn't trigger.

reb

Created using spr 1.3.4

Merge branch 'main' into users/meinersbur/flang_runtime_premerge

Rebase, address comments

Created using spr 1.3.5

Rebase, address comments

Created using spr 1.3.5

Reabse, address comments

Created using spr 1.3.5

[VPlan] Add Name argument to VPWidenPHIRecipe. NFC (#129527)

This allows a different IR name for the generated phi to be used. This
is split off from #118638 and helps remove some of the diffs in it.

Rebase, address comments

Created using spr 1.3.5

rebase

Created using spr 1.3.5-bogner

Merge branch 'users/chapuni/mcdc/nest/nest-base' into users/chapuni/mcdc/nest/trunk