[Perf] Linux/x64: 6 Regressions on 10/11/2023 8:44:35 PM

### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [7c82eaafe6c67cfd85cb213cd5647e50074fb48e](https://github.com/dotnet/runtime/commit/7c82eaafe6c67cfd85cb213cd5647e50074fb48e)
Compare | [5280006fb69e15a3a429ff34a9a0b2f3c2434000](https://github.com/dotnet/runtime/commit/5280006fb69e15a3a429ff34a9a0b2f3c2434000)
Diff | [Diff](https://github.com/dotnet/runtime/compare/7c82eaafe6c67cfd85cb213cd5647e50074fb48e...5280006fb69e15a3a429ff34a9a0b2f3c2434000)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Collections.ContainsFalse&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[ICollection - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.ContainsFalse(Int32).ICollection(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Contains/ContainsFalse.cs#L80-#L82>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpVUXU/bMBR9r9T/4LckWxuSlI/SLUiFaQKNjkG77QEhZJLb1swfke2s7TTtt+86LdCEgTRFiuLrc869x/c6HCwZz5W2n6kAQ1KSU4vPHQf/qpSXJZQwMFYzOeuQauVwm0hArtst7zuTuVqYMI7Cocj3d8MkOk3CiwUPv4Ceeh3iLZjsLvd3u1TkXudfjPjwNA4nbAb6GYdJC7xifb0rpS1RPdoNh1og7QHLEUtdBDMUoKEGTxy8ylJPwF9KEPdfZsT9BmfbymNN4bh8MrEuzGCEZlDjjEH/RPm6l0XTS7t1867dGgFFCRAgrWm3fpPFHPfIccl4fgWFImlKvFxZCXZHowsmHLEGO9ZUZvMKqGFqduZAc7MjKJNN5FBnc2Yhs5iwwqNljyj9wm5V7ZbGBEw1TNXmeGUsiPBEcY4UpqTBb2kxq/lIuYH3Z9L2kqPw7Anhj9kvGJC9OAm2VHEYkThls1LTSufaO1GiYLxajVQO3g1J/xDPMoTnrzPPz7+NHuC6hNfBIyXV8GLyX3h0BbrQgO8Nb+rcvk7E0CccjQ1BsEyrW4FijbM9Udhg0BNVbL4a7Ztg88cWp4ccucsMbhj8JEp63eigG/cn8cEg6g/ivbDX3zvcTw7eRtEgigKnYkohqMbjJ1TPbgVd+pWi62aHvAnI3aqRovPY7Y5zdOl+EE6o0Ooeu/kMfQWm5DbVWHjub5lZx4d4HegMpXpBXe5eMUl+4NmkTErQ2z8sJWtIDTJHgPOczam2ZMHsnPgGNAOTVrB1tctM8VLItFnhah036bokBFpmOaTeBzxKvKCrzdJRiC9N4GKm4MymdAkm+AvSgR+YUAUAAA==>)</li></ul> | 103.60 μs | 140.02 μs | 1.35 | 0.04 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.ContainsFalse%28Int32%29_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.ContainsFalse%28Int32%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.ContainsFalse&lt;Int32&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.ContainsFalse&lt;Int32&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-ab0168dc-7ed1-425b-9a65-fa78ccc9ea0847e1438cc7d434395/06298a48-5115-4767-acbe-403e18cbe992.zip?sv=2021-08-06&se=2023-11-10T10%3A45%3A40Z&sr=c&sp=rl&sig=vTrXr7RbQeX%2F%2FpjbA4eP%2F%2Fmj8FocIx9%2BMTOsFC%2BeFrs%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-0ac3877f-2511-4d57-ad64-70cb80ddff784c81c8898f841d881/11879c35-4383-4f71-9b7a-1e4aa5ea4b1b.zip?sv=2021-08-06&se=2023-11-11T04%3A53%3A46Z&sr=c&sp=rl&sig=EcEbeOYANJHdzPNQeQ0RR%2FQ8l8k1TF2Hg4Ln0jQX%2FZ0%3D>)
### System.Collections.ContainsFalse&lt;Int32&gt;.ICollection(Size: 512)

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/11/2023 2:37:28 PM, 10/16/2023 8:09:45 PM falls between 10/6/2023 6:15:21 PM and 10/16/2023 8:09:45 PM.
IsRegressionStdDev: Marked as regression because -208.9482801824831 (T) = (0 -139680.74346940403) / Math.Sqrt((307213.1585862824 / (11)) + (52095.63695618427 / (15))) is less than -2.0638985616205927 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (15) - 2, .025) and -0.3606929724187627 = (102654.1227894402 - 139680.74346940403) / 102654.1227894402 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [7c82eaafe6c67cfd85cb213cd5647e50074fb48e](https://github.com/dotnet/runtime/commit/7c82eaafe6c67cfd85cb213cd5647e50074fb48e)
Compare | [5280006fb69e15a3a429ff34a9a0b2f3c2434000](https://github.com/dotnet/runtime/commit/5280006fb69e15a3a429ff34a9a0b2f3c2434000)
Diff | [Diff](https://github.com/dotnet/runtime/compare/7c82eaafe6c67cfd85cb213cd5647e50074fb48e...5280006fb69e15a3a429ff34a9a0b2f3c2434000)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Collections.IterateForEach&lt;String&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.IterateForEach(String).List(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Iterate/IterateForEach.cs#L104-#L112>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpVU72/TMBD9Xqn/g78lhTZL2rJ1hUzqCmgTK2NLgQ/TNHnJtfHwj8p2aIsQfzvntBtNxoZQpCg+v/funu8cDpYkudL2IxVgSEwyavG55eBfFvKigAKGxmom521SrhxuG2mRq2bD+8pkppYmiMJgJLL9ftANT7rB+ZIHn0DPvDbxlkx2Vvv9DhWZ1/4bIzo8iYIpm4N+xGHSAi9Zn28LaQtUD/vBSAuk3WM5YqmLYIYFaKjAuw5eZqkm4E8liAZPM6JBjbNr5aGmICn+mNgUZjBCU6hwEtDfUb7qZVn30mxcv242JkBRAgRIa5qNn2SZ4x45LhjPLmGhSBwTL1NWgt3T6IIJR6zAjjWVaV4CNczMXg40M3uCMllHjnSaMwupxYQlHi17ROkndstqdzSmYMphKjeTtbEggrHiHClMSROcWtDUwnul39E0f5OUo3QUnDFj/YT9gCF5FXVbO4I4h2MlZ2xeIM9JXHljJRaMl6uJysC7JvEv4lmG8Ox55tnZl8k9XBfwPHiipBqdT/8Lf4qzoRca8L3lzSg3/yBi6ANOxZYgWKrVjUCx2rGOFfYW9FQttl+1zk2x74nFwSFH7h6DmwO/G3Z7nfCgEw2m0cEwHAz7YTDoHh5EYe9lGA7DsOVUTCEE1Xj8hOr5jaArv1R0jWyTFy1yu66laD80uu0cXbh/gxNaaHWHrX6EvgRTcBtrLDzzd8xs4iO8CXSOUr1WVe5OMUm+4dnETErQu/8qJStIDTJDgPOc5lRbsmQ2J74BzcDEJWxT7SpVvBAyrle43sRNvCkJgZZZDrH3Fo8S7+Z6u3QU4kvTcjGz4MzGdAWm9RvwEr9oSwUAAA==>)</li></ul> | 2.28 μs | 2.61 μs | 1.14 | 0.03 | False | | |
|<ul><li>[SortedList - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.IterateForEach(String).SortedList(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Iterate/IterateForEach.cs#L182-#L190>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpVU70/bMBD9Xqn/g78l2dqQlAKlW5BKxwQaHYN02weEkEmujZl/VLazttO0v33ntLCmDKYpUhSf33t3z3cOB0vSQmn7kQowJCE5tfjccfCvSnlZQgl9YzWT0xapVg63jgTkutnwvjKZq7kJ4ygciHy/G3ai0054MefhJ9ATr0W8OZPtxX63TUXutf7GiA9P43DMpqCfcJi0wCvW57tS2hLVo2440AJpD1iOWOoimGEGGmrwjoNXWeoJ+HMJ4t7zjLi3xdm08lhTmJZ/TKwKMxihGdQ4KejvKF/3Mt/20mzcvGk2RkBRAgRIa5qNn2Re4B45LhnPr2CmSJIQL1dWgt3R6IIJR6zBjjWVWVEBNUzMTgE0NzuCMrmNHOisYBYyiwkrPFr2iNLP7FbVbmiMwVTDVG2mS2NBhEPFOVKYkiY8s6CphfdKn9CseJtWo3QUpjiDkJ8zY/2U/YA+2Ys7wYYsTuNQyQmblsh2QtfeUIkZ49VqpHLwbkjyi3iWITx/mXl+/mX0ANclvAweKakGF+P/wp/hhOiZBnyveRPKzT+IGPqAs7EmCJZpdStQbOtwhwo7DHqsZuuvrf6NsfupxfEhR+42g5sGvxN1dtvRQTvujeODftTr78VhHMeH+1H3dRT1oyhwKqYUgmo8fkL19FbQhV8puna2yKuA3C23UrQe291yji7dH8IJzbS6x4Y/QV+BKblNNBae+xtmVvEB3gc6RandoC53r5gk3/BsEiYl6M0/lpI1pAaZI8B5zgqqLZkzWxDfgGZgkgq2qnaRKV4KmWxXuFzFTbIqCYGWWQ6J9w6PEm/ocr10FOJLE7iYmXFmE7oAE/wGHlGggFEFAAA=>)</li></ul> | 4.75 μs | 5.24 μs | 1.10 | 0.14 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.IterateForEach%28String%29_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.IterateForEach%28String%29_2.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.IterateForEach%28String%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.IterateForEach&lt;String&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.IterateForEach&lt;String&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.IterateForEach&lt;String&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.IterateForEach&lt;String&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-ab0168dc-7ed1-425b-9a65-fa78ccc9ea0847e1438cc7d434395/06298a48-5115-4767-acbe-403e18cbe992.zip?sv=2021-08-06&se=2023-11-10T10%3A45%3A40Z&sr=c&sp=rl&sig=vTrXr7RbQeX%2F%2FpjbA4eP%2F%2Fmj8FocIx9%2BMTOsFC%2BeFrs%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-0ac3877f-2511-4d57-ad64-70cb80ddff784c81c8898f841d881/11879c35-4383-4f71-9b7a-1e4aa5ea4b1b.zip?sv=2021-08-06&se=2023-11-11T04%3A53%3A46Z&sr=c&sp=rl&sig=EcEbeOYANJHdzPNQeQ0RR%2FQ8l8k1TF2Hg4Ln0jQX%2FZ0%3D>)
### System.Collections.IterateForEach&lt;String&gt;.List(Size: 512)

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.6084099788924067 > 2.3809812624349758.
IsChangePoint: Marked as a change because one of 10/11/2023 2:37:28 PM, 10/16/2023 8:09:45 PM falls between 10/6/2023 6:15:21 PM and 10/16/2023 8:09:45 PM.
IsRegressionStdDev: Marked as regression because -16.853304480488294 (T) = (0 -2667.4407544097485) / Math.Sqrt((3700.687316499907 / (12)) + (1980.5709596235015 / (15))) is less than -2.0595385527466985 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (12) + (15) - 2, .025) and -0.1528643797507861 = (2313.7506902471628 - 2667.4407544097485) / 2313.7506902471628 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### JIT Disasms

### System.Collections.IterateForEach&lt;String&gt;.SortedList(Size: 512)

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.244357933096315 > 5.002796507027684.
IsChangePoint: Marked as a change because one of 10/6/2023 6:15:21 PM, 10/16/2023 8:09:45 PM falls between 10/6/2023 6:15:21 PM and 10/16/2023 8:09:45 PM.
IsRegressionStdDev: Marked as regression because -15.26960764035391 (T) = (0 -5303.850490853338) / Math.Sqrt((60.69930181781473 / (5)) + (27536.502491826675 / (22))) is less than -2.0595385527466985 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (22) - 2, .025) and -0.11401636470269552 = (4761.016677047477 - 5303.850490853338) / 4761.016677047477 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [7c82eaafe6c67cfd85cb213cd5647e50074fb48e](https://github.com/dotnet/runtime/commit/7c82eaafe6c67cfd85cb213cd5647e50074fb48e)
Compare | [5280006fb69e15a3a429ff34a9a0b2f3c2434000](https://github.com/dotnet/runtime/commit/5280006fb69e15a3a429ff34a9a0b2f3c2434000)
Diff | [Diff](https://github.com/dotnet/runtime/compare/7c82eaafe6c67cfd85cb213cd5647e50074fb48e...5280006fb69e15a3a429ff34a9a0b2f3c2434000)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Collections.Sort&lt;IntClass&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[Array_ComparerClass - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.Sort(IntClass).Array_ComparerClass(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Sort.cs#L47-#L48>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpVUXW/aQBB8R+I/3JtxC44NNCG0jkTpQ6qGpgm0fYii6IIXfOl9WHvnAlXV3949Q1IgTarKkuXbm5ndud2zBMfGuUH3kSuwLGUZd/TcSmhclvqihBL61qHQ8yarVh63iYTsql4LvgqdmYWNkjgaqOywG7Xj03Z0vpDRJ8BZ0GTBQujW8rDb4ioLmn9jJMenSTQRc8BHHKEdyIr1+bbUriT1uBsNUBHtHisJy32EMhSAsANve3iVZTeBfCpB0nuakfT2ONtWHmqKxuUfE+vCLEX4FHY4Y8DvJL/rZbHvpV67fl2vjYCTBCjQztZrP9kipz32thQyu4TCsDRlQWacBneA5EIoT9yBvUWup3kFRJjZgxx4Zg8UF3ofOcBpLhxMHSWs8GQ5YAaf2K2q3dKYgK2Gqdocr6wDFQ2NlEQRRpNtGrY377UbSm7tCdlHvroZGlVwBKyCjbH4AX32KmmHW7o0jkOjZ2JeIq+UrgLPErJajUwGwTVLf7HACYJnzzPPzr6M7uFYwvPgkdFmcD75LzwZBCwQ6L3hzbi0/yBS6AMNx4agxBTNjSKxvdMdGmox4MQUm6+9Bk6o/WNH88NO/HUGPw6NdtzutOKjVtKbJEf9+LjfTaJOr32YdOKXcdyP49Cr2FIpjnT8jOP8RvFlo1L0/WyyFyG7Xe2laD70u+kdXfhfhBcq0NxRxx+hL8GW0qVIhWeNLTPr+IAuBJ+TVCfclbszQrNvdDap0Bpw+5dl9A4SQWcE8J6nOUfHFsLlrGEBBdi0gq2rXU6NLJVO9ytcreM2XZdEQCechDR4R0dJV3S1WXoKa2gb+pgtpHApX4INfwPweJMMUgUAAA==>)</li></ul> | 39.71 μs | 43.78 μs | 1.10 | 0.00 | False | | |
|<ul><li>[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.Sort(IntClass).Array(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Sort.cs#L44-#L45>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpVUXU/bMBR9r9T/4LckWxuSUKB0C1LpHphGx6Dd9oAQMsltY+aPyHbWdpr223edFtaUwTRFiuLrc869x/c6HCyZFErbj1SAISnJqcXnjoN/VcnLCioYGKuZnHdIvXK4TSQg1+2W95XJXC1MGEfhUOSHvTCJzpLwYsHDT6BnXod4Cya7y8Nel4rc6/yNER+fxeGUzUE/4TBpgdesz3eVtBWqR71wqAXSHrAcsdRFMEMJGhrwxMHrLM0E/LkEcf95Rtzf4WxbeawpnFR/TKwLMxihGTQ4E9DfUb7pZbHrpd26edNujYGiBAiQ1rRbP8miwD1yWjGeX0GpSJoSL1dWgt3T6IIJR2zATjWVWVEDNczMXgE0N3uCMrmLHOqsYBYyiwlrPFr2iNLP7NbVbmlMwdTDVG9OVsaCCEeKc6QwJdE2Dtvb99KOODXmBO1ruvIn7AcMyEGcBFtKOIAjJWdsXmlac6+9kRIl4/VqrHLwbkj6i3iWITx/mXl+/mX8ANcVvAweK6mGF9P/wqMl0KUGfG94M8rNP4gY+oDjsCEIlml1K1Bs5zxHCpsKeqrKzddOy6bY8InFiSEn7gKDGwA/iZL9bnTUjfvT+GgQHQ8O4vAwOUr6veh1FA2iKHAqphKCajx+QvX8VtClXyu6DnbIq4DcrXZSdB473HGOLt1PwQmVWt1jj5+gr8BU3KYaC8/9LTPr+BCvAJ2j1H7QlLtXTJJveDYpkxL09k9KyQZSg8wR4DxnBdWWLJgtiG9AMzBpDVtXu8wUr4RMdytcreMmXZeEQMssh9R7h0eJl3K1WToK8aUJXMyUnNmULsEEvwEzB1wqRAUAAA==>)</li></ul> | 21.26 μs | 24.50 μs | 1.15 | 0.29 | False | | |
|<ul><li>[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.Sort(IntClass).List(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Sort.cs#L59-#L60>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpVUXW/TMBR9r9T/4Lck0GZJ9lUKmVTKwxArY2uBh2mavOS28fBHZDu0RYjfznXajSZjQyhSFF+fc+49vtfhYMm0UNp+pAIMSUlOLT63HPzLSl5UUMHQWM3kokfqlcNtIwG56na8r0zmamnCOApHIj86CJPoNAnPlzz8BHru9Yi3ZLK/OjroU5F7vb8x4lencThjC9CPOExa4DXr820lbYXq0UE40gJp91iOWOoimKEEDQ144uB1lmYC/lSCePA0Ix60OLtWHmoKp9UfE5vCDEZoBg3OFPR3lG96Wba9dDvXr7udCVCUAAHSmm7nJ1kWuEfeVoznl1AqkqbEy5WVYPc0umDCERuwt5rKrKiBGuZmrwCamz1BmWwjRzormIXMYsIaj5Y9ovQTu3W1OxozMPUw1ZvTtbEgwrHiHClMSbSNw/bmvbRjTo05Cc+Ysf6U/YAhOYyTYEcI52+s5JwtKk1r6pU3VqJkvF5NVA7eNUl/Ec8yhOfPM8/Ovkzu4bqC58ETJdXofPZfeHQEutSA7y1vTrn5BxFDH3AatgTBMq1uBIq1jnOssKegZ6rcfrU6NsN+Ty0ODDlx9xdc//0kSvb70XE/Hszi42EcDaM4HBwn0WEyeBnhKgqciqmEoBqPn1C9uBF05deKroE98iIgt+tWit5Dg3vO0YX7JzihUqs7bPEj9CWYittUY+G5v2NmEx/hDaALlNoPmnJ3iknyDc8mZVKC3v1HKdlAapA5ApznrKDakiWzBfENaAYmrWGbaleZ4pWQabvC9SZu0k1JCLTMcki9d3iUeCfX26WjEF+awMVMyZlN6QpM8Bt96Rl/QwUAAA==>)</li></ul> | 21.03 μs | 24.08 μs | 1.14 | 0.31 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.Sort%28IntClass%29_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.Sort%28IntClass%29_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.Sort%28IntClass%29_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_17_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.Sort%28IntClass%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.Sort&lt;IntClass&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.Sort&lt;IntClass&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.Sort&lt;IntClass&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.Sort&lt;IntClass&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-ab0168dc-7ed1-425b-9a65-fa78ccc9ea0847e1438cc7d434395/06298a48-5115-4767-acbe-403e18cbe992.zip?sv=2021-08-06&se=2023-11-10T10%3A45%3A40Z&sr=c&sp=rl&sig=vTrXr7RbQeX%2F%2FpjbA4eP%2F%2Fmj8FocIx9%2BMTOsFC%2BeFrs%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-0ac3877f-2511-4d57-ad64-70cb80ddff784c81c8898f841d881/11879c35-4383-4f71-9b7a-1e4aa5ea4b1b.zip?sv=2021-08-06&se=2023-11-11T04%3A53%3A46Z&sr=c&sp=rl&sig=EcEbeOYANJHdzPNQeQ0RR%2FQ8l8k1TF2Hg4Ln0jQX%2FZ0%3D>)
### System.Collections.Sort&lt;IntClass&gt;.Array_ComparerClass(Size: 512)

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.7810003 > 41.791916170307694.
IsChangePoint: Marked as a change because one of 10/11/2023 2:37:28 PM, 10/16/2023 8:09:45 PM falls between 10/6/2023 6:15:21 PM and 10/16/2023 8:09:45 PM.
IsRegressionStdDev: Marked as regression because -11.227223771303683 (T) = (0 -42732.98264476434) / Math.Sqrt((175166.74147682652 / (12)) + (682168.9969775461 / (15))) is less than -2.0595385527466985 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (12) + (15) - 2, .025) and -0.06882788456324666 = (39981.16372331196 - 42732.98264476434) / 39981.16372331196 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### JIT Disasms

### System.Collections.Sort&lt;IntClass&gt;.Array(Size: 512)

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 10/11/2023 2:37:28 PM, 10/16/2023 8:09:45 PM falls between 10/6/2023 6:15:21 PM and 10/16/2023 8:09:45 PM.
IsRegressionStdDev: Marked as regression because -8.313730188731535 (T) = (0 -23398.480596786325) / Math.Sqrt((632335.3224796153 / (11)) + (1216701.8395517303 / (15))) is less than -2.0638985616205927 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (15) - 2, .025) and -0.15244278899757102 = (20303.377156916413 - 23398.480596786325) / 20303.377156916413 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### JIT Disasms

### System.Collections.Sort&lt;IntClass&gt;.List(Size: 512)

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.07509402666667 > 22.04463978125.
IsChangePoint: Marked as a change because one of 10/11/2023 2:37:28 PM, 10/16/2023 8:09:45 PM falls between 10/6/2023 6:15:21 PM and 10/16/2023 8:09:45 PM.
IsRegressionStdDev: Marked as regression because -9.436014622978808 (T) = (0 -23470.53667306471) / Math.Sqrt((653539.8268277029 / (12)) + (855970.6974405069 / (15))) is less than -2.0595385527466985 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (12) + (15) - 2, .025) and -0.15508438509514205 = (20319.326428373013 - 23470.53667306471) / 20319.326428373013 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	7c82eaafe6c67cfd85cb213cd5647e50074fb48e
Compare	5280006fb69e15a3a429ff34a9a0b2f3c2434000
Diff	Diff
Configs	CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
List - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	2.28 μs	2.61 μs	1.14	0.03	False
SortedList - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	4.75 μs	5.24 μs	1.10	0.14	False

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Array_ComparerClass - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	39.71 μs	43.78 μs	1.10	0.00	False
Array - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	21.26 μs	24.50 μs	1.15	0.29	False
List - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	21.03 μs	24.08 μs	1.14	0.31	False

[Perf] Linux/x64: 6 Regressions on 10/11/2023 8:44:35 PM #23309

Description

Run Information

Regressions in System.Collections.ContainsFalse<Int32>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Collections.ContainsFalse<Int32>.ICollection(Size: 512)

ETL Files

Histogram

Description of detection logic

JIT Disasms

Docs

Run Information

Regressions in System.Collections.IterateForEach<String>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Collections.IterateForEach<String>.List(Size: 512)

ETL Files

Histogram

Description of detection logic

JIT Disasms

System.Collections.IterateForEach<String>.SortedList(Size: 512)

ETL Files

Histogram

Description of detection logic

JIT Disasms

Docs

Run Information

Regressions in System.Collections.Sort<IntClass>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Collections.Sort<IntClass>.Array_ComparerClass(Size: 512)

ETL Files

Histogram

Description of detection logic

JIT Disasms

System.Collections.Sort<IntClass>.Array(Size: 512)

ETL Files

Histogram

Description of detection logic

JIT Disasms

System.Collections.Sort<IntClass>.List(Size: 512)

ETL Files

Histogram

Description of detection logic

JIT Disasms

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions