[Perf] Linux/x64: 5 Regressions on 11/20/2023 6:28:42 AM

### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [83f116627e2548c7a55b3701bd5448570b84a784](https://github.com/dotnet/runtime/commit/83f116627e2548c7a55b3701bd5448570b84a784)
Compare | [5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb](https://github.com/dotnet/runtime/commit/5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb)
Diff | [Diff](https://github.com/dotnet/runtime/compare/83f116627e2548c7a55b3701bd5448570b84a784...5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Collections.Concurrent.IsEmpty&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.Concurrent.IsEmpty(Int32).Queue(Size%3a%200).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Concurrent/IsEmpty.cs#L34-#L35>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpVUXW/TMBR9R+I/+C0JZG36oTEqMtGVAYUWRlvxgtDkJreNkT+ia3trJsRvx05LWTtphJfKPjrn3OubezoFqi2CAGn0k5/ktgAEcmEZz2dQKpKmJMiVkWDaaKVhAoJD1gVSmRU1D2Gl2wXQXLcFZfKIOMSsYAYy46oRJkkYbE77QUwCisIdoj17Adp8ogK85+tgXmkDojVSnDstU1K7s8wsouu4NdaXojTVq7E0ve5564sFC+Gc3cGAJNHfBmZWOtGKrS3S2uNbMFKiZLy+TVUOwXeS/iKBYY6eB08fU04mX6d/6GjhcfJUSTX8vPgvvnsMYIngfne6FeX6H0IHfWQy3wkEy1BdC2d2T8U0+GGFD9RDZaIGtLHSE34j6q/ZhP9BX8o1k9CEe7VWi6psRi0qzTLKr1AJ5ZGmwvfVEln+jqsl5eyuxprIZt1Z0wqXmxLQZUTWC3y40iPl8gO4UOXudBiPhZPNDRUlOSc5NeCjFnaTbu8kOTvpdhbJ2aDTG3ROW53+i/7LpP88SQZJ4ktoKwRFt/OE4vpa0E1YG/oOYvIsIsvqqEK8j1jsN6kOjfMpUf1wEXtAnoG23KTous7Dey/Z4sMbQLp2Tr0oJrWVN07fIgOZ82qP+GHVF9+yy24OSPwbs4KiIbfMFCTUbnig070mJptMcStketxTtcV1um3CEQ0zHNLgjRud+1OpdlcvIaHUkcd0yZlJ6QZ09Bu0VBuW9gQAAA==>)</li></ul> | 9.56 ns | 10.90 ns | 1.14 | 0.08 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.Concurrent.IsEmpty%28Int32%29_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.Concurrent.IsEmpty%28Int32%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;Int32&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.Concurrent.IsEmpty&lt;Int32&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;Int32&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.Concurrent.IsEmpty&lt;Int32&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-bdb3debd-9d5b-4fde-8f54-2ecb422e1fc3d7f6f7a9cba48e987/db01048d-86db-43f9-80fb-b515a86b6d7d.zip?sv=2021-08-06&se=2023-12-19T19%3A07%3A43Z&sr=c&sp=rl&sig=at21WTQ9%2BNT%2FyiSFzV%2FHPsfkWYF%2B8MEP5jbfks2VTW8%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-7909a506-02a7-44bc-ba5f-9d42871609abc89a0ff00e24004a1/a25503c2-84ce-4393-8660-78cf80241033.zip?sv=2021-08-06&se=2023-12-20T14%3A23%3A52Z&sr=c&sp=rl&sig=5T%2FdqAwhfG1AwJ6YH2FgsZaKIx8KzDX6BYdyKkk9%2FjA%3D>)
### System.Collections.Concurrent.IsEmpty&lt;Int32&gt;.Queue(Size: 0)

#### ETL Files

#### Histogram

#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [83f116627e2548c7a55b3701bd5448570b84a784](https://github.com/dotnet/runtime/commit/83f116627e2548c7a55b3701bd5448570b84a784)
Compare | [5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb](https://github.com/dotnet/runtime/commit/5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb)
Diff | [Diff](https://github.com/dotnet/runtime/compare/83f116627e2548c7a55b3701bd5448570b84a784...5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Tests.Perf_Random

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[NextBytes - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Tests.Perf_Random.NextBytes.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Runtime.Extensions/Perf.Random.cs#L42-#L43>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUUW/TMBDH35H4Dn5LAlmbphOrKgXRlgGDdpQs4gWhyk2ujVFsR2dnSybEZ8dOS1k7aYSXyP7n9787X3xZAFUVAgeh1bOf5C4HBDKtWJHFUEoSRcTJpBag+1gJzTg4x9QUqUjzlkPYqH4ONFN9Tpk4ASeY5kxDqk02wgRxnfrVueMThyI3C+9AJ6D0NeVgY75xbhqlgfesqHpLwM0qpiKTvHcNtZ42GtTfPHElZlJs2LZCqpkU6pszk7xkRbtbyAyc7yT6RRzNDJ45z59yzudfF39wrOBpeCGFnHxO/ou/EhqwRDDPvW9DC/UPo5E+MZHtDZylKFfcBHvgYgp4qRv3kXsitdcBu5JqXtzy9qN14T+qS7FlArqwy61MmrIbmjeKpbRYouTSKl2NH5o1sux9Ide0YPet1sUWh3HXDJd1CWhGQbT39PjmzqQZE8BElvvV8RQkxnajKS/Ja5JRDXai3DAIh2fB6CwcJMFoPBiOzy96o8FFGAajl0EwDgKbQlWcU2T3QChuV5zWbhvQVuCTFx5ZNycZ/MMk+fYmfamgAhOnRPnDTOEjOAZVFTpCU3XmPjjJTp/cAtKtiTT0fNKGsoGjd8hAZEVzUGyz2o0tGc07QGLPmOYUNbljOieuMs0DFR08PqlTWVRcRKc1NTtdRbsiDKiZLiBy3prWmX9Hs99aC3GF8qymyoLpiNagvN9Y5QiM3QQAAA==>)</li></ul> | 2.29 μs | 2.47 μs | 1.08 | 0.02 | False | | |
|<ul><li>[NextBytes_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Tests.Perf_Random.NextBytes_unseeded.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Runtime.Extensions/Perf.Random.cs#L45-#L46>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUUW/TMBDH35H4Dn5LAlmbtaN0lYJoywaDdpSs4gWhyo2vjVFsR2dnaybEZ8dOS1k7aYSXyP7n9787X3yZAtUlggBp9LOf5C4DBDIqec4SKBSJY+IxZSSYNpbScAHeITVCKtOs5hBWup0BZbotKJdH4BDTjBtIjc1GuCS+t+mdeSHxKAq7CPb0HLS5pgJczLfeTaUNiJYTdWsGuFokVDIlWtewMaPKgF6UUgMwYH8TJqUcK7ni6xKp4Urqb95YiYLn9W6qGHjfSfyLeIZbnHnPn3JOJl+nf3As4Wl4qqQafp7/F38lDWCBYJ8734rm+h9GK33iku0MgqeoFsIGe+DiGkRhKv+Re6hM0AC7UnqS34r66zXhP+oLueYSmrCztZpXRTM0qzRPaT5DJZRTmho/VEvk7H2uljTn97XWxJZ0kqYZLjYFoJ0JWV/Ywys8VnZeAOeq2K0Ox2FubTeGioK8IYwacKPld6JO9yTqn3RO51F/cNodnL1unb/q9nu985dRNIgil0KXQlDk90AorheCbvw6oKsgJC8CsqyOMoT7kQrdTfpSQgk2ToHqhx3HR3ACusxNjLZq5j84yVYf3gLStY3UDUJSh3KB40vkIFle7RXXrHrjSkb7DpC4M6YZRUPuuMmIr23zQMd7T0g2qcpLIePjmqqtruNtERY03OQQe+9s6+xPpNptnYX4UgdO00XOTUw3oIPfdozmZ+YEAAA=>)</li></ul> | 162.49 ns | 264.33 ns | 1.63 | 0.11 | False | | |
|<ul><li>[NextBytes_span_unseeded - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Tests.Perf_Random.NextBytes_span_unseeded.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Runtime.Extensions/Perf.Random.cs#L58-#L59>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUUW/TMBDH35H4Dn5LAlmbtQNKpSDassGgHSWreEGocuNrYxTb0dnZkgnx2bHTUtZOGuElsv/5/e/OF19mQHWJIEAa/eQnuc0AgYxLnrMECkXimHhMGQmmi6U0XIB3SI2RyjRrOIS17mZAme4KyuUROMI04wZSY7MRLonvVS/PvJB4FIVdBHt6AdpcUQEu5lvvutYGRMeJujMHXC8TKpkSnSuozLg2oJe6oHJZSg3AgP3NmpRyouSab0qkhiupv3kTJQqeN7uZYuB9J/Ev4hluceY9fcw5nX6d/cGxhMfhmZJq9HnxX/ylNIAFgn3ufGua638YrfSJS7YzCJ6iWgob7J6LaxCFqf0H7pEyQQvsUulpfiOaT9iG/6jP5YZLaMPON2pRF+3QrNY8pfkclVBOaWv8UK+Qs/e5WtGc3zVaG1vSS9pmOK8KQDsYsrm1h/d4ouzQAC5UsVsdzsTC2q4NFQV5Qxg14ObL70W9/kk0OOmdLqLB8LQ/PBt0ote9F6f9V8+jaBhFLoUuhaDI74BQ3CwFrfwmoKsgJM8CsqqPMoT7uQrdTfpSQgk2ToHqh53JB3ACusxNjLZq5t87yVYf3QDSjY3UD0LShHKB4wvkIFle7xXXrGbjSkb7DpC4M6YZRUNuucmIr23zQMd7T0iqVOWlkPFxTfVW1/G2CAsabnKIvXe2dfZPUu+2zkJ8qQOn6SLnJqYV6OA3qIJyLusEAAA=>)</li></ul> | 160.76 ns | 261.53 ns | 1.63 | 0.11 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Tests.Perf_Random_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Tests.Perf_Random_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Tests.Perf_Random_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Tests.Perf_Random.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_Random*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_Random* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_Random*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_Random* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-bdb3debd-9d5b-4fde-8f54-2ecb422e1fc3d7f6f7a9cba48e987/db01048d-86db-43f9-80fb-b515a86b6d7d.zip?sv=2021-08-06&se=2023-12-19T19%3A07%3A43Z&sr=c&sp=rl&sig=at21WTQ9%2BNT%2FyiSFzV%2FHPsfkWYF%2B8MEP5jbfks2VTW8%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-7909a506-02a7-44bc-ba5f-9d42871609abc89a0ff00e24004a1/a25503c2-84ce-4393-8660-78cf80241033.zip?sv=2021-08-06&se=2023-12-20T14%3A23%3A52Z&sr=c&sp=rl&sig=5T%2FdqAwhfG1AwJ6YH2FgsZaKIx8KzDX6BYdyKkk9%2FjA%3D>)
### System.Tests.Perf_Random.NextBytes

#### ETL Files

#### Histogram

#### JIT Disasms

### System.Tests.Perf_Random.NextBytes_unseeded

#### ETL Files

#### Histogram

#### JIT Disasms

### System.Tests.Perf_Random.NextBytes_span_unseeded

#### ETL Files

#### Histogram

#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [83f116627e2548c7a55b3701bd5448570b84a784](https://github.com/dotnet/runtime/commit/83f116627e2548c7a55b3701bd5448570b84a784)
Compare | [5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb](https://github.com/dotnet/runtime/commit/5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb)
Diff | [Diff](https://github.com/dotnet/runtime/compare/83f116627e2548c7a55b3701bd5448570b84a784...5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Tests.Perf_String

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[ToLower - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Tests.Perf_String.ToLower(s%3a%20%22TeSt%22).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Runtime/Perf.String.cs#L217-#L223>)</li><li>[📈 - ADX Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUb2/TMBDG3yPxHay9SQJZm7YTqioF0Y3BBi2UNuINQpWbXBMj/4nOztpMiM+OnZaydtIIbyL7ye+5O198mQLVFYIAafSzn2RTAAK5rBjP5lAqEsfEy5SRYLpYScMEeMfUJVKZFg2HsNbdAmimu4IyeQKOMS2YgdTYbIRJ4nvbVxdeSDyKwi6CA52ANp+oABfzjbeotQHRcaLuzADXy4VBJvNOoiZqA+jrETlLYGHOgr8J55W8UnLN8gqpYUrqb96VEiXjzW6qMvC+k/gX8QyzeOY9f8o5mXyd/sGxgqfhqZJq/Dn5L/5WGsASwT73vjXl+h9GK31kMtsbBEtRLYUN9sDFNIjS1P4j91iZoAV2q/SE34nm67XhP+hrmTMJbdhZrpK6bIcWtWYp5TNUQjmlrfGmXiHL3nO1opzdN1ob27w/b5vhelsC2pmQzYU9vsJXys4LYKLK/ep4HBJrWxgqSvKaZNSAGy2/H/UH59HwvN9LouGodzGKhp1hNOz3Br2XUTSKIpdCV0JQZPdAKOZLQbd+E9BVEJIXAVnVJxnCw0iF7iZ9qaACG6dE9cOO4yN4DrriJkZbdeY/OMlOH98B0txGGgQhaUK5wPE7ZCAzXh8U16xm40pG+w6QuDOmBUVDNswUxNe2eaDjgyck21TxSsj4tKZ6p+t4V4QFDTMcYu+tbZ39idT7rbMQX+rAabrkzMR0Czr4DfPP75bmBAAA>)</li></ul> | 101.12 ns | 111.70 ns | 1.10 | 0.01 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Tests.Perf_String_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_21_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Tests.Perf_String.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_String*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_String* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_String*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_String* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-bdb3debd-9d5b-4fde-8f54-2ecb422e1fc3d7f6f7a9cba48e987/db01048d-86db-43f9-80fb-b515a86b6d7d.zip?sv=2021-08-06&se=2023-12-19T19%3A07%3A43Z&sr=c&sp=rl&sig=at21WTQ9%2BNT%2FyiSFzV%2FHPsfkWYF%2B8MEP5jbfks2VTW8%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-7909a506-02a7-44bc-ba5f-9d42871609abc89a0ff00e24004a1/a25503c2-84ce-4393-8660-78cf80241033.zip?sv=2021-08-06&se=2023-12-20T14%3A23%3A52Z&sr=c&sp=rl&sig=5T%2FdqAwhfG1AwJ6YH2FgsZaKIx8KzDX6BYdyKkk9%2FjA%3D>)
### System.Tests.Perf_String.ToLower(s: "TeSt")

#### ETL Files

#### Histogram

#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	83f116627e2548c7a55b3701bd5448570b84a784
Compare	5fa2080e2fff7bb31a4235250ce2f7a4bb1b64cb
Diff	Diff
Configs	CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
NextBytes - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	2.29 μs	2.47 μs	1.08	0.02	False
NextBytes_unseeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	162.49 ns	264.33 ns	1.63	0.11	False
NextBytes_span_unseeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	160.76 ns	261.53 ns	1.63	0.11	False

[Perf] Linux/x64: 5 Regressions on 11/20/2023 6:28:42 AM #24786

Description

Run Information

Regressions in System.Collections.Concurrent.IsEmpty<Int32>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Collections.Concurrent.IsEmpty<Int32>.Queue(Size: 0)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Tests.Perf_Random

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Tests.Perf_Random.NextBytes

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.NextBytes_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.NextBytes_span_unseeded

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Tests.Perf_String

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Tests.Perf_String.ToLower(s: "TeSt")

ETL Files

Histogram

JIT Disasms

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions