Skip to content

Instantly share code, notes, and snippets.

@ronen-fr
Created February 23, 2023 16:24
Show Gist options
  • Save ronen-fr/e1aaf304ffff7a7c71073b09fde2197e to your computer and use it in GitHub Desktop.
Save ronen-fr/e1aaf304ffff7a7c71073b09fde2197e to your computer and use it in GitHub Desktop.
timeline of scrub reservations vs osd-scrub-dump.sh collected data
0 166221 2023 02 15T23 47 38 823+0000 7f1eb72ce700 15 osd 0 pg_epoch 50 pg[3 6( v 47'64 (0'0,47'64] local lis/les=41/43 n=64 ec=41/41 lis/c=41/41 les/c/f=43/43/0 sis=41) [0,1,4] r=0 lpr=41 crt=47'64 lcod 47'63 mlcod 47'63 active+clean] scrubber<NotActive> reserve_local local resources reserved
1 218584 2023 02 15T23 47 38 823+0000 7f6c6c685700 20 osd 1 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
1 218618 2023 02 15T23 47 38 862+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[1 a( v 47'61 (0'0,47'61] local lis/les=32/33 n=61 ec=32/32 lis/c=32/32 les/c/f=33/34/0 sis=32) [1,2,4] r=0 lpr=32 crt=47'61 lcod 47'60 mlcod 47'60 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 148602 2023 02 15T23 47 38 927+0000 7fbf7973f700 20 osd 2 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
4 199823 2023 02 15T23 47 38 890+0000 7fd96b2f9700 20 osd 4 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
4 199942 2023 02 15T23 47 38 890+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 166591 2023 02 15T23 47 39 674+0000 7f1ea2aa5700 20 osd 0 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
0 166619 2023 02 15T23 47 39 839+0000 7f1eb72ce700 15 osd 0 pg_epoch 50 pg[3 f( v 47'62 (0'0,47'62] local lis/les=41/43 n=62 ec=41/41 lis/c=41/41 les/c/f=43/43/0 sis=41) [0,1,4] r=0 lpr=41 crt=47'62 lcod 47'61 mlcod 47'61 active+clean] scrubber<NotActive> reserve_local local resources reserved
0 166702 2023 02 15T23 47 39 840+0000 7f1ea42a8700 20 osd 0 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
1 218993 2023 02 15T23 47 39 586+0000 7f6c6b683700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
1 219018 2023 02 15T23 47 39 674+0000 7f6c6b683700 20 osd 1 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 1)
2 148737 2023 02 15T23 47 39 403+0000 7fbf8c765700 15 osd 2 pg_epoch 50 pg[2 e( v 47'69 (0'0,47'69] local lis/les=37/39 n=69 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [2,3,5] r=0 lpr=37 crt=47'69 lcod 47'68 mlcod 47'68 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 149046 2023 02 15T23 47 39 586+0000 7fbf77f3c700 20 osd 2 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
3 199269 2023 02 15T23 47 39 500+0000 7fc7f88bb700 20 osd 3 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
3 199381 2023 02 15T23 47 39 674+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[3 d( v 47'67 (0'0,47'67] local lis/les=41/43 n=67 ec=41/41 lis/c=41/41 les/c/f=43/43/0 sis=41) [3,1,0] r=0 lpr=41 crt=47'67 lcod 47'66 mlcod 47'66 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 200115 2023 02 15T23 47 39 586+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[3 8( v 47'66 (0'0,47'66] local lis/les=41/43 n=66 ec=41/41 lis/c=41/41 les/c/f=43/44/0 sis=41) [4,1,2] r=0 lpr=41 crt=47'66 lcod 47'65 mlcod 47'65 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 200228 2023 02 15T23 47 39 840+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 1)
4 200249 2023 02 15T23 47 39 840+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 1)
5 161619 2023 02 15T23 47 39 483+0000 7ff32542e700 20 osd 5 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
0 166809 2023 02 15T23 47 40 862+0000 7f1eb72ce700 15 osd 0 pg_epoch 50 pg[2 f( v 47'62 (0'0,47'62] local lis/les=37/39 n=62 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [0,5,4] r=0 lpr=37 crt=47'62 lcod 47'61 mlcod 47'61 active+clean] scrubber<NotActive> reserve_local local resources reserved
0 168207 2023 02 15T23 47 40 898+0000 7f1ea3aa7700 20 osd 0 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
1 219313 2023 02 15T23 47 40 898+0000 7f6c6c685700 20 osd 1 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 1)
1 220574 2023 02 15T23 47 40 935+0000 7f6c6ce86700 20 osd 1 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 2)
2 149098 2023 02 15T23 47 40 372+0000 7fbf8c765700 15 osd 2 pg_epoch 50 pg[1 d( v 47'67 (0'0,47'67] local lis/les=32/34 n=67 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [2,4,1] r=0 lpr=32 crt=47'67 lcod 47'66 mlcod 47'66 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 149181 2023 02 15T23 47 40 373+0000 7fbf77f3c700 20 osd 2 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 2)
2 149445 2023 02 15T23 47 40 936+0000 7fbf7973f700 20 osd 2 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
4 200276 2023 02 15T23 47 40 373+0000 7fd96a2f7700 20 osd 4 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 1)
4 200297 2023 02 15T23 47 40 373+0000 7fd96a2f7700 20 osd 4 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 1)
4 200348 2023 02 15T23 47 40 863+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 1)
4 200561 2023 02 15T23 47 40 898+0000 7fd96b2f9700 20 osd 4 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 1)
4 200771 2023 02 15T23 47 40 936+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
5 161975 2023 02 15T23 47 40 863+0000 7ff327432700 20 osd 5 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 168502 2023 02 15T23 47 41 682+0000 7f1ea2aa5700 20 osd 0 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
0 168543 2023 02 15T23 47 41 893+0000 7f1eb72ce700 15 osd 0 pg_epoch 50 pg[2 8( v 47'66 (0'0,47'66] local lis/les=37/39 n=66 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [0,2,1] r=0 lpr=37 crt=47'66 lcod 47'65 mlcod 47'65 active+clean] scrubber<NotActive> reserve_local local resources reserved
1 221041 2023 02 15T23 47 41 600+0000 7f6c6b683700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
1 221269 2023 02 15T23 47 41 682+0000 7f6c6b683700 20 osd 1 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
1 221318 2023 02 15T23 47 41 875+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[3 4( v 47'51 (0'0,47'51] local lis/les=41/42 n=51 ec=41/41 lis/c=41/41 les/c/f=42/42/0 sis=41) [1,2,4] r=0 lpr=41 crt=47'51 lcod 47'50 mlcod 47'50 active+clean] scrubber<NotActive> reserve_local local resources reserved
1 221427 2023 02 15T23 47 41 894+0000 7f6c6b683700 20 osd 1 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
2 150992 2023 02 15T23 47 41 507+0000 7fbf7773b700 20 osd 2 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
2 151220 2023 02 15T23 47 41 600+0000 7fbf77f3c700 20 osd 2 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
2 151250 2023 02 15T23 47 41 875+0000 7fbf7773b700 20 osd 2 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
2 151273 2023 02 15T23 47 41 894+0000 7fbf77f3c700 20 osd 2 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
3 200089 2023 02 15T23 47 41 507+0000 7fc7f88bb700 20 osd 3 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
3 201477 2023 02 15T23 47 41 682+0000 7fc7f90bc700 20 osd 3 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
4 202284 2023 02 15T23 47 41 600+0000 7fd96a2f7700 20 osd 4 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
4 202341 2023 02 15T23 47 41 875+0000 7fd969af6700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
5 162305 2023 02 15T23 47 41 507+0000 7ff32542e700 20 osd 5 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
0 168881 2023 02 15T23 47 42 857+0000 7f1ea3aa7700 20 osd 0 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 2)
0 170144 2023 02 15T23 47 42 869+0000 7f1ea42a8700 20 osd 0 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
1 221662 2023 02 15T23 47 42 857+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[1 b( v 47'65 (0'0,47'65] local lis/les=32/33 n=65 ec=32/32 lis/c=32/32 les/c/f=33/34/0 sis=32) [1,0,2] r=0 lpr=32 crt=47'65 lcod 47'64 mlcod 47'64 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 151420 2023 02 15T23 47 42 857+0000 7fbf78f3e700 20 osd 2 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
4 202872 2023 02 15T23 47 42 869+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
5 162749 2023 02 15T23 47 42 869+0000 7ff327432700 20 osd 5 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
T 16150 2023 02 15T23 47 42 040 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 16151 2023 02 15T23 47 42 152 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16179 2023 02 15T23 47 42 271 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 16180 2023 02 15T23 47 42 383 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16208 2023 02 15T23 47 42 502 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 16209 2023 02 15T23 47 42 614 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16237 2023 02 15T23 47 42 733 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 16238 2023 02 15T23 47 42 844 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 16266 2023 02 15T23 47 42 964 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
0 171527 2023 02 15T23 47 43 901+0000 7f1ea2aa5700 20 osd 0 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
1 221782 2023 02 15T23 47 43 455+0000 7f6c6ae82700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 2)
1 222931 2023 02 15T23 47 43 881+0000 7f6c6ae82700 20 osd 1 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 2)
1 223163 2023 02 15T23 47 43 901+0000 7f6c6b683700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
2 151456 2023 02 15T23 47 43 454+0000 7fbf8c765700 15 osd 2 pg_epoch 50 pg[3 e( v 47'69 (0'0,47'69] local lis/les=41/42 n=69 ec=41/41 lis/c=41/41 les/c/f=42/42/0 sis=41) [2,4,1] r=0 lpr=41 crt=47'69 lcod 47'68 mlcod 47'68 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 151756 2023 02 15T23 47 43 882+0000 7fbf7773b700 20 osd 2 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 1)
2 151980 2023 02 15T23 47 43 901+0000 7fbf77f3c700 20 osd 2 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
4 202915 2023 02 15T23 47 43 455+0000 7fd969af6700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
4 203126 2023 02 15T23 47 43 882+0000 7fd969af6700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
T 16267 2023 02 15T23 47 43 076 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
T 16295 2023 02 15T23 47 43 194 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 16296 2023 02 15T23 47 43 306 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
0 171570 2023 02 15T23 47 44 471+0000 7f1ea3aa7700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 171802 2023 02 15T23 47 44 859+0000 7f1eb72ce700 15 osd 0 pg_epoch 50 pg[1 2( v 47'55 (0'0,47'55] local lis/les=32/34 n=55 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [0,4,1] r=0 lpr=32 crt=47'55 lcod 47'54 mlcod 47'54 active+clean] scrubber<NotActive> reserve_local local resources reserved
0 172026 2023 02 15T23 47 44 866+0000 7f1ea3aa7700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
1 223494 2023 02 15T23 47 44 859+0000 7f6c6be84700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
1 224664 2023 02 15T23 47 44 865+0000 7f6c6c685700 20 osd 1 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 2)
2 152038 2023 02 15T23 47 44 471+0000 7fbf8c765700 15 osd 2 pg_epoch 50 pg[2 1( v 47'67 (0'0,47'67] local lis/les=37/39 n=67 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [2,5,0] r=0 lpr=37 crt=47'67 lcod 47'66 mlcod 47'66 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 152405 2023 02 15T23 47 44 866+0000 7fbf78f3e700 20 osd 2 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 2)
4 203178 2023 02 15T23 47 44 859+0000 7fd96aaf8700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
5 162872 2023 02 15T23 47 44 471+0000 7ff326c31700 20 osd 5 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
1 225136 2023 02 15T23 47 45 464+0000 7f6c6ae82700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
1 225200 2023 02 15T23 47 45 886+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[1 e( v 47'69 (0'0,47'69] local lis/les=32/33 n=69 ec=32/32 lis/c=32/32 les/c/f=33/34/0 sis=32) [1,4,2] r=0 lpr=32 crt=47'69 lcod 47'68 mlcod 47'68 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 153945 2023 02 15T23 47 45 463+0000 7fbf7773b700 20 osd 2 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 0)
2 153978 2023 02 15T23 47 45 583+0000 7fbf7773b700 20 osd 2 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
2 154026 2023 02 15T23 47 45 886+0000 7fbf7773b700 20 osd 2 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
4 203608 2023 02 15T23 47 45 464+0000 7fd969af6700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
4 203653 2023 02 15T23 47 45 583+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[3 9( v 47'61 (0'0,47'61] local lis/les=41/43 n=61 ec=41/41 lis/c=41/41 les/c/f=43/44/0 sis=41) [4,2,5] r=0 lpr=41 crt=47'61 lcod 47'60 mlcod 47'60 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 203840 2023 02 15T23 47 45 886+0000 7fd969af6700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
5 162942 2023 02 15T23 47 45 583+0000 7ff32542e700 20 osd 5 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 172516 2023 02 15T23 47 46 480+0000 7f1ea3aa7700 20 osd 0 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
0 172541 2023 02 15T23 47 46 590+0000 7f1ea32a6700 20 osd 0 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
0 173695 2023 02 15T23 47 46 866+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
0 173744 2023 02 15T23 47 46 896+0000 7f1eb72ce700 15 osd 0 pg_epoch 50 pg[3 f( v 47'62 (0'0,47'62] local lis/les=41/43 n=62 ec=41/41 lis/c=41/41 les/c/f=43/43/0 sis=41) [0,1,4] r=0 lpr=41 crt=47'62 lcod 47'61 mlcod 47'61 active+clean] scrubber<NotActive> reserve_local local resources reserved
1 225532 2023 02 15T23 47 46 866+0000 7f6c6be84700 20 osd 1 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
1 225560 2023 02 15T23 47 46 896+0000 7f6c6ce86700 20 osd 1 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
2 155409 2023 02 15T23 47 46 480+0000 7fbf78f3e700 20 osd 2 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 2)
3 202248 2023 02 15T23 47 46 590+0000 7fc7f98bd700 20 osd 3 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
4 203978 2023 02 15T23 47 46 589+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[3 7( v 47'53 (0'0,47'53] local lis/les=41/43 n=53 ec=41/41 lis/c=41/41 les/c/f=43/43/0 sis=41) [4,3,0] r=0 lpr=41 crt=47'53 lcod 47'52 mlcod 47'52 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 204276 2023 02 15T23 47 46 866+0000 7fd96aaf8700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 2)
4 204301 2023 02 15T23 47 46 896+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 2)
5 163325 2023 02 15T23 47 46 480+0000 7ff326c31700 20 osd 5 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
1 227203 2023 02 15T23 47 47 899+0000 7f6c6ae82700 20 osd 1 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
2 155885 2023 02 15T23 47 47 590+0000 7fbf7773b700 20 osd 2 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
2 156118 2023 02 15T23 47 47 899+0000 7fbf7773b700 20 osd 2 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
4 205664 2023 02 15T23 47 47 590+0000 7fd969af6700 20 osd 4 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 2)
4 205898 2023 02 15T23 47 47 899+0000 7fd969af6700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
5 163790 2023 02 15T23 47 47 590+0000 7ff32542e700 20 osd 5 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
T 16334 2023 02 15T23 47 47 444 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 16335 2023 02 15T23 47 47 557 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16363 2023 02 15T23 47 47 676 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 16364 2023 02 15T23 47 47 788 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16392 2023 02 15T23 47 47 905 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
0 174136 2023 02 15T23 47 48 540+0000 7f1ea32a6700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
0 174336 2023 02 15T23 47 48 597+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
0 175660 2023 02 15T23 47 48 902+0000 7f1ea42a8700 20 osd 0 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
1 227248 2023 02 15T23 47 48 261+0000 7f6c6b683700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 227484 2023 02 15T23 47 48 903+0000 7f6c6ce86700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
2 156185 2023 02 15T23 47 48 540+0000 7fbf8c765700 15 osd 2 pg_epoch 50 pg[2 c( v 47'60 (0'0,47'60] local lis/les=37/39 n=60 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [2,0,5] r=0 lpr=37 crt=47'60 lcod 47'59 mlcod 47'59 active+clean] scrubber<NotActive> reserve_local local resources reserved
3 202348 2023 02 15T23 47 48 261+0000 7fc7f90bc700 20 osd 3 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
3 202634 2023 02 15T23 47 48 597+0000 7fc7f98bd700 20 osd 3 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
4 207059 2023 02 15T23 47 48 596+0000 7fd96aaf8700 20 osd 4 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
4 207298 2023 02 15T23 47 48 903+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
5 163901 2023 02 15T23 47 48 261+0000 7ff33a458700 15 osd 5 pg_epoch 50 pg[2 d( v 47'67 (0'0,47'67] local lis/les=37/39 n=67 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [5,1,3] r=0 lpr=37 crt=47'67 lcod 47'66 mlcod 47'66 active+clean] scrubber<NotActive> reserve_local local resources reserved
5 164011 2023 02 15T23 47 48 540+0000 7ff326430700 20 osd 5 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
T 16393 2023 02 15T23 47 48 018 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 16421 2023 02 15T23 47 48 136 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 16422 2023 02 15T23 47 48 247 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
T 16450 2023 02 15T23 47 48 366 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 16451 2023 02 15T23 47 48 478 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16479 2023 02 15T23 47 48 597 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 16480 2023 02 15T23 47 48 708 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
0 175797 2023 02 15T23 47 49 938+0000 7f1ea42a8700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 227759 2023 02 15T23 47 49 938+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[2 a( v 47'61 (0'0,47'61] local lis/les=37/39 n=61 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [1,5,0] r=0 lpr=37 crt=47'61 lcod 47'60 mlcod 47'60 active+clean] scrubber<NotActive> reserve_local local resources reserved
5 164211 2023 02 15T23 47 49 938+0000 7ff327432700 20 osd 5 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
0 176181 2023 02 15T23 47 50 547+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
0 176245 2023 02 15T23 47 50 934+0000 7f1ea3aa7700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 228126 2023 02 15T23 47 50 270+0000 7f6c6b683700 20 osd 1 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
1 228239 2023 02 15T23 47 50 934+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[2 6( v 47'64 (0'0,47'64] local lis/les=37/39 n=64 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [1,0,4] r=0 lpr=37 crt=47'64 lcod 47'63 mlcod 47'63 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 157760 2023 02 15T23 47 50 547+0000 7fbf7873d700 20 osd 2 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
3 203146 2023 02 15T23 47 50 270+0000 7fc7f90bc700 20 osd 3 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
4 207823 2023 02 15T23 47 50 934+0000 7fd96b2f9700 20 osd 4 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
5 165574 2023 02 15T23 47 50 270+0000 7ff325c2f700 20 osd 5 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 2)
5 165821 2023 02 15T23 47 50 547+0000 7ff326430700 20 osd 5 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
0 176289 2023 02 15T23 47 51 565+0000 7f1ea42a8700 20 osd 0 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
0 176514 2023 02 15T23 47 51 947+0000 7f1ea42a8700 20 osd 0 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
0 176538 2023 02 15T23 47 51 947+0000 7f1ea32a6700 20 osd 0 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
1 229629 2023 02 15T23 47 51 946+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[1 7( v 47'53 (0'0,47'53] local lis/les=32/33 n=53 ec=32/32 lis/c=32/32 les/c/f=33/34/0 sis=32) [1,3,0] r=0 lpr=32 crt=47'53 lcod 47'52 mlcod 47'52 active+clean] scrubber<NotActive> reserve_local local resources reserved
1 229687 2023 02 15T23 47 51 946+0000 7f6c6ce86700 20 osd 1 scrub queue dec_scrubs_local 3 > 2 (max 4, remote 0)
3 203368 2023 02 15T23 47 51 565+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[2 5( v 47'73 (0'0,47'73] local lis/les=37/40 n=73 ec=37/37 lis/c=37/37 les/c/f=40/41/0 sis=37) [3,4,0] r=0 lpr=37 crt=47'73 lcod 47'72 mlcod 47'72 active+clean] scrubber<NotActive> reserve_local local resources reserved
3 203541 2023 02 15T23 47 51 947+0000 7fc7f98bd700 20 osd 3 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
4 207920 2023 02 15T23 47 51 565+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
5 166229 2023 02 15T23 47 51 947+0000 7ff327432700 20 osd 5 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
0 176828 2023 02 15T23 47 52 947+0000 7f1ea3aa7700 20 osd 0 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
0 176857 2023 02 15T23 47 52 957+0000 7f1ea22a4700 20 osd 0 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
1 231384 2023 02 15T23 47 52 947+0000 7f6c6c685700 20 osd 1 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 0)
1 231443 2023 02 15T23 47 52 957+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[2 4( v 47'51 (0'0,47'51] local lis/les=37/39 n=51 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [1,0,2] r=0 lpr=37 crt=47'51 lcod 47'50 mlcod 47'50 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 157894 2023 02 15T23 47 52 605+0000 7fbf78f3e700 20 osd 2 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
2 157999 2023 02 15T23 47 52 957+0000 7fbf7773b700 20 osd 2 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
3 203589 2023 02 15T23 47 52 605+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[1 6( v 47'64 (0'0,47'64] local lis/les=32/34 n=64 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [3,4,2] r=0 lpr=32 crt=47'64 lcod 47'63 mlcod 47'63 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 207964 2023 02 15T23 47 52 605+0000 7fd96b2f9700 20 osd 4 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
4 208240 2023 02 15T23 47 52 947+0000 7fd96b2f9700 20 osd 4 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
T 16518 2023 02 15T23 47 52 847 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 16519 2023 02 15T23 47 52 961 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
0 177188 2023 02 15T23 47 53 573+0000 7f1ea42a8700 20 osd 0 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
0 177428 2023 02 15T23 47 53 954+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
1 232746 2023 02 15T23 47 53 953+0000 7f6c6be84700 20 osd 1 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 0)
3 205353 2023 02 15T23 47 53 573+0000 7fc7fa8bf700 20 osd 3 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
3 205572 2023 02 15T23 47 53 954+0000 7fc7f98bd700 20 osd 3 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
4 208640 2023 02 15T23 47 53 573+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
T 16547 2023 02 15T23 47 53 079 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 16548 2023 02 15T23 47 53 191 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16576 2023 02 15T23 47 53 309 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 16577 2023 02 15T23 47 53 420 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16605 2023 02 15T23 47 53 539 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 16606 2023 02 15T23 47 53 652 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16634 2023 02 15T23 47 53 770 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 16635 2023 02 15T23 47 53 882 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
0 177544 2023 02 15T23 47 54 578+0000 7f1ea32a6700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 177748 2023 02 15T23 47 54 965+0000 7f1ea22a4700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
1 232796 2023 02 15T23 47 54 237+0000 7f6c6be84700 20 osd 1 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
1 233981 2023 02 15T23 47 54 965+0000 7f6c6ae82700 20 osd 1 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
2 158231 2023 02 15T23 47 54 551+0000 7fbf7973f700 20 osd 2 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
2 158253 2023 02 15T23 47 54 578+0000 7fbf7873d700 20 osd 2 scrub queue inc_scrubs_remote 3 > 4 (max 4, local 0)
2 158462 2023 02 15T23 47 54 618+0000 7fbf78f3e700 20 osd 2 scrub queue dec_scrubs_remote 4 > 3 (max 4, local 0)
2 158680 2023 02 15T23 47 54 965+0000 7fbf7773b700 20 osd 2 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
3 205626 2023 02 15T23 47 54 237+0000 7fc7f98bd700 20 osd 3 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
3 205706 2023 02 15T23 47 54 578+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[2 7( v 47'53 (0'0,47'53] local lis/les=37/40 n=53 ec=37/37 lis/c=37/37 les/c/f=40/41/0 sis=37) [3,0,2] r=0 lpr=37 crt=47'53 lcod 47'52 mlcod 47'52 active+clean] scrubber<NotActive> reserve_local local resources reserved
3 207092 2023 02 15T23 47 54 618+0000 7fc7fa0be700 20 osd 3 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
4 208875 2023 02 15T23 47 54 551+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[1 5( v 47'73 (0'0,47'73] local lis/les=32/34 n=73 ec=32/32 lis/c=32/32 les/c/f=34/35/0 sis=32) [4,2,5] r=0 lpr=32 crt=47'73 lcod 47'72 mlcod 47'72 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 209177 2023 02 15T23 47 54 618+0000 7fd96b2f9700 20 osd 4 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
5 166468 2023 02 15T23 47 54 237+0000 7ff33a458700 15 osd 5 pg_epoch 50 pg[3 c( v 47'60 (0'0,47'60] local lis/les=41/42 n=60 ec=41/41 lis/c=41/41 les/c/f=42/42/0 sis=41) [5,3,1] r=0 lpr=41 crt=47'60 lcod 47'59 mlcod 47'59 active+clean] scrubber<NotActive> reserve_local local resources reserved
5 166649 2023 02 15T23 47 54 551+0000 7ff327432700 20 osd 5 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
T 16663 2023 02 15T23 47 54 001 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 16664 2023 02 15T23 47 54 112 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
0 178075 2023 02 15T23 47 55 600+0000 7f1ea22a4700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 234282 2023 02 15T23 47 55 600+0000 7f6c6ae82700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 234324 2023 02 15T23 47 55 925+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[3 0( v 47'72 (0'0,47'72] local lis/les=41/42 n=72 ec=41/41 lis/c=41/41 les/c/f=42/42/0 sis=41) [1,2,4] r=0 lpr=41 crt=47'72 lcod 47'71 mlcod 47'71 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 158913 2023 02 15T23 47 55 925+0000 7fbf7973f700 20 osd 2 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
3 207264 2023 02 15T23 47 55 555+0000 7fc7fa0be700 20 osd 3 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
3 207302 2023 02 15T23 47 55 600+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[1 4( v 47'51 (0'0,47'51] local lis/les=32/34 n=51 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [3,0,1] r=0 lpr=32 crt=47'51 lcod 47'50 mlcod 47'50 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 209430 2023 02 15T23 47 55 554+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[3 1( v 47'67 (0'0,47'67] local lis/les=41/43 n=67 ec=41/41 lis/c=41/41 les/c/f=43/44/0 sis=41) [4,3,5] r=0 lpr=41 crt=47'67 lcod 47'66 mlcod 47'66 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 209540 2023 02 15T23 47 55 925+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 2)
5 166951 2023 02 15T23 47 55 555+0000 7ff326c31700 20 osd 5 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
0 178325 2023 02 15T23 47 56 584+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
0 178353 2023 02 15T23 47 56 587+0000 7f1ea32a6700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 234632 2023 02 15T23 47 56 245+0000 7f6c6be84700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
2 159174 2023 02 15T23 47 56 566+0000 7fbf7973f700 20 osd 2 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
2 159394 2023 02 15T23 47 56 584+0000 7fbf7873d700 20 osd 2 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
3 207620 2023 02 15T23 47 56 245+0000 7fc7f98bd700 20 osd 3 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 2)
3 208863 2023 02 15T23 47 56 584+0000 7fc7f98bd700 20 osd 3 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
3 208917 2023 02 15T23 47 56 587+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[3 2( v 47'55 (0'0,47'55] local lis/les=41/43 n=55 ec=41/41 lis/c=41/41 les/c/f=43/44/0 sis=41) [3,5,0] r=0 lpr=41 crt=47'55 lcod 47'54 mlcod 47'54 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 211077 2023 02 15T23 47 56 565+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
5 168209 2023 02 15T23 47 56 245+0000 7ff326430700 20 osd 5 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 2)
5 168516 2023 02 15T23 47 56 566+0000 7ff327432700 20 osd 5 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
5 168583 2023 02 15T23 47 56 587+0000 7ff326430700 20 osd 5 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 178439 2023 02 15T23 47 57 524+0000 7f1ea22a4700 20 osd 0 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
0 178621 2023 02 15T23 47 57 607+0000 7f1ea22a4700 20 osd 0 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
1 234819 2023 02 15T23 47 57 524+0000 7f6c6ae82700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
1 235023 2023 02 15T23 47 57 607+0000 7f6c6ae82700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
1 236480 2023 02 15T23 47 57 934+0000 7f6c6ce86700 20 osd 1 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
2 159741 2023 02 15T23 47 57 934+0000 7fbf7973f700 20 osd 2 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
3 209133 2023 02 15T23 47 57 216+0000 7fc7fa8bf700 20 osd 3 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 2)
3 209371 2023 02 15T23 47 57 568+0000 7fc7fa0be700 20 osd 3 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 2)
3 210455 2023 02 15T23 47 57 607+0000 7fc7f88bb700 20 osd 3 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
4 211138 2023 02 15T23 47 57 216+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
4 211232 2023 02 15T23 47 57 524+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[2 9( v 47'61 (0'0,47'61] local lis/les=37/39 n=61 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [4,1,0] r=0 lpr=37 crt=47'61 lcod 47'60 mlcod 47'60 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 212669 2023 02 15T23 47 57 568+0000 7fd96b2f9700 20 osd 4 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 2)
4 212928 2023 02 15T23 47 57 934+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
5 168623 2023 02 15T23 47 57 215+0000 7ff33a458700 15 osd 5 pg_epoch 50 pg[3 5( v 47'73 (0'0,47'73] local lis/les=41/42 n=73 ec=41/41 lis/c=41/41 les/c/f=42/42/0 sis=41) [5,3,4] r=0 lpr=41 crt=47'73 lcod 47'72 mlcod 47'72 active+clean] scrubber<NotActive> reserve_local local resources reserved
5 168981 2023 02 15T23 47 57 568+0000 7ff326c31700 20 osd 5 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
0 179029 2023 02 15T23 47 58 593+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
3 211792 2023 02 15T23 47 58 592+0000 7fc7f98bd700 20 osd 3 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
5 169290 2023 02 15T23 47 58 593+0000 7ff326430700 20 osd 5 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
T 16702 2023 02 15T23 47 58 250 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 16703 2023 02 15T23 47 58 362 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 16731 2023 02 15T23 47 58 482 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 16732 2023 02 15T23 47 58 593 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
T 16760 2023 02 15T23 47 58 715 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 16761 2023 02 15T23 47 58 825 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 16789 2023 02 15T23 47 58 943 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
0 179096 2023 02 15T23 47 59 521+0000 7f1ea2aa5700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 179301 2023 02 15T23 47 59 530+0000 7f1ea22a4700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
0 179392 2023 02 15T23 47 59 929+0000 7f1ea42a8700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 236906 2023 02 15T23 47 59 530+0000 7f6c6ae82700 20 osd 1 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
1 236975 2023 02 15T23 47 59 929+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[1 0( v 47'72 (0'0,47'72] local lis/les=32/33 n=72 ec=32/32 lis/c=32/32 les/c/f=33/34/0 sis=32) [1,0,2] r=0 lpr=32 crt=47'72 lcod 47'71 mlcod 47'71 active+clean] scrubber<NotActive> reserve_local local resources reserved
2 159937 2023 02 15T23 47 59 929+0000 7fbf7973f700 20 osd 2 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
3 212219 2023 02 15T23 47 59 223+0000 7fc7fa8bf700 20 osd 3 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
4 213522 2023 02 15T23 47 59 224+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
4 213577 2023 02 15T23 47 59 521+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[3 3( v 47'54 (0'0,47'54] local lis/les=41/43 n=54 ec=41/41 lis/c=41/41 les/c/f=43/44/0 sis=41) [4,0,5] r=0 lpr=41 crt=47'54 lcod 47'53 mlcod 47'53 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 214912 2023 02 15T23 47 59 530+0000 7fd969af6700 20 osd 4 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 0)
5 170838 2023 02 15T23 47 59 223+0000 7ff327432700 20 osd 5 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
5 170878 2023 02 15T23 47 59 521+0000 7ff325c2f700 20 osd 5 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
T 16790 2023 02 15T23 47 59 054 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
T 16818 2023 02 15T23 47 59 171 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 16819 2023 02 15T23 47 59 284 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
T 16847 2023 02 15T23 47 59 403 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 16848 2023 02 15T23 47 59 515 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
0 179480 2023 02 15T23 48 00 635+0000 7f1ea3aa7700 20 osd 0 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
1 237110 2023 02 15T23 48 00 592+0000 7f6c6b683700 20 osd 1 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
2 159988 2023 02 15T23 48 00 591+0000 7fbf8c765700 15 osd 2 pg_epoch 50 pg[1 d( v 47'67 (0'0,47'67] local lis/les=32/34 n=67 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [2,4,1] r=0 lpr=32 crt=47'67 lcod 47'66 mlcod 47'66 active+clean] scrubber<NotActive> reserve_local local resources reserved
3 212307 2023 02 15T23 48 00 634+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[3 b( v 47'65 (0'0,47'65] local lis/les=41/43 n=65 ec=41/41 lis/c=41/41 les/c/f=43/43/0 sis=41) [3,0,4] r=0 lpr=41 crt=47'65 lcod 47'64 mlcod 47'64 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 214990 2023 02 15T23 48 00 592+0000 7fd96a2f7700 20 osd 4 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
4 215007 2023 02 15T23 48 00 635+0000 7fd96b2f9700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
0 179921 2023 02 15T23 48 01 533+0000 7f1ea2aa5700 20 osd 0 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
0 180199 2023 02 15T23 48 01 937+0000 7f1ea42a8700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
1 238931 2023 02 15T23 48 01 937+0000 7f6c6ce86700 20 osd 1 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
2 160540 2023 02 15T23 48 01 937+0000 7fbf7973f700 20 osd 2 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
4 216407 2023 02 15T23 48 01 532+0000 7fd96a2f7700 20 osd 4 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 2)
5 171171 2023 02 15T23 48 01 533+0000 7ff325c2f700 20 osd 5 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
0 180437 2023 02 15T23 48 02 643+0000 7f1ea3aa7700 20 osd 0 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
1 238981 2023 02 15T23 48 02 241+0000 7f6c6b683700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 239010 2023 02 15T23 48 02 537+0000 7f6c6b683700 20 osd 1 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
1 239224 2023 02 15T23 48 02 600+0000 7f6c6b683700 20 osd 1 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
2 160583 2023 02 15T23 48 02 537+0000 7fbf77f3c700 20 osd 2 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 1)
2 161927 2023 02 15T23 48 02 600+0000 7fbf77f3c700 20 osd 2 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 1)
3 214070 2023 02 15T23 48 02 643+0000 7fc7fa0be700 20 osd 3 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
4 216545 2023 02 15T23 48 02 241+0000 7fd96a2f7700 20 osd 4 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
4 216602 2023 02 15T23 48 02 536+0000 7fd97eb20700 15 osd 4 pg_epoch 50 pg[1 3( v 47'54 (0'0,47'54] local lis/les=32/34 n=54 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [4,1,2] r=0 lpr=32 crt=47'54 lcod 47'53 mlcod 47'53 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 216910 2023 02 15T23 48 02 600+0000 7fd96a2f7700 20 osd 4 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 1)
4 217134 2023 02 15T23 48 02 643+0000 7fd96b2f9700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
5 171361 2023 02 15T23 48 02 241+0000 7ff33a458700 15 osd 5 pg_epoch 50 pg[2 3( v 47'54 (0'0,47'54] local lis/les=37/39 n=54 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [5,4,1] r=0 lpr=37 crt=47'54 lcod 47'53 mlcod 47'53 active+clean] scrubber<NotActive> reserve_local local resources reserved
T 16886 2023 02 15T23 48 03 652 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 16887 2023 02 15T23 48 03 765 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 16915 2023 02 15T23 48 03 882 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 16916 2023 02 15T23 48 03 993 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
0 180767 2023 02 15T23 48 04 291+0000 7f1ea32a6700 20 osd 0 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
1 239700 2023 02 15T23 48 04 247+0000 7f6c6b683700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
1 239796 2023 02 15T23 48 04 291+0000 7f6c6be84700 20 osd 1 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 239985 2023 02 15T23 48 04 542+0000 7f6c6b683700 20 osd 1 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
2 162427 2023 02 15T23 48 04 542+0000 7fbf77f3c700 20 osd 2 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
4 217482 2023 02 15T23 48 04 247+0000 7fd96a2f7700 20 osd 4 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
4 218664 2023 02 15T23 48 04 542+0000 7fd96a2f7700 20 osd 4 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
5 172893 2023 02 15T23 48 04 247+0000 7ff325c2f700 20 osd 5 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
5 172954 2023 02 15T23 48 04 291+0000 7ff33a458700 15 osd 5 pg_epoch 50 pg[2 2( v 47'55 (0'0,47'55] local lis/les=37/39 n=55 ec=37/37 lis/c=37/37 les/c/f=39/39/0 sis=37) [5,1,0] r=0 lpr=37 crt=47'55 lcod 47'54 mlcod 47'54 active+clean] scrubber<NotActive> reserve_local local resources reserved
T 16944 2023 02 15T23 48 04 111 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 16945 2023 02 15T23 48 04 221 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
T 16973 2023 02 15T23 48 04 340 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 16974 2023 02 15T23 48 04 451 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17002 2023 02 15T23 48 04 571 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 17003 2023 02 15T23 48 04 682 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17031 2023 02 15T23 48 04 801 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 17032 2023 02 15T23 48 04 912 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
2 162678 2023 02 15T23 48 05 740+0000 7fbf78f3e700 20 osd 2 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
3 214459 2023 02 15T23 48 05 247+0000 7fc7f90bc700 20 osd 3 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
3 214539 2023 02 15T23 48 05 740+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[2 b( v 47'65 (0'0,47'65] local lis/les=37/40 n=65 ec=37/37 lis/c=37/37 les/c/f=40/41/0 sis=37) [3,2,5] r=0 lpr=37 crt=47'65 lcod 47'64 mlcod 47'64 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 218752 2023 02 15T23 48 05 247+0000 7fd96a2f7700 20 osd 4 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
5 173158 2023 02 15T23 48 05 247+0000 7ff33a458700 15 osd 5 pg_epoch 50 pg[1 8( v 47'66 (0'0,47'66] local lis/les=32/35 n=66 ec=32/32 lis/c=32/32 les/c/f=35/36/0 sis=32) [5,4,3] r=0 lpr=32 crt=47'66 lcod 47'65 mlcod 47'65 active+clean] scrubber<NotActive> reserve_local local resources reserved
5 173375 2023 02 15T23 48 05 740+0000 7ff326c31700 20 osd 5 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 2)
0 181076 2023 02 15T23 48 06 259+0000 7f1ea3aa7700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
0 181268 2023 02 15T23 48 06 298+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
0 181336 2023 02 15T23 48 06 739+0000 7f1ea42a8700 20 osd 0 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
1 240511 2023 02 15T23 48 06 298+0000 7f6c6be84700 20 osd 1 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
3 214954 2023 02 15T23 48 06 739+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[1 f( v 47'62 (0'0,47'62] local lis/les=32/34 n=62 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [3,0,4] r=0 lpr=32 crt=47'62 lcod 47'61 mlcod 47'61 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 219058 2023 02 15T23 48 06 259+0000 7fd96b2f9700 20 osd 4 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 0)
4 219262 2023 02 15T23 48 06 739+0000 7fd96bafa700 20 osd 4 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
5 173448 2023 02 15T23 48 06 259+0000 7ff33a458700 15 osd 5 pg_epoch 50 pg[1 1( v 47'67 (0'0,47'67] local lis/les=32/35 n=67 ec=32/32 lis/c=32/32 les/c/f=35/36/0 sis=32) [5,0,4] r=0 lpr=32 crt=47'67 lcod 47'66 mlcod 47'66 active+clean] scrubber<NotActive> reserve_local local resources reserved
5 174685 2023 02 15T23 48 06 298+0000 7ff326430700 20 osd 5 scrub queue dec_scrubs_local 3 > 2 (max 4, remote 1)
1 240630 2023 02 15T23 48 07 698+0000 7f6c6ce86700 20 osd 1 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
2 163018 2023 02 15T23 48 07 748+0000 7fbf78f3e700 20 osd 2 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
3 215295 2023 02 15T23 48 07 255+0000 7fc7f90bc700 20 osd 3 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 2)
3 215358 2023 02 15T23 48 07 697+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[2 0( v 47'72 (0'0,47'72] local lis/les=37/40 n=72 ec=37/37 lis/c=37/37 les/c/f=40/41/0 sis=37) [3,5,1] r=0 lpr=37 crt=47'72 lcod 47'71 mlcod 47'71 active+clean] scrubber<NotActive> reserve_local local resources reserved
3 216761 2023 02 15T23 48 07 748+0000 7fc7fa0be700 20 osd 3 scrub queue dec_scrubs_local 3 > 2 (max 4, remote 0)
4 219503 2023 02 15T23 48 07 255+0000 7fd96a2f7700 20 osd 4 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
5 176207 2023 02 15T23 48 07 255+0000 7ff325c2f700 20 osd 5 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 1)
5 176251 2023 02 15T23 48 07 698+0000 7ff327432700 20 osd 5 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
5 176464 2023 02 15T23 48 07 748+0000 7ff326c31700 20 osd 5 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 1)
0 181654 2023 02 15T23 48 08 267+0000 7f1ea3aa7700 20 osd 0 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
0 181931 2023 02 15T23 48 08 747+0000 7f1ea42a8700 20 osd 0 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
1 240674 2023 02 15T23 48 08 087+0000 7f6c7feac700 15 osd 1 pg_epoch 50 pg[1 9( v 47'61 (0'0,47'61] local lis/les=32/33 n=61 ec=32/32 lis/c=32/32 les/c/f=33/34/0 sis=32) [1,4,5] r=0 lpr=32 crt=47'61 lcod 47'60 mlcod 47'60 active+clean] scrubber<NotActive> reserve_local local resources reserved
3 218087 2023 02 15T23 48 08 746+0000 7fc7fa8bf700 20 osd 3 scrub queue dec_scrubs_local 2 > 1 (max 4, remote 0)
4 219567 2023 02 15T23 48 08 087+0000 7fd969af6700 20 osd 4 scrub queue inc_scrubs_remote 2 > 3 (max 4, local 0)
4 219846 2023 02 15T23 48 08 267+0000 7fd96b2f9700 20 osd 4 scrub queue dec_scrubs_remote 3 > 2 (max 4, local 0)
4 220080 2023 02 15T23 48 08 747+0000 7fd96bafa700 20 osd 4 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
5 176497 2023 02 15T23 48 08 087+0000 7ff32542e700 20 osd 5 scrub queue inc_scrubs_remote 1 > 2 (max 4, local 1)
5 177853 2023 02 15T23 48 08 267+0000 7ff326c31700 20 osd 5 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 2)
1 241462 2023 02 15T23 48 09 710+0000 7f6c6ce86700 20 osd 1 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 1)
3 219813 2023 02 15T23 48 09 710+0000 7fc7fa8bf700 20 osd 3 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
5 178218 2023 02 15T23 48 09 710+0000 7ff327432700 20 osd 5 scrub queue dec_scrubs_remote 2 > 1 (max 4, local 0)
T 17070 2023 02 15T23 48 09 050 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 17071 2023 02 15T23 48 09 163 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17099 2023 02 15T23 48 09 281 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 17100 2023 02 15T23 48 09 392 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=2
T 17128 2023 02 15T23 48 09 511 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 17129 2023 02 15T23 48 09 622 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17157 2023 02 15T23 48 09 742 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 17158 2023 02 15T23 48 09 854 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17186 2023 02 15T23 48 09 971 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
1 242730 2023 02 15T23 48 10 093+0000 7f6c6ae82700 20 osd 1 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
4 220619 2023 02 15T23 48 10 093+0000 7fd969af6700 20 osd 4 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
5 178545 2023 02 15T23 48 10 093+0000 7ff32542e700 20 osd 5 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
T 17187 2023 02 15T23 48 10 084 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=1
T 17215 2023 02 15T23 48 10 202 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 17216 2023 02 15T23 48 10 314 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
0 182470 2023 02 15T23 48 11 714+0000 7f1ea32a6700 20 osd 0 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
3 220148 2023 02 15T23 48 11 714+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[1 c( v 47'60 (0'0,47'60] local lis/les=32/34 n=60 ec=32/32 lis/c=32/32 les/c/f=34/34/0 sis=32) [3,0,4] r=0 lpr=32 crt=47'60 lcod 47'59 mlcod 47'59 active+clean] scrubber<NotActive> reserve_local local resources reserved
4 220878 2023 02 15T23 48 11 714+0000 7fd96aaf8700 20 osd 4 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
0 182824 2023 02 15T23 48 13 722+0000 7f1ea32a6700 20 osd 0 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
3 221732 2023 02 15T23 48 13 721+0000 7fc7f98bd700 20 osd 3 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
4 221282 2023 02 15T23 48 13 722+0000 7fd96aaf8700 20 osd 4 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
T 17254 2023 02 15T23 48 14 451 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 17255 2023 02 15T23 48 14 564 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17283 2023 02 15T23 48 14 682 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 17284 2023 02 15T23 48 14 793 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17312 2023 02 15T23 48 14 911 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
1 243639 2023 02 15T23 48 15 829+0000 7f6c6ce86700 20 osd 1 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
3 222141 2023 02 15T23 48 15 829+0000 7fc80d8e5700 15 osd 3 pg_epoch 50 pg[3 a( v 47'61 (0'0,47'61] local lis/les=41/43 n=61 ec=41/41 lis/c=41/41 les/c/f=43/44/0 sis=41) [3,1,5] r=0 lpr=41 crt=47'61 lcod 47'60 mlcod 47'60 active+clean] scrubber<NotActive> reserve_local local resources reserved
5 179438 2023 02 15T23 48 15 829+0000 7ff327432700 20 osd 5 scrub queue inc_scrubs_remote 0 > 1 (max 4, local 0)
T 17313 2023 02 15T23 48 15 021 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17341 2023 02 15T23 48 15 139 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 17342 2023 02 15T23 48 15 250 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17370 2023 02 15T23 48 15 369 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 17371 2023 02 15T23 48 15 480 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17399 2023 02 15T23 48 15 597 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 17400 2023 02 15T23 48 15 709 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
1 244333 2023 02 15T23 48 17 837+0000 7f6c6ce86700 20 osd 1 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
3 223746 2023 02 15T23 48 17 837+0000 7fc7fa8bf700 20 osd 3 scrub queue dec_scrubs_local 1 > 0 (max 4, remote 0)
5 179793 2023 02 15T23 48 17 837+0000 7ff327432700 20 osd 5 scrub queue dec_scrubs_remote 1 > 0 (max 4, local 0)
T 17440 2023 02 15T23 48 19 847 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 17441 2023 02 15T23 48 19 960 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17469 2023 02 15T23 48 20 077 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 17470 2023 02 15T23 48 20 188 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17498 2023 02 15T23 48 20 305 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 17499 2023 02 15T23 48 20 417 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17527 2023 02 15T23 48 20 534 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 17528 2023 02 15T23 48 20 646 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17556 2023 02 15T23 48 20 764 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 17557 2023 02 15T23 48 20 877 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17585 2023 02 15T23 48 20 994 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 17586 2023 02 15T23 48 21 106 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17626 2023 02 15T23 48 25 244 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 17627 2023 02 15T23 48 25 356 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17655 2023 02 15T23 48 25 474 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 17656 2023 02 15T23 48 25 586 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17684 2023 02 15T23 48 25 704 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 17685 2023 02 15T23 48 25 815 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17713 2023 02 15T23 48 25 932 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 17714 2023 02 15T23 48 26 044 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17742 2023 02 15T23 48 26 162 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 17743 2023 02 15T23 48 26 274 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17771 2023 02 15T23 48 26 391 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 17772 2023 02 15T23 48 26 503 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17812 2023 02 15T23 48 30 644 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 0 asok dump_scrub_reservations
T 17813 2023 02 15T23 48 30 756 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17841 2023 02 15T23 48 30 874 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 1 asok dump_scrub_reservations
T 17842 2023 02 15T23 48 30 985 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17870 2023 02 15T23 48 31 102 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 2 asok dump_scrub_reservations
T 17871 2023 02 15T23 48 31 214 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17899 2023 02 15T23 48 31 332 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 3 asok dump_scrub_reservations
T 17900 2023 02 15T23 48 31 442 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17928 2023 02 15T23 48 31 561 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 4 asok dump_scrub_reservations
T 17929 2023 02 15T23 48 31 673 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
T 17957 2023 02 15T23 48 31 790 INFO tasks workunit client 0 smithi016 stderr //home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected ceph daemon /tmp/ceph asok 133010/ceph osd 5 asok dump_scrub_reservations
T 17958 2023 02 15T23 48 31 901 INFO tasks workunit client 0 smithi016 stderr /home/ubuntu/cephtest/clone client 0/qa/standalone/scrub/osd scrub dump sh 127 TEST_recover_unexpected scrubs=0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment