mlperf_405b_f4_Prefillbs_1_Decodebs_2_dbc2816.log

INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:28.623037
INFO:root:####################################################################################################################################################################################
Running python3 harness_alt_mi355.py --devices 0,1,2,3,4,5,6,7 --scenario Offline --test_mode PerformanceOnly --prefill_bs 1 --decode_bs 2 --user_conf_path user.conf --tensor_path /data/mlperf_llama3.1_405b_dataset_8313_processed_fp16_eval.pkl --logfile_outdir OutputOfflinePerformanceOnly --debug False --verbose False --user_conf_path user.conf --shortfin_config shortfin_405b_config_fp4.json
##############################################################################################################################################################################################
INFO:Llama-405B-Dataset:Loading dataset...
INFO:Llama-405B-Dataset:Finished loading dataset.
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.679279
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.682372
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.684684
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.684858
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.684857
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.691033
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.699477
INFO:shortfin_apps.llm.components.service_debug_dumper:[debug_service.py] Please find debug dumps for service.py in /root/.shortfin/debug/llm_service_invocation_dumps/2025-09-10T08:11:30.705756
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [1]
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [1]
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [0]
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [0]
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [1]
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [0]
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [0]
INFO:root:NUMA hardware info: {'numa_node_distance': [[10, 32], [32, 10]], 'node_cpu_info': {0: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191], 1: [64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}}
INFO:root:GPU: 0
INFO:root:Nearest nodes = [1]
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:shortfin_apps.llm.components.manager:Created local system with ['amdgpu:0:0@0'] devices
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:root:Allocating page table (shape=[2816, 8257536], dtype=float8_e4m3fn, size=21.7GiB) on DeviceAffinity(amdgpu:0:0@0[0x1])
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:root:Loading parameter fiber 'model' from: /shark-dev/weights/fp4/fp4_2025_07_10_fn.irpa
INFO:shortfin_apps.llm.components.manager:Starting system manager
INFO:root:Start Test!
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 408995.998471601
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 408996.405624061
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409009.035267901
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 409044.722284242
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409084.812029401
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 409085.131872318
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 409095.566678902
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 409101.213875426
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409103.363189204
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409116.976168992
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409133.455462048
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409137.486555361
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409186.928631145
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409196.52471667
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409227.692870192
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409246.84206741
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409249.038976575
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409251.166747362
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409267.14907993
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409269.637757618
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409277.65601887
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409298.416807428
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 409302.724340091
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409322.462079136
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409360.112132003
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409396.831534813
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409401.780699929
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409416.010163926
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-1 Sending response
INFO:micro_llama_process_samples:SampleResponder-1 end time: 409422.85074288
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 409453.432808334
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 409496.243760155
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 409505.69637735
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409517.027076502
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409517.510746183
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 409520.001671634
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 409543.029617027
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 409569.235368034
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409575.095142264
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409581.457745845
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-3 Sending response
INFO:micro_llama_process_samples:SampleResponder-3 end time: 409591.068197003
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409595.951632495
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 409597.826602511
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 409618.198312071
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 409631.431774419
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 409645.157662137
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 409666.573616672
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-2 Sending response
INFO:micro_llama_process_samples:SampleResponder-2 end time: 409692.935098606
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 409704.635671751
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409712.076869685
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 409727.793663848
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409828.433158058
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 409833.385904324
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 409853.870379966
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 409875.972169008
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 409877.684083429
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 409885.044057629
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 409903.014289185
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 409905.606069952
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-4 Sending response
INFO:micro_llama_process_samples:SampleResponder-4 end time: 409924.315256627
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-5 Sending response
INFO:micro_llama_process_samples:SampleResponder-5 end time: 409937.925677013
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 409953.20466967
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 409954.071889779
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 409957.697359331
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 409963.968167112
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 409966.491951787
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 409968.213832637
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 409972.532781469
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 409983.715418906
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 409998.874636294
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 410007.067313381
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 410017.120132875
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 410098.131815907
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 410111.302776343
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 410118.541497064
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 410125.780253711
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 410145.826342283
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 410166.3488856
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-6 Sending response
INFO:micro_llama_process_samples:SampleResponder-6 end time: 410171.418323065
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 410197.756424156
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 410245.631294555
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 410251.517800967
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-7 Sending response
INFO:micro_llama_process_samples:SampleResponder-7 end time: 410258.329923954
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 410261.792053901
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 410276.318599118
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 410283.45332543
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 410308.58978114
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 410318.253274032
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 410348.996511947
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 410370.370326204
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 410381.106594452
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 410398.269306798
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 410417.36466438
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-9 Sending response
INFO:micro_llama_process_samples:SampleResponder-9 end time: 410431.8444835
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 410432.736588518
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 410437.795545613
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 410446.109114456
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 410485.820068487
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 410520.266861847
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 410521.323456105
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 410524.849157757
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 410597.569025625
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 410622.540397661
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 410625.760501848
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 410631.865603153
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 410635.172766608
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 410639.965537026
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 410649.296477428
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 410654.334837444
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-10 Sending response
INFO:micro_llama_process_samples:SampleResponder-10 end time: 410658.311645527
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 410663.868538579
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 410668.713714758
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 410701.419504565
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 410753.232249247
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 410773.409195222
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 410800.988719842
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 410853.188193476
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 410853.516807181
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 410856.975527441
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 410878.16412139
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 410886.536836269
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 410889.115743917
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 410894.588085431
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 410897.322849315
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 410912.875950422
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 410921.534316329
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 410926.83987409
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 410976.920941031
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 410984.780411333
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 410986.591153889
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-11 Sending response
INFO:micro_llama_process_samples:SampleResponder-11 end time: 411003.607427302
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-8 Sending response
INFO:micro_llama_process_samples:SampleResponder-8 end time: 411006.342053787
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 411030.561196784
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 411033.613277232
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 411054.578832944
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 411084.814714828
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 411092.206776641
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 411153.182391503
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 411171.383034738
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 411189.874600077
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 411217.510805936
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 411226.896781151
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 411236.564627508
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 411244.484521952
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 411255.534082541
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 411259.523633217
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 411270.177660447
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 411272.278313162
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-14 Sending response
INFO:micro_llama_process_samples:SampleResponder-14 end time: 411291.047663677
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 411304.642360201
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 411328.841301342
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 411331.470623745
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 411333.893099127
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 411334.590095376
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 411334.976974705
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 411337.557841555
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 411354.704685658
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 411368.22501608
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 411450.624110581
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 411452.421166213
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 411514.582366523
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-15 Sending response
INFO:micro_llama_process_samples:SampleResponder-15 end time: 411527.231521741
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-12 Sending response
INFO:micro_llama_process_samples:SampleResponder-12 end time: 411529.694910172
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 411574.945894371
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
INFO:micro_llama_process_samples:SampleResponder-29 end time: 411590.572196642
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 411594.959473519
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 end time: 411596.388634936
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 411626.992114832
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 411631.975889754
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 411632.028147233
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 411632.881630651
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 411636.214151859
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 411647.964462154
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 411659.796357791
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 end time: 411707.220939594
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-13 Sending response
INFO:micro_llama_process_samples:SampleResponder-13 end time: 411713.088897665
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 411726.900993426
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 411732.897581834
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 411777.190607466
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 411782.544782739
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 end time: 411782.997574258
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 411783.578256559
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 411789.839748499
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 411797.794966857
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 411837.856127144
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 411873.546133479
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 411874.072162082
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 411949.632184989
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-17 Sending response
INFO:micro_llama_process_samples:SampleResponder-17 end time: 411958.705593075
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 end time: 411958.902365171
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 411972.039936822
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 411973.402236636
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 411976.733290956
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-16 Sending response
INFO:micro_llama_process_samples:SampleResponder-16 end time: 411978.695537325
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 411991.211977507
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 412009.825066572
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 412075.315581453
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 412094.105595161
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 412097.586798256
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 412105.812134599
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 412109.719186786
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 412144.270346387
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 412146.801804482
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 412163.500358522
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 412165.709446427
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-18 Sending response
INFO:micro_llama_process_samples:SampleResponder-18 end time: 412167.46959704
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-19 Sending response
INFO:micro_llama_process_samples:SampleResponder-19 end time: 412173.534552361
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 412183.57451526
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 412246.200615079
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 412266.608243964
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 412282.723524556
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
INFO:micro_llama_process_samples:SampleResponder-29 end time: 412283.467474946
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 412289.570606198
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 412293.273579582
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 412294.020514159
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 412302.746306781
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 412367.926851695
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 412391.666492714
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 412397.761449875
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 412424.656070435
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 412434.950602877
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-20 Sending response
INFO:micro_llama_process_samples:SampleResponder-20 end time: 412439.453320653
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 412446.681976
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
INFO:micro_llama_process_samples:SampleResponder-29 end time: 412449.367554203
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-22 Sending response
INFO:micro_llama_process_samples:SampleResponder-22 end time: 412478.789506878
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 412485.91304777
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-21 Sending response
INFO:micro_llama_process_samples:SampleResponder-21 end time: 412511.769066586
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 412534.162150844
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 412557.604143966
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-23 Sending response
INFO:micro_llama_process_samples:SampleResponder-23 end time: 412564.518042721
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 end time: 412568.290102289
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 end time: 412626.696948712
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 412629.338769601
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 412660.375291757
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 412662.44906096
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 412666.172924321
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
INFO:micro_llama_process_samples:SampleResponder-29 end time: 412723.076000119
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 412728.583150609
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 end time: 412740.898618655
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 end time: 412741.074562225
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 412742.732168474
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
INFO:micro_llama_process_samples:SampleResponder-29 end time: 412745.120277059
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 412749.293658632
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 412767.838781264
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 412818.124441642
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 412831.381433346
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 412836.28806157
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 412842.764308476
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-27 Sending response
INFO:micro_llama_process_samples:SampleResponder-27 end time: 412843.366810034
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 412885.895301781
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 412907.057670795
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-24 Sending response
INFO:micro_llama_process_samples:SampleResponder-24 end time: 412916.355815392
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 412918.426232306
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 412954.049848373
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 412960.883959408
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 412984.729438977
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 413004.103723685
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 413007.125779567
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 413008.702422276
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 413018.863111885
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
INFO:micro_llama_process_samples:SampleResponder-29 end time: 413030.271573448
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-26 Sending response
INFO:micro_llama_process_samples:SampleResponder-26 end time: 413030.787682229
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 413051.982398243
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 413053.506322637
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 413105.448172098
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 413130.214417312
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 413191.141584745
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-25 Sending response
INFO:micro_llama_process_samples:SampleResponder-25 end time: 413208.038700576
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 413226.525702089
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 413229.853746683
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 413235.477281919
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 413241.744422765
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 413242.822496644
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 413242.855176724
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 413246.041061461
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 413311.328686665
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 413311.706838085
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 413312.619104974
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 413345.077252048
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 413359.060396689
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 413359.557212786
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 413375.00142379
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 413397.34851297
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 413427.705846346
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 413428.658187791
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 413516.122828988
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 413529.380493014
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-31 Sending response
INFO:micro_llama_process_samples:SampleResponder-31 end time: 413573.981765603
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 413587.106531817
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 413597.32434582
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 413597.523459108
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 413607.027485508
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 413614.826243553
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 413624.682452629
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 413634.867327612
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 413651.515472613
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 413654.3379246
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 413672.446554616
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-30 Sending response
INFO:micro_llama_process_samples:SampleResponder-30 end time: 413678.186640704
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-28 Sending response
INFO:micro_llama_process_samples:SampleResponder-28 end time: 413679.097424046
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-29 Sending response
INFO:micro_llama_process_samples:SampleResponder-29 end time: 413684.807395744
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 413691.164444331
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 413692.736807484
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 413723.842416561
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 413730.218711269
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 413745.309872613
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 413766.645046028
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 413773.734595826
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 413787.115216073
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 413806.665841173
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 413838.540798105
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 413909.855931801
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 413913.076046075
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 413925.332496902
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 413939.620913156
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 413947.138944019
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 413962.499168412
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-33 Sending response
INFO:micro_llama_process_samples:SampleResponder-33 end time: 413962.532665022
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 413963.403540463
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 414003.667707709
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 414014.111405985
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 414055.577307361
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 414057.096788435
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 414072.109796539
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 414074.409771813
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 414113.710394256
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 414116.228606296
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 414123.437044326
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 414159.137219966
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 414160.863660653
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-34 Sending response
INFO:micro_llama_process_samples:SampleResponder-34 end time: 414161.775324487
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 414163.29519453
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-35 Sending response
INFO:micro_llama_process_samples:SampleResponder-35 end time: 414172.785155944
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 414180.865044706
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 414183.49994479
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 414196.97408002
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 414255.429296709
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 414306.578074782
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 414339.875146413
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 414345.879974115
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 414347.009786973
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 414347.074357455
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 414349.397092407
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-32 Sending response
INFO:micro_llama_process_samples:SampleResponder-32 end time: 414350.711205116
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 414351.674549622
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 414384.472103783
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 414392.926197915
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 414412.79049775
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 414429.80911787
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 414433.963814662
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 414534.182421723
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 414545.353249973
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 414563.893475668
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 414568.489078026
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 414582.594954648
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 414583.433863067
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 414604.121257607
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-37 Sending response
INFO:micro_llama_process_samples:SampleResponder-37 end time: 414623.924801077
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 414626.576823389
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-38 Sending response
INFO:micro_llama_process_samples:SampleResponder-38 end time: 414645.400378483
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-36 Sending response
INFO:micro_llama_process_samples:SampleResponder-36 end time: 414661.234400216
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 414662.127204598
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 414664.746955669
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 414676.331974886
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 414695.995074983
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 414728.927923178
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 414735.430842893
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 414764.848736351
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 414766.921407457
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 414788.487072382
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 414808.654266785
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 414811.1095612
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 414814.737556817
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 414847.557550327
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 414856.08112696
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 414899.67501251
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 414933.8168904
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-39 Sending response
INFO:micro_llama_process_samples:SampleResponder-39 end time: 414946.196689484
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 414966.25732913
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 414975.223601345
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 414999.689391758
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 415000.28401623
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 415033.061369255
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 415050.663417282
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 415054.790263556
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 415077.291794892
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 415085.163929434
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 415087.179896593
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 415090.939054437
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 415100.921669613
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 415107.87498041
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 415124.797728715
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 415129.542109659
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 415153.42595904
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 415174.710804659
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 415178.116271431
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-41 Sending response
INFO:micro_llama_process_samples:SampleResponder-41 end time: 415225.845232223
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-40 Sending response
INFO:micro_llama_process_samples:SampleResponder-40 end time: 415230.043312303
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 415263.31519094
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-43 Sending response
INFO:micro_llama_process_samples:SampleResponder-43 end time: 415273.357917815
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 415282.667016066
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 415284.028510203
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 415290.972100338
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 415337.04766535
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 415353.511074281
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 415364.097188781
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 415369.050366378
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 415370.828100748
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 415409.783631944
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 415448.297490387
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 415454.597779643
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 415514.206585839
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-42 Sending response
INFO:micro_llama_process_samples:SampleResponder-42 end time: 415514.44375678
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 415531.003307332
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 415533.609502087
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 415533.931817134
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 415564.150902899
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 415567.090017742
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 415575.589774046
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 415601.074197667
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 415635.590216347
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-61 end time: 415638.515075859
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 415680.891861586
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 415692.471725157
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 415700.693090395
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 415711.272112025
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 415721.630590147
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 415725.925291396
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 415755.257722909
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 415757.614493675
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 415760.619165489
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 415767.663957817
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-46 Sending response
INFO:micro_llama_process_samples:SampleResponder-46 end time: 415792.125993162
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 415800.998819544
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 415815.47024946
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 415819.764807968
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-47 Sending response
INFO:micro_llama_process_samples:SampleResponder-47 end time: 415833.283277709
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 415840.532988584
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 415868.853007311
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 415891.1733419
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 415912.669131968
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 415942.506810854
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 415965.007109899
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 415989.397348684
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 415991.498795444
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 416008.331432615
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 end time: 416008.506344737
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-44 Sending response
INFO:micro_llama_process_samples:SampleResponder-44 end time: 416028.295502757
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 416051.337822029
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 416066.161876546
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 416074.344457511
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 416123.840618653
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 416192.661779509
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 416203.219423697
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-61 end time: 416210.49282015
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 416210.952469533
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-45 Sending response
INFO:micro_llama_process_samples:SampleResponder-45 end time: 416213.803060336
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-61 end time: 416221.217079622
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 416221.787532374
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 416245.182873334
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 416250.293664321
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 416255.195167176
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 416258.962917963
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 416291.253624638
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 416323.538919558
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 416324.649463762
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 416329.705313863
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 416357.780288915
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 416381.241337994
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 416393.005951577
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 416396.739484623
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 416397.38090467
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 416409.942776712
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 416449.563681976
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-48 Sending response
INFO:micro_llama_process_samples:SampleResponder-48 end time: 416482.071519421
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-50 Sending response
INFO:micro_llama_process_samples:SampleResponder-50 end time: 416519.134522314
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 416520.027114149
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 416529.931078464
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-61 end time: 416533.501820375
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 416539.837025974
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 416542.701101381
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 416566.331012483
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 416583.648982979
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 416585.525635441
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 416585.931914125
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 416593.239820746
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-51 Sending response
INFO:micro_llama_process_samples:SampleResponder-51 end time: 416599.970317451
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 416641.848811363
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 416695.954855265
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 416712.570363435
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 416718.30866791
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 416750.912239279
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 416757.19319841
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 416771.493659761
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 416777.372719612
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 416786.531655798
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 416808.632750398
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 416810.487202652
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 416816.586521585
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-49 Sending response
INFO:micro_llama_process_samples:SampleResponder-49 end time: 416840.37813976
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 416899.105743883
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 416944.068598601
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 416949.527620636
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 416952.380488271
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 416973.610755373
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 416984.723640847
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 416988.347398453
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 416989.833107603
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-61 end time: 416993.247899994
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 417028.857904308
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 417048.684153096
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 417059.541650542
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 417060.778055369
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-72 Sending response
INFO:micro_llama_process_samples:SampleResponder-72 end time: 417079.386481249
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 417085.350590625
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-52 Sending response
INFO:micro_llama_process_samples:SampleResponder-52 end time: 417086.621531049
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-73 Sending response
INFO:micro_llama_process_samples:SampleResponder-73 end time: 417095.843205384
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 417101.190333382
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-54 Sending response
INFO:micro_llama_process_samples:SampleResponder-54 end time: 417106.181716415
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 417146.587542653
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 417181.213826564
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 417196.091918433
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-55 Sending response
INFO:micro_llama_process_samples:SampleResponder-55 end time: 417198.316714229
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 417236.751556934
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-53 Sending response
INFO:micro_llama_process_samples:SampleResponder-53 end time: 417251.558536912
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 417265.206645072
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 417291.844181735
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 417315.171983862
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 417343.959335945
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 417344.624583424
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 417345.368398807
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 417345.901726534
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 417364.303027675
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-74 Sending response
INFO:micro_llama_process_samples:SampleResponder-74 end time: 417372.997508454
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 417386.112918949
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 417455.587985653
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-72 Sending response
INFO:micro_llama_process_samples:SampleResponder-72 end time: 417467.701507387
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-59 Sending response
INFO:micro_llama_process_samples:SampleResponder-59 end time: 417482.50737087
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-57 Sending response
INFO:micro_llama_process_samples:SampleResponder-57 end time: 417500.755694473
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-56 Sending response
INFO:micro_llama_process_samples:SampleResponder-56 end time: 417500.956378835
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-58 Sending response
INFO:micro_llama_process_samples:SampleResponder-58 end time: 417534.041600096
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-74 Sending response
INFO:micro_llama_process_samples:SampleResponder-74 end time: 417539.82340666
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-75 Sending response
INFO:micro_llama_process_samples:SampleResponder-75 end time: 417548.286652012
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-73 Sending response
INFO:micro_llama_process_samples:SampleResponder-73 end time: 417563.014844528
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-72 Sending response
INFO:micro_llama_process_samples:SampleResponder-72 end time: 417583.844162089
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 417621.19036406
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 417625.963561744
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-73 Sending response
INFO:micro_llama_process_samples:SampleResponder-73 end time: 417628.349622316
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 417646.842094176
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-72 Sending response
INFO:micro_llama_process_samples:SampleResponder-72 end time: 417649.45406933
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 417693.719614349
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 417713.21216907
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-74 Sending response
INFO:micro_llama_process_samples:SampleResponder-74 end time: 417722.670475886
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 417727.46014054
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-76 Sending response
INFO:micro_llama_process_samples:SampleResponder-76 end time: 417728.685518393
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-75 Sending response
INFO:micro_llama_process_samples:SampleResponder-75 end time: 417735.826011533
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-72 Sending response
INFO:micro_llama_process_samples:SampleResponder-72 end time: 417736.570786459
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-76 Sending response
INFO:micro_llama_process_samples:SampleResponder-76 end time: 417740.128738025
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-61 end time: 417758.356062876
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 417775.291706833
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-73 Sending response
INFO:micro_llama_process_samples:SampleResponder-73 end time: 417781.199128701
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-77 Sending response
INFO:micro_llama_process_samples:SampleResponder-77 end time: 417805.572130984
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 417811.021982283
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 417811.217238102
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 417814.676266081
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-74 Sending response
INFO:micro_llama_process_samples:SampleResponder-74 end time: 417859.350278201
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-63 Sending response
INFO:micro_llama_process_samples:SampleResponder-63 end time: 417887.476681746
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-75 Sending response
INFO:micro_llama_process_samples:SampleResponder-75 end time: 417921.864028735
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-62 Sending response
INFO:micro_llama_process_samples:SampleResponder-62 end time: 417942.78590075
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-73 Sending response
INFO:micro_llama_process_samples:SampleResponder-73 end time: 417992.284403421
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-61 Sending response
INFO:micro_llama_process_samples:SampleResponder-61 end time: 418004.639825477
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-77 Sending response
INFO:micro_llama_process_samples:SampleResponder-77 end time: 418028.544925392
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-75 Sending response
INFO:micro_llama_process_samples:SampleResponder-75 end time: 418035.212163127
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-78 Sending response
INFO:micro_llama_process_samples:SampleResponder-78 end time: 418047.496812883
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-77 Sending response
INFO:micro_llama_process_samples:SampleResponder-77 end time: 418056.533267685
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 418082.366217662
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 418121.367853381
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-73 Sending response
INFO:micro_llama_process_samples:SampleResponder-73 end time: 418122.350072305
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-78 Sending response
INFO:micro_llama_process_samples:SampleResponder-78 end time: 418146.957342862
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-77 Sending response
INFO:micro_llama_process_samples:SampleResponder-77 end time: 418147.39744284
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-79 Sending response
INFO:micro_llama_process_samples:SampleResponder-79 end time: 418163.26222891
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-60 Sending response
INFO:micro_llama_process_samples:SampleResponder-60 end time: 418178.727880732
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-76 Sending response
INFO:micro_llama_process_samples:SampleResponder-76 end time: 418184.276319031
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-76 Sending response
INFO:micro_llama_process_samples:SampleResponder-76 end time: 418200.302189876
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-78 Sending response
INFO:micro_llama_process_samples:SampleResponder-78 end time: 418218.017093003
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-76 Sending response
INFO:micro_llama_process_samples:SampleResponder-76 end time: 418219.392670925
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 418222.014065893
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-77 Sending response
INFO:micro_llama_process_samples:SampleResponder-77 end time: 418238.129567242
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-80 Sending response
INFO:micro_llama_process_samples:SampleResponder-80 end time: 418242.947484838
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 418243.585417903
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-79 Sending response
INFO:micro_llama_process_samples:SampleResponder-79 end time: 418268.010735059
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-75 Sending response
INFO:micro_llama_process_samples:SampleResponder-75 end time: 418280.364515848
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-74 Sending response
INFO:micro_llama_process_samples:SampleResponder-74 end time: 418330.10958804
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 418343.412566326
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-80 Sending response
INFO:micro_llama_process_samples:SampleResponder-80 end time: 418359.730006506
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-78 Sending response
INFO:micro_llama_process_samples:SampleResponder-78 end time: 418367.629725565
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-72 Sending response
INFO:micro_llama_process_samples:SampleResponder-72 end time: 418405.214706804
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-79 Sending response
INFO:micro_llama_process_samples:SampleResponder-79 end time: 418429.236304812
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-82 Sending response
INFO:micro_llama_process_samples:SampleResponder-82 end time: 418438.491409053
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-80 Sending response
INFO:micro_llama_process_samples:SampleResponder-80 end time: 418457.861213335
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-81 Sending response
INFO:micro_llama_process_samples:SampleResponder-81 end time: 418476.009854736
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-64 Sending response
INFO:micro_llama_process_samples:SampleResponder-64 end time: 418479.543401006
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-79 Sending response
INFO:micro_llama_process_samples:SampleResponder-79 end time: 418509.247151886
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 418527.65938198
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-81 Sending response
INFO:micro_llama_process_samples:SampleResponder-81 end time: 418543.474526226
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-83 Sending response
INFO:micro_llama_process_samples:SampleResponder-83 end time: 418559.584729253
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-78 Sending response
INFO:micro_llama_process_samples:SampleResponder-78 end time: 418561.031224248
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-80 Sending response
INFO:micro_llama_process_samples:SampleResponder-80 end time: 418576.661994953
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-80 Sending response
INFO:micro_llama_process_samples:SampleResponder-80 end time: 418594.753589175
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-81 Sending response
INFO:micro_llama_process_samples:SampleResponder-81 end time: 418599.634715801
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-79 Sending response
INFO:micro_llama_process_samples:SampleResponder-79 end time: 418631.972248362
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-75 Sending response
INFO:micro_llama_process_samples:SampleResponder-75 end time: 418633.149154284
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-77 Sending response
INFO:micro_llama_process_samples:SampleResponder-77 end time: 418651.778212924
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-65 Sending response
INFO:micro_llama_process_samples:SampleResponder-65 end time: 418677.704963869
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-67 Sending response
INFO:micro_llama_process_samples:SampleResponder-67 end time: 418685.613612457
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-84 Sending response
INFO:micro_llama_process_samples:SampleResponder-84 end time: 418691.240233516
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-76 Sending response
INFO:micro_llama_process_samples:SampleResponder-76 end time: 418693.98347065
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-83 Sending response
INFO:micro_llama_process_samples:SampleResponder-83 end time: 418694.239718649
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-74 Sending response
INFO:micro_llama_process_samples:SampleResponder-74 end time: 418743.890702432
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 418754.704142755
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 418773.245173854
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-81 Sending response
INFO:micro_llama_process_samples:SampleResponder-81 end time: 418773.833498371
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-86 Sending response
INFO:micro_llama_process_samples:SampleResponder-86 end time: 418798.847451967
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-84 Sending response
INFO:micro_llama_process_samples:SampleResponder-84 end time: 418804.208866659
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-72 Sending response
INFO:micro_llama_process_samples:SampleResponder-72 end time: 418815.667367038
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-83 Sending response
INFO:micro_llama_process_samples:SampleResponder-83 end time: 418824.244776761
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-84 Sending response
INFO:micro_llama_process_samples:SampleResponder-84 end time: 418846.15853088
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-66 Sending response
INFO:micro_llama_process_samples:SampleResponder-66 end time: 418862.156286626
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 418864.953131317
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-82 Sending response
INFO:micro_llama_process_samples:SampleResponder-82 end time: 418865.410396454
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-81 Sending response
INFO:micro_llama_process_samples:SampleResponder-81 end time: 418870.570186546
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-85 Sending response
INFO:micro_llama_process_samples:SampleResponder-85 end time: 418898.466049497
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-85 Sending response
INFO:micro_llama_process_samples:SampleResponder-85 end time: 418903.375318504
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-85 Sending response
INFO:micro_llama_process_samples:SampleResponder-85 end time: 418944.541204995
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-82 Sending response
INFO:micro_llama_process_samples:SampleResponder-82 end time: 418958.293529033
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-81 Sending response
INFO:micro_llama_process_samples:SampleResponder-81 end time: 418972.802383153
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-78 Sending response
INFO:micro_llama_process_samples:SampleResponder-78 end time: 418987.240170843
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-84 Sending response
INFO:micro_llama_process_samples:SampleResponder-84 end time: 419015.18800583
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-79 Sending response
INFO:micro_llama_process_samples:SampleResponder-79 end time: 419057.241846845
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-83 Sending response
INFO:micro_llama_process_samples:SampleResponder-83 end time: 419087.930752212
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-80 Sending response
INFO:micro_llama_process_samples:SampleResponder-80 end time: 419106.58395446
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-68 Sending response
INFO:micro_llama_process_samples:SampleResponder-68 end time: 419118.160434506
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-74 Sending response
INFO:micro_llama_process_samples:SampleResponder-74 end time: 419120.323990306
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-82 Sending response
INFO:micro_llama_process_samples:SampleResponder-82 end time: 419128.778160953
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-83 Sending response
INFO:micro_llama_process_samples:SampleResponder-83 end time: 419130.672050003
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-88 Sending response
INFO:micro_llama_process_samples:SampleResponder-88 end time: 419134.570309423
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-76 Sending response
INFO:micro_llama_process_samples:SampleResponder-76 end time: 419140.283668688
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-71 Sending response
INFO:micro_llama_process_samples:SampleResponder-71 end time: 419153.3290477
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-75 Sending response
INFO:micro_llama_process_samples:SampleResponder-75 end time: 419156.639056301
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-70 Sending response
INFO:micro_llama_process_samples:SampleResponder-70 end time: 419158.465195312
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-86 Sending response
INFO:micro_llama_process_samples:SampleResponder-86 end time: 419207.002778027
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-87 Sending response
INFO:micro_llama_process_samples:SampleResponder-87 end time: 419231.190482904
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-85 Sending response
INFO:micro_llama_process_samples:SampleResponder-85 end time: 419247.304535559
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-73 Sending response
INFO:micro_llama_process_samples:SampleResponder-73 end time: 419250.276889705
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-87 Sending response
INFO:micro_llama_process_samples:SampleResponder-87 end time: 419303.416284085
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-82 Sending response
INFO:micro_llama_process_samples:SampleResponder-82 end time: 419307.121791712
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-85 Sending response
INFO:micro_llama_process_samples:SampleResponder-85 end time: 419309.690243195
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-90 Sending response
INFO:micro_llama_process_samples:SampleResponder-90 end time: 419327.146001522
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-86 Sending response
INFO:micro_llama_process_samples:SampleResponder-86 end time: 419356.141752031
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-89 Sending response
INFO:micro_llama_process_samples:SampleResponder-89 end time: 419368.003124918
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-87 Sending response
INFO:micro_llama_process_samples:SampleResponder-87 end time: 419439.990156696
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-69 Sending response
INFO:micro_llama_process_samples:SampleResponder-69 end time: 419442.582137458
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-88 Sending response
INFO:micro_llama_process_samples:SampleResponder-88 end time: 419492.45648431
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-84 Sending response
INFO:micro_llama_process_samples:SampleResponder-84 end time: 419532.603534361
ALLCLOSE: True
INFO:micro_llama_process_samples:SampleResponder-82 Sending response
INFO:micro_llama_process_samples:SampleResponder-82 end time: 419547.064032232
ALLCLOSE: True
================================================
MLPerf Results Summary
================================================
SUT name : PySUT
Scenario : Offline
Mode     : PerformanceOnly
Samples per second: 0.0621003
Tokens per second: 50.4332
Result is : VALID
  Min duration satisfied : Yes
  Min queries satisfied : Yes
  Early stopping satisfied: Yes

================================================
Additional Stats
================================================
Min latency (ns)                : 141309536795
Max latency (ns)                : 10692377849269
Mean latency (ns)               : 5364105423385
50.00 percentile latency (ns)   : 5326174783081
90.00 percentile latency (ns)   : 9583801769587
95.00 percentile latency (ns)   : 10043775749604
97.00 percentile latency (ns)   : 10280101571019
99.00 percentile latency (ns)   : 10501453071287
99.90 percentile latency (ns)   : 10692377849269


================================================
Test Parameters Used
================================================
samples_per_query : 660
target_qps : 1
ttft_latency (ns): 6000000000
tpot_latency (ns): 175000000
max_async_queries : 1
min_duration (ms): 600000
max_duration (ms): 0
min_query_count : 1
max_query_count : 4
qsl_rng_seed : 1780908523862526354
sample_index_rng_seed : 14771362308971278857
schedule_rng_seed : 18209322760996052031
accuracy_log_rng_seed : 0
accuracy_log_probability : 0
accuracy_log_sampling_target : 0
print_timestamps : 0
performance_issue_unique : 0
performance_issue_same : 0
performance_issue_same_index : 0
performance_sample_count : 8313
WARNING: sample_concatenate_permutation was set to true. 
Generated samples per query might be different as the one in the setting.
Check the generated_samples_per_query line in the detailed log for the real
samples_per_query value

No warnings encountered during test.

No errors encountered during test.
INFO:root:[Server] Received 664 total samples
INFO:root:Test Done!
INFO:root:Destroying SUT...
INFO:root:Destroying QSL...
INFO:root:Check OutputOfflinePerformanceOnly