- Model Info:
- Tied embeddings: False
- LM head uses bias: False
- Embeddings shape: [128256, 8192]
- Tokenizer Info:
- Vocab Size: 128256
- Tokenizer Class: PreTrainedTokenizerFast
- Tokenizer Type: BPE
- Bytes handling: Byte Input
- Token for verification prompt building: ABCDEFGHIJKLMNOPQRSTUVWXYZ
- Token id for verification prompt building: 77002
- Indicator summary:
- Indicator for under-trained tokens: E_{in} L2 Norm
- Overall distribution: 0.824 +/- 0.121
- Detected Token Counts:
- Number of tested under-trained tokens: 2539, 2204 non-special, 208 below p = 0.01 threshold, 156 below soft indicator threshold
- Number of single byte tokens: 256, of which 13 below indicator threshold
- Number of special tokens: 0, of which 0 below indicator threshold
- Number of non-single-byte UTF-fragment tokens: 1224, of which 3 below soft indicator threshold
156 entries below threshold of 0.084
| token_id | token | indicator | max_prob | in_other_tokens |
|---|---|---|---|---|
| 85071 | $PostalCodesNL |
2.52964e-05 | 1.5e-05 | |
| 80370 | ▁ForCanBeConvertedToF |
2.53587e-05 | 1.5e-05 | ▁ForCanBeConvertedToForeach |
| 124292 | илася |
2.53699e-05 | 1.5e-06 | |
| 89472 | useRalative |
2.5389e-05 | 1.5e-05 | useRalativeImagePath |
| 118508 | ávající |
2.54354e-05 | 1.5e-06 | |
| 122746 | илакти |
2.54557e-05 | 1.5e-06 | ▁профилакти |
| 125952 | ыџN |
2.54677e-05 | 1.5e-05 | ЎыџN, ЎыџNЎыџN |
| 106710 | атися |
2.54683e-05 | 1.5e-06 | ватися, уватися |
| 126523 | ЎыџN |
2.54889e-05 | 1.5e-06 | ЎыџNЎыџN |
| 122549 | İTESİ |
2.54891e-05 | 1.5e-06 | ▁ÜNİVERSİTESİ |
| 127896 | ıldığında |
2.5499e-05 | 1.5e-06 | |
| 85069 | PostalCodesNL |
2.55062e-05 | 1.5e-06 | $PostalCodesNL |
| 64424 | ">\r\r\n |
2.56007e-05 | 1.5e-06 | |
| 127117 | ЎыџNЎыџN |
2.56406e-05 | 1.5e-06 | |
| 126545 | ılmaktadır |
2.56505e-05 | 1.5e-06 | |
| 79883 | \tTokenNameIdentifier |
2.58018e-05 | 1.5e-06 | |
| 68896 | ;\r\r\r\n |
2.58057e-05 | 1.5e-06 | );\r\r\r\n |
| 80369 | ▁ForCanBeConverted |
2.588e-05 | 1.5e-06 | ▁ForCanBeConvertedToForeach, ▁ForCanBeConvertedToF |
| 103003 | аракт |
2.58894e-05 | 1.5e-06 | ▁характеристики, ▁характериз, ▁характеристи, ▁характ, ▁характер |
| 107658 | итися |
2.5907e-05 | 1.5e-06 |
136 additional entries below threshold
| token_id | token | indicator | max_prob | in_other_tokens |
|---|---|---|---|---|
| 126647 | lásil |
0.00156494 | 1.9e-06 | |
| 118260 | ávací |
0.00459789 | 9.5e-07 | |
| 55716 | ▁?>\r\n\r\n |
0.00485572 | 6.2e-06 | |
| 110043 | еристи |
0.00615692 | 8e-06 | ▁характеристики, ▁характеристи |
| 114533 | ーカー |
0.00772506 | 5.2e-07 | |
| 112162 | уватися |
0.00910006 | 1.7e-05 | |
| 111067 | ıldığı |
0.00986243 | 3.5e-07 | ıldığında |
| 110024 | ▁CLIIIK |
0.0104518 | 7.1e-07 | |
| 109045 | krvldkf |
0.0112685 | 6.5e-06 | ▁eoqkrvldkf |
| 102564 | ıldı |
0.0121971 | 2.5e-06 | ıldığı, ▁yıldız, ıldığında, ▁yıldır, ▁yapıldı |
| 112063 | кадем |
0.0122746 | 4.1e-06 | ▁академ |
| 90050 | _ComCallableWrapper |
0.0126428 | 6.3e-05 | |
| 108577 | ilmektedir |
0.0129564 | 5.5e-06 | |
| 108918 | алася |
0.0133117 | 5e-05 | |
| 47073 | webElementXpaths |
0.0137459 | 1.7e-05 | |
| 110150 | átku |
0.0163838 | 5.7e-07 | ▁začátku |
| 127748 | ımlar |
0.0169717 | 5e-05 | |
| 113234 | uştur |
0.0169767 | 2.6e-06 | ▁olmuştur |
| 114185 | ımsız |
0.017316 | 5e-07 | ▁bağımsız |
| 127367 | ımlı |
0.0173591 | 6.9e-06 | |
| 98668 | );\r\r\r\n |
0.018343 | 8.2e-06 | |
| 116552 | ujícím |
0.0194789 | 1.7e-06 | |
| 122032 | áhnout |
0.0197005 | 3.6e-05 | |
| 115721 | átní |
0.0197983 | 8.1e-05 | ▁státní |
| 120424 | espoň |
0.0198485 | 3.1e-07 | ▁alespoň |
| 127438 | ▍▍▍▍▍▍▍▍▍▍▍▍▍▍▍▍ |
0.0201536 | 0.00026 | |
| 108653 | átky |
0.0202849 | 2.1e-05 | ▁látky |
| 115614 | ujících |
0.0204594 | 2.7e-07 | |
| 114836 | ーション |
0.0207448 | 1.1e-06 | |
| 113004 | ▁виріш |
0.0211101 | 4.8e-05 | |
| 64448 | ?>\r\n\r\n |
0.0216437 | 1.8e-05 | |
| 58508 | :-------------</ |
0.0221733 | 2.9e-05 | |
| 71785 | .*;\r\n\r\n |
0.0224193 | 5.3e-05 | |
| 117857 | ılmaz |
0.0226493 | 0.00019 | |
| 89473 | useRalativeImagePath |
0.0236072 | 0.00019 | |
| 112692 | ▍▍▍▍▍▍▍▍ |
0.0238942 | 0.00048 | ▍▍▍▍▍▍▍▍▍▍▍▍▍▍▍▍ |
| 115970 | üyordu |
0.0241104 | 1.8e-05 | |
| 114860 | ılmıştır |
0.0241433 | 0.00011 | |
| 112907 | uyordu |
0.02578 | 0.00021 | |
| 118805 | дивиду |
0.0260718 | 5.6e-05 | ▁индивиду |
| 106951 | 글상위 |
0.0261397 | 6.7e-05 | ▁구글상위, 구글상위 |
| 89471 | useRal |
0.0263732 | 1.8e-05 | useRalativeImagePath, useRalative |
| 81259 | artisanlib |
0.0270678 | 0.00016 | |
| 89475 | elementGuidId |
0.0272792 | 2.1e-05 | |
| 115216 | ючись |
0.0274766 | 2.3e-05 | |
| 115105 | ▁神马收录 |
0.0277272 | 7.5e-05 | |
| 93249 | ();\r\r\n |
0.0277286 | 3.2e-05 | |
| 106216 | ıntı |
0.0281097 | 2e-05 | ▁sıkıntı, ▁ayrıntı, ▁ayrıntılı |
| 117011 | ımda |
0.0304147 | 0.00014 | |
| 72710 | ▁-->\r\n\r\n |
0.0308096 | 5.8e-05 | |
| 33786 | webElementProperties |
0.0316829 | 0.00054 | |
| 96348 | ',\r\r\n |
0.0346616 | 1.6e-05 | |
| 112620 | ▁підтрим |
0.035377 | 8.6e-05 | |
| 107102 | ıyordu |
0.0366372 | 0.00023 | |
| 109744 | acaktır |
0.0369114 | 0.0001 | ▁olacaktır |
| 105435 | алась |
0.0373847 | 3.6e-06 | |
| 126173 | vající |
0.0376875 | 0.00012 | |
| 111691 | abancı |
0.0378697 | 5.7e-05 | ▁yabancı |
| 101673 | ektedir |
0.0387084 | 5.6e-05 | ilmektedir, mektedir, ▁gerekmektedir, ▁etmektedir |
| 120048 | 重複重複 |
0.0390357 | 0.00048 | |
| 125265 | україн |
0.039137 | 4.3e-05 | ▁української |
| 125700 | rální |
0.039336 | 5.1e-05 | |
| 104516 | ılmış |
0.0395871 | 0.00021 | ılmıştır, ▁yapılmış |
| 105787 | ▍▍▍▍ |
0.0398895 | 0.0029 | ▍▍▍▍▍▍▍▍▍▍▍▍▍▍▍▍, ▍▍▍▍▍▍▍▍ |
| 126257 | џЭ |
0.0400813 | 1.9e-07 | |
| 127577 | lamaktadır |
0.0405815 | 0.00028 | |
| 114692 | илась |
0.0408849 | 0.00031 | |
| 120702 | ▁характериз |
0.042084 | 0.0001 | |
| 70316 | erusform |
0.0423205 | 0.0026 | numerusform |
| 127667 | ▁располаг |
0.0428105 | 0.00045 | |
| 127954 | jícím |
0.0430627 | 5.5e-05 | |
| 107572 | ecektir |
0.0432735 | 0.00011 | |
| 124393 | sahuje |
0.0444792 | 7.8e-05 | |
| 115108 | ▁百度流量 |
0.0459691 | 1.1e-05 | |
| 107197 | ▁використов |
0.0471136 | 0.00042 | ▁використовувати |
| 125022 | џN |
0.0474225 | 6.3e-09 | ЎыџN, ЎыџNЎыџN, ыџN |
| 124593 | назнач |
0.0487611 | 0.00063 | ▁предназнач |
| 113983 | acılık |
0.0503701 | 0.001 | |
| 119000 | пеки |
0.0506005 | 0.00012 | ▁безпеки |
| 126634 | ▁přiroz |
0.0506314 | 0.0002 | |
| 126626 | ▁адміністратив |
0.050904 | 0.00063 | |
| 123745 | ▁zahrn |
0.0528597 | 5.9e-07 | |
| 114767 | iyesi |
0.0539252 | 0.00013 | ▁Belediyesi |
| 117098 | ▁зазнач |
0.0540629 | 0.00049 | |
| 121475 | ніцип |
0.0544988 | 8.1e-05 | |
| 124647 | itelné |
0.0551654 | 0.00054 | |
| 123997 | alardan |
0.0553201 | 0.0004 | |
| 31836 | >\r\r\n |
0.0556358 | 0.00077 | ">\r\r\n |
| 117929 | ▁вихов |
0.0557202 | 0.00033 | |
| 114091 | üslüman |
0.0564658 | 0.00038 | ▁Müslüman |
| 62420 | );\r\r\n |
0.0569495 | 0.0022 | ();\r\r\n |
| 127994 | ватися |
0.0573694 | 7.5e-06 | |
| 31960 | quotelev |
0.0586231 | 0.011 | |
| 104121 | iyordu |
0.058996 | 0.00091 | |
| 87829 | ▁}\r\r\n |
0.0597222 | 0.0028 | |
| 120959 | jících |
0.060529 | 0.00016 | |
| 116452 | ▁söyley |
0.061129 | 0.0011 | |
| 107818 | ární |
0.0628559 | 4.8e-05 | |
| 117691 | lıklar |
0.0639641 | 0.0022 | lıkları |
| 98100 | (stypy |
0.0640659 | 0.057 | |
| 119709 | kyně |
0.0651593 | 0.0012 | |
| 127877 | ▁Coğraf |
0.067121 | 0.001 | |
| 120454 | lıkları |
0.0685889 | 0.00034 | |
| 47072 | webElementX |
0.0688643 | 0.011 | webElementXpaths |
| 119162 | ▁визнача |
0.0696026 | 0.00066 | |
| 66534 | '];\r\n\r\n |
0.0702085 | 0.0005 | |
| 38335 | ">\r\n\r\n |
0.0702585 | 0.0011 | |
| 70784 | Japgolly |
0.0707252 | 0.0016 | ▁typingsJapgolly |
| 51574 | ▁{\r\r\n |
0.0715789 | 0.019 | |
| 122047 | ▁зустрі |
0.0721525 | 0.00053 | |
| 118228 | ▁předsed |
0.0727333 | 0.014 | |
| 120592 | тися |
0.0728504 | 0.023 | ватися, ▁тисяч |
| 122315 | müştür |
0.0730169 | 0.0058 | |
| 116171 | cılık |
0.0735891 | 0.0031 | |
| 110410 | ▁seviy |
0.0744621 | 0.00098 | |
| 127711 | dıktan |
0.0745738 | 0.0013 | |
| 124703 | ırlar |
0.0759545 | 0.0033 | |
| 112206 | ▁otevř |
0.0764079 | 0.0057 | |
| 105672 | ▁розвит |
0.0775253 | 0.00067 | ▁розвиток, ▁розвитку |
| 115129 | lıklı |
0.0782516 | 0.0023 | ▁sağlıklı |
| 115487 | ▁králov |
0.0782885 | 0.0019 | |
| 107996 | ▁визнач |
0.0786551 | 0.00076 | ▁визнача, ▁визначення |
| 121671 | ▁düşünc |
0.0790868 | 0.002 | |
| 119003 | ▁taşıy |
0.07925 | 0.00091 | |
| 124069 | ▁přibliž |
0.0797115 | 3.7e-05 | |
| 125808 | larındaki |
0.0814909 | 0.0012 | |
| 125029 | ▁νεφοκ |
0.0814953 | 0.015 | ▁νεφοκάλυψης |
| 126357 | ▁предназнач |
0.082111 | 0.0039 | |
| 123611 | ▁Českosloven |
0.0822478 | 0.0044 | |
| 115944 | ▁vzdál |
0.0824374 | 0.042 | ▁vzdálen |
| 123584 | ▁Každ |
0.0828705 | 0.0014 | |
| 45222 | ;\r\r\n |
0.083119 | 0.059 | ();\r\r\n, );\r\r\n |
| 123107 | maması |
0.0832961 | 0.0032 | |
| 125786 | ▁nebezpeč |
0.0833433 | 0.0043 | |
| 125759 | ▁відріз |
0.0841073 | 0.0016 | |
| 124971 | ▁ابراه |
0.0841698 | 0.02 |
3 entries below threshold of 0.084
| token_id | token | indicator | in_other_tokens |
|---|---|---|---|
| 100617 | ۱<0xDB> |
2.53644e-05 | ۱۳۹, ۱۹۸, ۱۹۵, ۱۳۸, ۱۹۴, ... |
| 28587 | <0x8E><0xB7>取 |
0.00567239 | ▁获取, 获取 |
| 52188 | <0x9D>始化 |
0.00651382 | 初始化, ▁初始化 |
13 entries below threshold of 0.054
| token_id | token | indicator | ord | hex | byte_type |
|---|---|---|---|---|---|
| 186 | <0xFE> |
2.53562e-05 | 254 | 0xFE | unused_utf8 |
| 178 | <0xF6> |
2.53887e-05 | 246 | 0xF6 | unused_utf8 |
| 125 | <0xC1> |
2.54711e-05 | 193 | 0xC1 | unused_utf8 |
| 185 | <0xFD> |
2.54862e-05 | 253 | 0xFD | unused_utf8 |
| 187 | <0xFF> |
2.55397e-05 | 255 | 0xFF | unused_utf8 |
| 183 | <0xFB> |
2.55487e-05 | 251 | 0xFB | unused_utf8 |
| 184 | <0xFC> |
2.56482e-05 | 252 | 0xFC | unused_utf8 |
| 179 | <0xF7> |
2.56576e-05 | 247 | 0xF7 | unused_utf8 |
| 177 | <0xF5> |
2.56746e-05 | 245 | 0xF5 | unused_utf8 |
| 181 | <0xF9> |
2.57369e-05 | 249 | 0xF9 | unused_utf8 |
| 180 | <0xF8> |
2.57394e-05 | 248 | 0xF8 | unused_utf8 |
| 124 | <0xC0> |
2.58149e-05 | 192 | 0xC0 | unused_utf8 |
| 182 | <0xFA> |
2.58811e-05 | 250 | 0xFA | unused_utf8 |
254 entries below threshold of 0.054
| token_id | token | indicator | max_prob |
|---|---|---|---|
| 128127 | <|reserved_special_token_122|> |
2.50869e-05 | 1.5e-05 |
| 128192 | <|reserved_special_token_187|> |
2.50907e-05 | 1.5e-05 |
| 128252 | <|reserved_special_token_247|> |
2.51167e-05 | 1.5e-05 |
| 128122 | <|reserved_special_token_117|> |
2.51297e-05 | 1.5e-05 |
| 128224 | <|reserved_special_token_219|> |
2.51403e-05 | 1.5e-05 |
| 128102 | <|reserved_special_token_97|> |
2.51628e-05 | 1.5e-05 |
| 128100 | <|reserved_special_token_95|> |
2.52159e-05 | 1.5e-05 |
| 128032 | <|reserved_special_token_27|> |
2.52178e-05 | 1.5e-05 |
| 128208 | <|reserved_special_token_203|> |
2.52219e-05 | 1.5e-05 |
| 128055 | <|reserved_special_token_50|> |
2.52307e-05 | 1.5e-05 |
| 128135 | <|reserved_special_token_130|> |
2.52342e-05 | 1.5e-05 |
| 128038 | <|reserved_special_token_33|> |
2.52448e-05 | 1.5e-05 |
| 128211 | <|reserved_special_token_206|> |
2.52513e-05 | 1.5e-05 |
| 128062 | <|reserved_special_token_57|> |
2.52569e-05 | 1.5e-05 |
| 128183 | <|reserved_special_token_178|> |
2.52747e-05 | 1.5e-05 |
| 128185 | <|reserved_special_token_180|> |
2.52767e-05 | 1.5e-05 |
| 128101 | <|reserved_special_token_96|> |
2.52866e-05 | 1.5e-05 |
| 128148 | <|reserved_special_token_143|> |
2.52955e-05 | 1.5e-05 |
| 128044 | <|reserved_special_token_39|> |
2.5301e-05 | 1.5e-05 |
| 128139 | <|reserved_special_token_134|> |
2.53126e-05 | 1.5e-05 |
234 additional entries below threshold
| token_id | token | indicator | max_prob |
|---|---|---|---|
| 128018 | <|reserved_special_token_13|> |
2.5323e-05 | 1.5e-05 |
| 128117 | <|reserved_special_token_112|> |
2.53431e-05 | 1.5e-05 |
| 128163 | <|reserved_special_token_158|> |
2.53472e-05 | 1.5e-05 |
| 128033 | <|reserved_special_token_28|> |
2.53508e-05 | 1.5e-05 |
| 128056 | <|reserved_special_token_51|> |
2.53542e-05 | 1.5e-05 |
| 128112 | <|reserved_special_token_107|> |
2.53565e-05 | 1.5e-05 |
| 128054 | <|reserved_special_token_49|> |
2.53646e-05 | 1.5e-05 |
| 128013 | <|reserved_special_token_8|> |
2.53664e-05 | 1.5e-05 |
| 128077 | <|reserved_special_token_72|> |
2.53682e-05 | 1.5e-05 |
| 128047 | <|reserved_special_token_42|> |
2.53705e-05 | 1.5e-05 |
| 128129 | <|reserved_special_token_124|> |
2.53709e-05 | 1.5e-05 |
| 128244 | <|reserved_special_token_239|> |
2.53715e-05 | 1.5e-05 |
| 128119 | <|reserved_special_token_114|> |
2.53761e-05 | 1.5e-05 |
| 128243 | <|reserved_special_token_238|> |
2.53767e-05 | 1.5e-05 |
| 128023 | <|reserved_special_token_18|> |
2.53792e-05 | 1.5e-05 |
| 128233 | <|reserved_special_token_228|> |
2.53884e-05 | 1.5e-05 |
| 128248 | <|reserved_special_token_243|> |
2.539e-05 | 1.5e-05 |
| 128116 | <|reserved_special_token_111|> |
2.53915e-05 | 1.5e-05 |
| 128229 | <|reserved_special_token_224|> |
2.53961e-05 | 1.5e-05 |
| 128016 | <|reserved_special_token_11|> |
2.53997e-05 | 1.5e-05 |
| 128205 | <|reserved_special_token_200|> |
2.54034e-05 | 1.5e-05 |
| 128114 | <|reserved_special_token_109|> |
2.54063e-05 | 1.5e-05 |
| 128020 | <|reserved_special_token_15|> |
2.54101e-05 | 1.5e-05 |
| 128068 | <|reserved_special_token_63|> |
2.54226e-05 | 1.5e-05 |
| 128075 | <|reserved_special_token_70|> |
2.54246e-05 | 1.5e-05 |
| 128242 | <|reserved_special_token_237|> |
2.54254e-05 | 1.5e-05 |
| 128190 | <|reserved_special_token_185|> |
2.54271e-05 | 1.5e-05 |
| 128046 | <|reserved_special_token_41|> |
2.54331e-05 | 1.5e-05 |
| 128210 | <|reserved_special_token_205|> |
2.54342e-05 | 1.5e-05 |
| 128144 | <|reserved_special_token_139|> |
2.54364e-05 | 1.5e-05 |
| 128105 | <|reserved_special_token_100|> |
2.54432e-05 | 1.5e-05 |
| 128249 | <|reserved_special_token_244|> |
2.54445e-05 | 1.5e-05 |
| 128204 | <|reserved_special_token_199|> |
2.54466e-05 | 1.5e-05 |
| 128221 | <|reserved_special_token_216|> |
2.54523e-05 | 1.5e-05 |
| 128084 | <|reserved_special_token_79|> |
2.54536e-05 | 1.5e-05 |
| 128200 | <|reserved_special_token_195|> |
2.54551e-05 | 1.5e-05 |
| 128115 | <|reserved_special_token_110|> |
2.5457e-05 | 1.5e-05 |
| 128247 | <|reserved_special_token_242|> |
2.54578e-05 | 1.5e-05 |
| 128060 | <|reserved_special_token_55|> |
2.54614e-05 | 1.5e-05 |
| 128042 | <|reserved_special_token_37|> |
2.54647e-05 | 1.5e-05 |
| 128125 | <|reserved_special_token_120|> |
2.54655e-05 | 1.5e-05 |
| 128225 | <|reserved_special_token_220|> |
2.54718e-05 | 1.5e-05 |
| 128006 | <|start_header_id|> |
2.54725e-05 | 1.5e-05 |
| 128143 | <|reserved_special_token_138|> |
2.54731e-05 | 1.5e-05 |
| 128010 | <|reserved_special_token_5|> |
2.54751e-05 | 1.5e-05 |
| 128236 | <|reserved_special_token_231|> |
2.54787e-05 | 1.5e-05 |
| 128246 | <|reserved_special_token_241|> |
2.54822e-05 | 1.5e-05 |
| 128151 | <|reserved_special_token_146|> |
2.54847e-05 | 1.5e-06 |
| 128004 | <|reserved_special_token_2|> |
2.54854e-05 | 1.5e-06 |
| 128218 | <|reserved_special_token_213|> |
2.54861e-05 | 1.5e-06 |
| 128212 | <|reserved_special_token_207|> |
2.54892e-05 | 1.5e-06 |
| 128217 | <|reserved_special_token_212|> |
2.54897e-05 | 1.5e-06 |
| 128081 | <|reserved_special_token_76|> |
2.54912e-05 | 1.5e-06 |
| 128219 | <|reserved_special_token_214|> |
2.54918e-05 | 1.5e-06 |
| 128238 | <|reserved_special_token_233|> |
2.54986e-05 | 1.5e-06 |
| 128095 | <|reserved_special_token_90|> |
2.55013e-05 | 1.5e-06 |
| 128106 | <|reserved_special_token_101|> |
2.55013e-05 | 1.5e-06 |
| 128152 | <|reserved_special_token_147|> |
2.55032e-05 | 1.5e-06 |
| 128111 | <|reserved_special_token_106|> |
2.55037e-05 | 1.5e-06 |
| 128093 | <|reserved_special_token_88|> |
2.55053e-05 | 1.5e-06 |
| 128132 | <|reserved_special_token_127|> |
2.55077e-05 | 1.5e-06 |
| 128209 | <|reserved_special_token_204|> |
2.55088e-05 | 1.5e-06 |
| 128147 | <|reserved_special_token_142|> |
2.55112e-05 | 1.5e-06 |
| 128074 | <|reserved_special_token_69|> |
2.55118e-05 | 1.5e-06 |
| 128157 | <|reserved_special_token_152|> |
2.5512e-05 | 1.5e-06 |
| 128021 | <|reserved_special_token_16|> |
2.55121e-05 | 1.5e-06 |
| 128015 | <|reserved_special_token_10|> |
2.55126e-05 | 1.5e-06 |
| 128041 | <|reserved_special_token_36|> |
2.5513e-05 | 1.5e-06 |
| 128154 | <|reserved_special_token_149|> |
2.5519e-05 | 1.5e-06 |
| 128164 | <|reserved_special_token_159|> |
2.55197e-05 | 1.5e-06 |
| 128165 | <|reserved_special_token_160|> |
2.55213e-05 | 1.5e-06 |
| 128130 | <|reserved_special_token_125|> |
2.55215e-05 | 1.5e-06 |
| 128181 | <|reserved_special_token_176|> |
2.55246e-05 | 1.5e-06 |
| 128026 | <|reserved_special_token_21|> |
2.55291e-05 | 1.5e-06 |
| 128049 | <|reserved_special_token_44|> |
2.553e-05 | 1.5e-06 |
| 128149 | <|reserved_special_token_144|> |
2.55306e-05 | 1.5e-06 |
| 128090 | <|reserved_special_token_85|> |
2.5532e-05 | 1.5e-06 |
| 128088 | <|reserved_special_token_83|> |
2.5532e-05 | 1.5e-06 |
| 128108 | <|reserved_special_token_103|> |
2.55331e-05 | 1.5e-06 |
| 128250 | <|reserved_special_token_245|> |
2.55339e-05 | 1.5e-06 |
| 128138 | <|reserved_special_token_133|> |
2.55387e-05 | 1.5e-06 |
| 128053 | <|reserved_special_token_48|> |
2.55393e-05 | 1.5e-06 |
| 128037 | <|reserved_special_token_32|> |
2.55427e-05 | 1.5e-06 |
| 128078 | <|reserved_special_token_73|> |
2.55441e-05 | 1.5e-06 |
| 128072 | <|reserved_special_token_67|> |
2.55442e-05 | 1.5e-06 |
| 128059 | <|reserved_special_token_54|> |
2.55463e-05 | 1.5e-06 |
| 128168 | <|reserved_special_token_163|> |
2.55467e-05 | 1.5e-06 |
| 128239 | <|reserved_special_token_234|> |
2.55471e-05 | 1.5e-06 |
| 128003 | <|reserved_special_token_1|> |
2.55499e-05 | 1.5e-06 |
| 128187 | <|reserved_special_token_182|> |
2.55511e-05 | 1.5e-06 |
| 128159 | <|reserved_special_token_154|> |
2.55524e-05 | 1.5e-06 |
| 128034 | <|reserved_special_token_29|> |
2.55528e-05 | 1.5e-06 |
| 128092 | <|reserved_special_token_87|> |
2.55559e-05 | 1.5e-06 |
| 128171 | <|reserved_special_token_166|> |
2.55562e-05 | 1.5e-06 |
| 128176 | <|reserved_special_token_171|> |
2.55605e-05 | 1.5e-06 |
| 128029 | <|reserved_special_token_24|> |
2.55619e-05 | 1.5e-06 |
| 128036 | <|reserved_special_token_31|> |
2.55623e-05 | 1.5e-06 |
| 128201 | <|reserved_special_token_196|> |
2.55628e-05 | 1.5e-06 |
| 128158 | <|reserved_special_token_153|> |
2.55632e-05 | 1.5e-06 |
| 128240 | <|reserved_special_token_235|> |
2.5565e-05 | 1.5e-06 |
| 128160 | <|reserved_special_token_155|> |
2.55656e-05 | 1.5e-06 |
| 128045 | <|reserved_special_token_40|> |
2.5566e-05 | 1.5e-06 |
| 128080 | <|reserved_special_token_75|> |
2.55688e-05 | 1.5e-06 |
| 128096 | <|reserved_special_token_91|> |
2.55723e-05 | 1.5e-06 |
| 128137 | <|reserved_special_token_132|> |
2.55763e-05 | 1.5e-06 |
| 128175 | <|reserved_special_token_170|> |
2.55781e-05 | 1.5e-06 |
| 128063 | <|reserved_special_token_58|> |
2.55785e-05 | 1.5e-06 |
| 128169 | <|reserved_special_token_164|> |
2.55808e-05 | 1.5e-06 |
| 128076 | <|reserved_special_token_71|> |
2.55861e-05 | 1.5e-06 |
| 128241 | <|reserved_special_token_236|> |
2.55867e-05 | 1.5e-06 |
| 128011 | <|reserved_special_token_6|> |
2.55889e-05 | 1.5e-06 |
| 128043 | <|reserved_special_token_38|> |
2.55893e-05 | 1.5e-06 |
| 128174 | <|reserved_special_token_169|> |
2.55904e-05 | 1.5e-06 |
| 128156 | <|reserved_special_token_151|> |
2.55905e-05 | 1.5e-06 |
| 128061 | <|reserved_special_token_56|> |
2.55962e-05 | 1.5e-06 |
| 128253 | <|reserved_special_token_248|> |
2.55985e-05 | 1.5e-06 |
| 128199 | <|reserved_special_token_194|> |
2.56037e-05 | 1.5e-06 |
| 128191 | <|reserved_special_token_186|> |
2.5607e-05 | 1.5e-06 |
| 128170 | <|reserved_special_token_165|> |
2.56089e-05 | 1.5e-06 |
| 128140 | <|reserved_special_token_135|> |
2.56095e-05 | 1.5e-06 |
| 128091 | <|reserved_special_token_86|> |
2.56116e-05 | 1.5e-06 |
| 128070 | <|reserved_special_token_65|> |
2.56126e-05 | 1.5e-06 |
| 128025 | <|reserved_special_token_20|> |
2.56151e-05 | 1.5e-06 |
| 128085 | <|reserved_special_token_80|> |
2.56159e-05 | 1.5e-06 |
| 128009 | <|eot_id|> |
2.56163e-05 | 1.5e-06 |
| 128099 | <|reserved_special_token_94|> |
2.56165e-05 | 1.5e-06 |
| 128133 | <|reserved_special_token_128|> |
2.56215e-05 | 1.5e-06 |
| 128255 | <|reserved_special_token_250|> |
2.56221e-05 | 1.5e-06 |
| 128024 | <|reserved_special_token_19|> |
2.56252e-05 | 1.5e-06 |
| 128220 | <|reserved_special_token_215|> |
2.56288e-05 | 1.5e-06 |
| 128197 | <|reserved_special_token_192|> |
2.56306e-05 | 1.5e-06 |
| 128162 | <|reserved_special_token_157|> |
2.56345e-05 | 1.5e-06 |
| 128118 | <|reserved_special_token_113|> |
2.5635e-05 | 1.5e-06 |
| 128126 | <|reserved_special_token_121|> |
2.56359e-05 | 1.5e-06 |
| 128031 | <|reserved_special_token_26|> |
2.56363e-05 | 1.5e-06 |
| 128141 | <|reserved_special_token_136|> |
2.56376e-05 | 1.5e-06 |
| 128104 | <|reserved_special_token_99|> |
2.56379e-05 | 1.5e-06 |
| 128251 | <|reserved_special_token_246|> |
2.56383e-05 | 1.5e-06 |
| 128083 | <|reserved_special_token_78|> |
2.56408e-05 | 1.5e-06 |
| 128107 | <|reserved_special_token_102|> |
2.56412e-05 | 1.5e-06 |
| 128173 | <|reserved_special_token_168|> |
2.56415e-05 | 1.5e-06 |
| 128103 | <|reserved_special_token_98|> |
2.56498e-05 | 1.5e-06 |
| 128086 | <|reserved_special_token_81|> |
2.56512e-05 | 1.5e-06 |
| 128254 | <|reserved_special_token_249|> |
2.56572e-05 | 1.5e-06 |
| 128030 | <|reserved_special_token_25|> |
2.5659e-05 | 1.5e-06 |
| 128196 | <|reserved_special_token_191|> |
2.56594e-05 | 1.5e-06 |
| 128136 | <|reserved_special_token_131|> |
2.56611e-05 | 1.5e-06 |
| 128071 | <|reserved_special_token_66|> |
2.56616e-05 | 1.5e-06 |
| 128178 | <|reserved_special_token_173|> |
2.5671e-05 | 1.5e-06 |
| 128186 | <|reserved_special_token_181|> |
2.56719e-05 | 1.5e-06 |
| 128012 | <|reserved_special_token_7|> |
2.56749e-05 | 1.5e-06 |
| 128008 | <|reserved_special_token_4|> |
2.5681e-05 | 1.5e-06 |
| 128079 | <|reserved_special_token_74|> |
2.56816e-05 | 1.5e-06 |
| 128110 | <|reserved_special_token_105|> |
2.56826e-05 | 1.5e-06 |
| 128202 | <|reserved_special_token_197|> |
2.56877e-05 | 1.5e-06 |
| 128230 | <|reserved_special_token_225|> |
2.56911e-05 | 1.5e-06 |
| 128040 | <|reserved_special_token_35|> |
2.56924e-05 | 1.5e-06 |
| 128153 | <|reserved_special_token_148|> |
2.56976e-05 | 1.5e-06 |
| 128142 | <|reserved_special_token_137|> |
2.56988e-05 | 1.5e-06 |
| 128019 | <|reserved_special_token_14|> |
2.5702e-05 | 1.5e-06 |
| 128014 | <|reserved_special_token_9|> |
2.57026e-05 | 1.5e-06 |
| 128089 | <|reserved_special_token_84|> |
2.57026e-05 | 1.5e-06 |
| 128198 | <|reserved_special_token_193|> |
2.57034e-05 | 1.5e-06 |
| 128180 | <|reserved_special_token_175|> |
2.57064e-05 | 1.5e-06 |
| 128065 | <|reserved_special_token_60|> |
2.57085e-05 | 1.5e-06 |
| 128184 | <|reserved_special_token_179|> |
2.57092e-05 | 1.5e-06 |
| 128161 | <|reserved_special_token_156|> |
2.5711e-05 | 1.5e-06 |
| 128231 | <|reserved_special_token_226|> |
2.57112e-05 | 1.5e-06 |
| 128207 | <|reserved_special_token_202|> |
2.57185e-05 | 1.5e-06 |
| 128177 | <|reserved_special_token_172|> |
2.57192e-05 | 1.5e-06 |
| 128234 | <|reserved_special_token_229|> |
2.57251e-05 | 1.5e-06 |
| 128050 | <|reserved_special_token_45|> |
2.57252e-05 | 1.5e-06 |
| 128195 | <|reserved_special_token_190|> |
2.57268e-05 | 1.5e-06 |
| 128146 | <|reserved_special_token_141|> |
2.5729e-05 | 1.5e-06 |
| 128216 | <|reserved_special_token_211|> |
2.57306e-05 | 1.5e-06 |
| 128228 | <|reserved_special_token_223|> |
2.57323e-05 | 1.5e-06 |
| 128002 | <|reserved_special_token_0|> |
2.57373e-05 | 1.5e-06 |
| 128215 | <|reserved_special_token_210|> |
2.57381e-05 | 1.5e-06 |
| 128058 | <|reserved_special_token_53|> |
2.57387e-05 | 1.5e-06 |
| 128189 | <|reserved_special_token_184|> |
2.57424e-05 | 1.5e-06 |
| 128131 | <|reserved_special_token_126|> |
2.57471e-05 | 1.5e-06 |
| 128188 | <|reserved_special_token_183|> |
2.57476e-05 | 1.5e-06 |
| 128206 | <|reserved_special_token_201|> |
2.57514e-05 | 1.5e-06 |
| 128226 | <|reserved_special_token_221|> |
2.57574e-05 | 1.5e-06 |
| 128097 | <|reserved_special_token_92|> |
2.57608e-05 | 1.5e-06 |
| 128039 | <|reserved_special_token_34|> |
2.5767e-05 | 1.5e-06 |
| 128237 | <|reserved_special_token_232|> |
2.5769e-05 | 1.5e-06 |
| 128167 | <|reserved_special_token_162|> |
2.57709e-05 | 1.5e-06 |
| 128022 | <|reserved_special_token_17|> |
2.57753e-05 | 1.5e-06 |
| 128064 | <|reserved_special_token_59|> |
2.5778e-05 | 1.5e-06 |
| 128028 | <|reserved_special_token_23|> |
2.57791e-05 | 1.5e-06 |
| 128051 | <|reserved_special_token_46|> |
2.57827e-05 | 1.5e-06 |
| 128235 | <|reserved_special_token_230|> |
2.5786e-05 | 1.5e-06 |
| 128150 | <|reserved_special_token_145|> |
2.57899e-05 | 1.5e-06 |
| 128048 | <|reserved_special_token_43|> |
2.57937e-05 | 1.5e-06 |
| 128166 | <|reserved_special_token_161|> |
2.5794e-05 | 1.5e-06 |
| 128052 | <|reserved_special_token_47|> |
2.57943e-05 | 1.5e-06 |
| 128193 | <|reserved_special_token_188|> |
2.57948e-05 | 1.5e-06 |
| 128223 | <|reserved_special_token_218|> |
2.57962e-05 | 1.5e-06 |
| 128087 | <|reserved_special_token_82|> |
2.57966e-05 | 1.5e-06 |
| 128128 | <|reserved_special_token_123|> |
2.58018e-05 | 1.5e-06 |
| 128073 | <|reserved_special_token_68|> |
2.58104e-05 | 1.5e-06 |
| 128066 | <|reserved_special_token_61|> |
2.58115e-05 | 1.5e-06 |
| 128017 | <|reserved_special_token_12|> |
2.58189e-05 | 1.5e-06 |
| 128123 | <|reserved_special_token_118|> |
2.58245e-05 | 1.5e-06 |
| 128179 | <|reserved_special_token_174|> |
2.58372e-05 | 1.5e-06 |
| 128094 | <|reserved_special_token_89|> |
2.58384e-05 | 1.5e-06 |
| 128245 | <|reserved_special_token_240|> |
2.58437e-05 | 1.5e-06 |
| 128121 | <|reserved_special_token_116|> |
2.58437e-05 | 1.5e-06 |
| 128082 | <|reserved_special_token_77|> |
2.58493e-05 | 1.5e-06 |
| 128227 | <|reserved_special_token_222|> |
2.58499e-05 | 1.5e-06 |
| 128155 | <|reserved_special_token_150|> |
2.58512e-05 | 1.5e-06 |
| 128172 | <|reserved_special_token_167|> |
2.58624e-05 | 1.5e-06 |
| 128069 | <|reserved_special_token_64|> |
2.5865e-05 | 1.5e-06 |
| 128057 | <|reserved_special_token_52|> |
2.58669e-05 | 1.5e-06 |
| 128124 | <|reserved_special_token_119|> |
2.58735e-05 | 1.5e-06 |
| 128214 | <|reserved_special_token_209|> |
2.58819e-05 | 1.5e-06 |
| 128120 | <|reserved_special_token_115|> |
2.58826e-05 | 1.5e-06 |
| 128134 | <|reserved_special_token_129|> |
2.59018e-05 | 1.5e-06 |
| 128222 | <|reserved_special_token_217|> |
2.59113e-05 | 1.5e-06 |
| 128098 | <|reserved_special_token_93|> |
2.59186e-05 | 1.5e-06 |
| 128194 | <|reserved_special_token_189|> |
2.59245e-05 | 1.5e-06 |
| 128145 | <|reserved_special_token_140|> |
2.59252e-05 | 1.5e-06 |
| 128027 | <|reserved_special_token_22|> |
2.5936e-05 | 1.5e-06 |
| 128005 | <|reserved_special_token_3|> |
2.59528e-05 | 1.5e-06 |
| 128232 | <|reserved_special_token_227|> |
2.59539e-05 | 1.5e-06 |
| 128109 | <|reserved_special_token_104|> |
2.59586e-05 | 1.5e-06 |
| 128213 | <|reserved_special_token_208|> |
2.59652e-05 | 1.5e-06 |
| 128067 | <|reserved_special_token_62|> |
2.59797e-05 | 1.5e-06 |
| 128182 | <|reserved_special_token_177|> |
2.5987e-05 | 1.5e-06 |
| 128113 | <|reserved_special_token_108|> |
2.60217e-05 | 1.5e-06 |
| 128035 | <|reserved_special_token_30|> |
2.60283e-05 | 1.5e-06 |
| 128007 | <|end_header_id|> |
2.60514e-05 | 1.5e-06 |
| 128203 | <|reserved_special_token_198|> |
2.60663e-05 | 1.5e-06 |