-
Notifications
You must be signed in to change notification settings - Fork 0
/
run_log.out
627 lines (620 loc) · 67.1 KB
/
run_log.out
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
[2024-08-12 18:56:05,465] torch.distributed.run: [WARNING]
[2024-08-12 18:56:05,465] torch.distributed.run: [WARNING] *****************************************
[2024-08-12 18:56:05,465] torch.distributed.run: [WARNING] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed.
[2024-08-12 18:56:05,465] torch.distributed.run: [WARNING] *****************************************
=====================
DDP
=====================
DDP
====================================
DDP
====================================
DDP
num decayed parameter tensors: 50, with 124,354,560 parameters
num non-decayed parameter tensors: 98, with 121,344 parameters
using fused AdamW: False
num decayed parameter tensors: 50, with 124,354,560 parameters
num non-decayed parameter tensors: 98, with 121,344 parameters
using fused AdamW: False
Gradient accumulation steps needed with B: 16 and T: 1024 for total batch size: 524288 = 16
total params: 124475904
loaded len : 338025
loaded len : 338025
step : 1 | loss: 10.925172805786133 | lr: 0.0000600 | dt: 35847.31 ms | tokens/sec: 14_625.588823 | norm: 28.85
step : 2 | loss: 9.567803382873535 | lr: 0.0001200 | dt: 2620.83 ms | tokens/sec: 200_046.818607 | norm: 7.79
step : 3 | loss: 9.125333786010742 | lr: 0.0001800 | dt: 2585.24 ms | tokens/sec: 202_800.485125 | norm: 3.87
step : 4 | loss: 9.705062866210938 | lr: 0.0002400 | dt: 2587.20 ms | tokens/sec: 202_647.162818 | norm: 8.84
step : 5 | loss: 8.97816276550293 | lr: 0.0003000 | dt: 2586.01 ms | tokens/sec: 202_739.775100 | norm: 4.23
step : 6 | loss: 8.55412769317627 | lr: 0.0003600 | dt: 2585.57 ms | tokens/sec: 202_774.584964 | norm: 2.33
step : 7 | loss: 8.33272933959961 | lr: 0.0004200 | dt: 2585.49 ms | tokens/sec: 202_781.185605 | norm: 4.92
step : 8 | loss: 7.976587295532227 | lr: 0.0004800 | dt: 2592.84 ms | tokens/sec: 202_206.078601 | norm: 1.63
step : 9 | loss: 7.652230262756348 | lr: 0.0005400 | dt: 2587.05 ms | tokens/sec: 202_658.368195 | norm: 2.67
step : 10 | loss: 7.273026466369629 | lr: 0.0006000 | dt: 2584.29 ms | tokens/sec: 202_874.912430 | norm: 2.49
step : 11 | loss: 6.95777702331543 | lr: 0.0006000 | dt: 2587.75 ms | tokens/sec: 202_603.641682 | norm: 1.90
step : 12 | loss: 6.724649906158447 | lr: 0.0006000 | dt: 2584.94 ms | tokens/sec: 202_824.240547 | norm: 1.17
step : 13 | loss: 6.517132759094238 | lr: 0.0006000 | dt: 2594.08 ms | tokens/sec: 202_109.717813 | norm: 1.46
step : 14 | loss: 6.38503885269165 | lr: 0.0006000 | dt: 2583.79 ms | tokens/sec: 202_914.655548 | norm: 2.12
step : 15 | loss: 6.269977569580078 | lr: 0.0006000 | dt: 2593.76 ms | tokens/sec: 202_134.612282 | norm: 0.98
step : 16 | loss: 6.223223686218262 | lr: 0.0006000 | dt: 2589.62 ms | tokens/sec: 202_457.587752 | norm: 1.54
step : 17 | loss: 6.160551071166992 | lr: 0.0006000 | dt: 2590.45 ms | tokens/sec: 202_392.667955 | norm: 1.42
step : 18 | loss: 6.163330078125 | lr: 0.0006000 | dt: 2591.85 ms | tokens/sec: 202_282.991515 | norm: 1.01
step : 19 | loss: 6.100296974182129 | lr: 0.0006000 | dt: 2594.77 ms | tokens/sec: 202_055.862714 | norm: 0.60
step : 20 | loss: 6.087071418762207 | lr: 0.0006000 | dt: 2591.76 ms | tokens/sec: 202_290.304542 | norm: 1.24
step : 21 | loss: 6.052515506744385 | lr: 0.0006000 | dt: 2591.53 ms | tokens/sec: 202_308.580116 | norm: 0.60
step : 22 | loss: 6.004415512084961 | lr: 0.0006000 | dt: 2595.02 ms | tokens/sec: 202_035.869353 | norm: 0.73
step : 23 | loss: 5.976036071777344 | lr: 0.0006000 | dt: 2591.15 ms | tokens/sec: 202_338.326858 | norm: 0.74
step : 24 | loss: 5.942173004150391 | lr: 0.0006000 | dt: 2589.26 ms | tokens/sec: 202_485.700283 | norm: 0.61
step : 25 | loss: 5.909804344177246 | lr: 0.0006000 | dt: 2596.59 ms | tokens/sec: 201_914.249472 | norm: 0.62
step : 26 | loss: 5.893524646759033 | lr: 0.0006000 | dt: 2593.05 ms | tokens/sec: 202_189.773512 | norm: 0.60
step : 27 | loss: 5.882970809936523 | lr: 0.0006000 | dt: 2592.22 ms | tokens/sec: 202_254.786421 | norm: 0.40
step : 28 | loss: 5.860320091247559 | lr: 0.0006000 | dt: 2586.99 ms | tokens/sec: 202_662.944081 | norm: 0.71
step : 29 | loss: 5.850890159606934 | lr: 0.0006000 | dt: 2591.79 ms | tokens/sec: 202_288.276194 | norm: 0.89
step : 30 | loss: 5.8280110359191895 | lr: 0.0006000 | dt: 2593.09 ms | tokens/sec: 202_186.204220 | norm: 0.60
step : 31 | loss: 5.823184967041016 | lr: 0.0006000 | dt: 2588.06 ms | tokens/sec: 202_579.676632 | norm: 0.55
step : 32 | loss: 5.817880153656006 | lr: 0.0006000 | dt: 2589.71 ms | tokens/sec: 202_450.728585 | norm: 1.22
step : 33 | loss: 5.793244361877441 | lr: 0.0006000 | dt: 2591.05 ms | tokens/sec: 202_346.053507 | norm: 0.69
step : 34 | loss: 5.787227630615234 | lr: 0.0006000 | dt: 2588.01 ms | tokens/sec: 202_583.558436 | norm: 1.27
step : 35 | loss: 5.762032508850098 | lr: 0.0006000 | dt: 2592.72 ms | tokens/sec: 202_215.245558 | norm: 0.67
step : 36 | loss: 5.759857177734375 | lr: 0.0006000 | dt: 2588.08 ms | tokens/sec: 202_578.351628 | norm: 0.78
step : 37 | loss: 5.737373352050781 | lr: 0.0006000 | dt: 2597.19 ms | tokens/sec: 201_867.354773 | norm: 0.36
step : 38 | loss: 5.745175361633301 | lr: 0.0006000 | dt: 2588.41 ms | tokens/sec: 202_552.023086 | norm: 0.97
step : 39 | loss: 5.70063591003418 | lr: 0.0006000 | dt: 2598.94 ms | tokens/sec: 201_731.131624 | norm: 0.77
step : 40 | loss: 5.701869487762451 | lr: 0.0006000 | dt: 2590.44 ms | tokens/sec: 202_393.264043 | norm: 0.71
step : 41 | loss: 5.676395893096924 | lr: 0.0006000 | dt: 2595.05 ms | tokens/sec: 202_033.790419 | norm: 0.76
step : 42 | loss: 5.665721893310547 | lr: 0.0005999 | dt: 2594.43 ms | tokens/sec: 202_081.765291 | norm: 1.02
step : 43 | loss: 5.63541316986084 | lr: 0.0005999 | dt: 2591.28 ms | tokens/sec: 202_327.491926 | norm: 0.62
step : 44 | loss: 5.613576412200928 | lr: 0.0005999 | dt: 2589.49 ms | tokens/sec: 202_467.579110 | norm: 0.63
step : 45 | loss: 5.606022834777832 | lr: 0.0005999 | dt: 2592.60 ms | tokens/sec: 202_224.562121 | norm: 0.70
step : 46 | loss: 5.586983680725098 | lr: 0.0005999 | dt: 2588.17 ms | tokens/sec: 202_571.073742 | norm: 1.04
step : 47 | loss: 5.552325248718262 | lr: 0.0005999 | dt: 2592.80 ms | tokens/sec: 202_209.109369 | norm: 0.49
step : 48 | loss: 5.541226863861084 | lr: 0.0005999 | dt: 2588.01 ms | tokens/sec: 202_583.782391 | norm: 0.65
step : 49 | loss: 5.523007392883301 | lr: 0.0005999 | dt: 2592.17 ms | tokens/sec: 202_258.525562 | norm: 0.85
step : 50 | loss: 5.502579212188721 | lr: 0.0005999 | dt: 2588.19 ms | tokens/sec: 202_569.282342 | norm: 0.72
step : 51 | loss: 5.469318389892578 | lr: 0.0005999 | dt: 2593.63 ms | tokens/sec: 202_144.831936 | norm: 0.55
step : 52 | loss: 5.453517913818359 | lr: 0.0005999 | dt: 2589.87 ms | tokens/sec: 202_437.589359 | norm: 0.74
step : 53 | loss: 5.427847862243652 | lr: 0.0005999 | dt: 2593.41 ms | tokens/sec: 202_161.352798 | norm: 0.60
step : 54 | loss: 5.411740303039551 | lr: 0.0005999 | dt: 2585.33 ms | tokens/sec: 202_793.135165 | norm: 0.59
step : 55 | loss: 5.380110263824463 | lr: 0.0005999 | dt: 2594.48 ms | tokens/sec: 202_078.515500 | norm: 0.42
step : 56 | loss: 5.360589027404785 | lr: 0.0005999 | dt: 2587.69 ms | tokens/sec: 202_608.140426 | norm: 0.82
step : 57 | loss: 5.365988254547119 | lr: 0.0005999 | dt: 2590.94 ms | tokens/sec: 202_354.283502 | norm: 0.90
step : 58 | loss: 5.340298652648926 | lr: 0.0005999 | dt: 2590.51 ms | tokens/sec: 202_388.216027 | norm: 1.04
step : 59 | loss: 5.338377952575684 | lr: 0.0005999 | dt: 2594.47 ms | tokens/sec: 202_078.998319 | norm: 0.92
step : 60 | loss: 5.2820000648498535 | lr: 0.0005999 | dt: 2589.36 ms | tokens/sec: 202_477.646028 | norm: 0.72
step : 61 | loss: 5.289456367492676 | lr: 0.0005999 | dt: 2590.33 ms | tokens/sec: 202_401.926356 | norm: 0.85
step : 62 | loss: 5.253976821899414 | lr: 0.0005999 | dt: 2593.22 ms | tokens/sec: 202_176.370728 | norm: 0.94
step : 63 | loss: 5.238509178161621 | lr: 0.0005999 | dt: 2592.37 ms | tokens/sec: 202_242.584016 | norm: 0.95
step : 64 | loss: 5.201255798339844 | lr: 0.0005998 | dt: 2591.35 ms | tokens/sec: 202_322.242427 | norm: 1.19
step : 65 | loss: 5.171767234802246 | lr: 0.0005998 | dt: 2592.14 ms | tokens/sec: 202_260.292866 | norm: 0.66
step : 66 | loss: 5.154880523681641 | lr: 0.0005998 | dt: 2595.06 ms | tokens/sec: 202_033.289254 | norm: 0.92
step : 67 | loss: 5.1305317878723145 | lr: 0.0005998 | dt: 2591.43 ms | tokens/sec: 202_316.043902 | norm: 1.05
step : 68 | loss: 5.111607551574707 | lr: 0.0005998 | dt: 2589.90 ms | tokens/sec: 202_435.502149 | norm: 1.00
step : 69 | loss: 5.080226421356201 | lr: 0.0005998 | dt: 2595.58 ms | tokens/sec: 201_992.981443 | norm: 1.00
step : 70 | loss: 5.0575666427612305 | lr: 0.0005998 | dt: 2594.37 ms | tokens/sec: 202_086.983746 | norm: 1.12
step : 71 | loss: 5.026509761810303 | lr: 0.0005998 | dt: 2590.25 ms | tokens/sec: 202_407.999730 | norm: 0.68
step : 72 | loss: 5.020694732666016 | lr: 0.0005998 | dt: 2593.00 ms | tokens/sec: 202_193.975028 | norm: 0.81
step : 73 | loss: 4.99310302734375 | lr: 0.0005998 | dt: 2595.64 ms | tokens/sec: 201_988.083247 | norm: 0.70
step : 74 | loss: 4.983156204223633 | lr: 0.0005998 | dt: 2588.92 ms | tokens/sec: 202_512.104833 | norm: 1.18
step : 75 | loss: 4.960909843444824 | lr: 0.0005998 | dt: 2598.44 ms | tokens/sec: 201_770.261209 | norm: 1.78
step : 76 | loss: 4.933356285095215 | lr: 0.0005998 | dt: 2592.88 ms | tokens/sec: 202_202.713253 | norm: 0.98
step : 77 | loss: 4.946307182312012 | lr: 0.0005998 | dt: 2594.70 ms | tokens/sec: 202_060.819898 | norm: 1.87
step : 78 | loss: 4.885838508605957 | lr: 0.0005998 | dt: 2591.51 ms | tokens/sec: 202_309.827144 | norm: 0.97
step : 79 | loss: 4.878668308258057 | lr: 0.0005998 | dt: 2591.50 ms | tokens/sec: 202_310.999737 | norm: 1.72
step : 80 | loss: 4.866021156311035 | lr: 0.0005997 | dt: 2595.69 ms | tokens/sec: 201_983.908836 | norm: 1.26
step : 81 | loss: 4.844635963439941 | lr: 0.0005997 | dt: 2603.20 ms | tokens/sec: 201_401.115576 | norm: 1.43
step : 82 | loss: 4.83492374420166 | lr: 0.0005997 | dt: 2591.68 ms | tokens/sec: 202_296.278170 | norm: 1.60
step : 83 | loss: 4.7947187423706055 | lr: 0.0005997 | dt: 2594.85 ms | tokens/sec: 202_049.364902 | norm: 1.00
step : 84 | loss: 4.777286529541016 | lr: 0.0005997 | dt: 2590.13 ms | tokens/sec: 202_417.389960 | norm: 1.36
step : 85 | loss: 4.780583381652832 | lr: 0.0005997 | dt: 2600.59 ms | tokens/sec: 201_603.778738 | norm: 1.29
step : 86 | loss: 4.747002124786377 | lr: 0.0005997 | dt: 2591.39 ms | tokens/sec: 202_319.096582 | norm: 1.08
step : 87 | loss: 4.734467506408691 | lr: 0.0005997 | dt: 2600.51 ms | tokens/sec: 201_609.545534 | norm: 1.39
step : 88 | loss: 4.711470603942871 | lr: 0.0005997 | dt: 2595.63 ms | tokens/sec: 201_988.584188 | norm: 1.48
step : 89 | loss: 4.681963920593262 | lr: 0.0005997 | dt: 2596.97 ms | tokens/sec: 201_884.479007 | norm: 1.10
step : 90 | loss: 4.6810150146484375 | lr: 0.0005997 | dt: 2596.45 ms | tokens/sec: 201_924.632272 | norm: 1.50
step : 91 | loss: 4.659510612487793 | lr: 0.0005997 | dt: 2599.18 ms | tokens/sec: 201_712.923218 | norm: 1.67
step : 92 | loss: 4.625673770904541 | lr: 0.0005996 | dt: 2596.30 ms | tokens/sec: 201_936.740707 | norm: 1.01
step : 93 | loss: 4.613494396209717 | lr: 0.0005996 | dt: 2599.48 ms | tokens/sec: 201_689.464387 | norm: 1.30
step : 94 | loss: 4.596883773803711 | lr: 0.0005996 | dt: 2593.88 ms | tokens/sec: 202_125.378319 | norm: 1.25
step : 95 | loss: 4.576940536499023 | lr: 0.0005996 | dt: 2597.51 ms | tokens/sec: 201_842.526086 | norm: 0.69
step : 96 | loss: 4.54551887512207 | lr: 0.0005996 | dt: 2596.84 ms | tokens/sec: 201_894.636311 | norm: 0.83
step : 97 | loss: 4.544377326965332 | lr: 0.0005996 | dt: 2597.60 ms | tokens/sec: 201_835.245399 | norm: 1.82
step : 98 | loss: 4.52232551574707 | lr: 0.0005996 | dt: 2588.41 ms | tokens/sec: 202_551.967115 | norm: 1.37
step : 99 | loss: 4.50290584564209 | lr: 0.0005996 | dt: 2599.95 ms | tokens/sec: 201_652.899475 | norm: 1.27
step : 100 | loss: 4.481143951416016 | lr: 0.0005996 | dt: 2594.51 ms | tokens/sec: 202_076.157145 | norm: 1.59
step : 101 | loss: 4.463927745819092 | lr: 0.0005996 | dt: 2599.92 ms | tokens/sec: 201_655.562329 | norm: 1.45
step : 102 | loss: 4.463397979736328 | lr: 0.0005996 | dt: 2597.96 ms | tokens/sec: 201_807.516902 | norm: 2.51
step : 103 | loss: 4.438662052154541 | lr: 0.0005995 | dt: 2600.29 ms | tokens/sec: 201_626.884873 | norm: 1.08
step : 104 | loss: 4.4256463050842285 | lr: 0.0005995 | dt: 2596.07 ms | tokens/sec: 201_954.841167 | norm: 1.97
step : 105 | loss: 4.3888139724731445 | lr: 0.0005995 | dt: 2598.97 ms | tokens/sec: 201_729.521602 | norm: 1.73
step : 106 | loss: 4.395038604736328 | lr: 0.0005995 | dt: 2591.13 ms | tokens/sec: 202_339.779051 | norm: 1.78
step : 107 | loss: 4.354106903076172 | lr: 0.0005995 | dt: 2599.94 ms | tokens/sec: 201_653.509706 | norm: 1.26
step : 108 | loss: 4.379093170166016 | lr: 0.0005995 | dt: 2594.88 ms | tokens/sec: 202_046.765894 | norm: 2.82
step : 109 | loss: 4.3506855964660645 | lr: 0.0005995 | dt: 2599.22 ms | tokens/sec: 201_709.888803 | norm: 1.85
step : 110 | loss: 4.3198676109313965 | lr: 0.0005995 | dt: 2596.51 ms | tokens/sec: 201_920.293615 | norm: 2.81
step : 111 | loss: 4.343290328979492 | lr: 0.0005995 | dt: 2598.11 ms | tokens/sec: 201_795.664692 | norm: 2.10
step : 112 | loss: 4.307811260223389 | lr: 0.0005995 | dt: 2596.35 ms | tokens/sec: 201_932.716763 | norm: 2.00
step : 113 | loss: 4.306704044342041 | lr: 0.0005994 | dt: 2595.93 ms | tokens/sec: 201_965.469280 | norm: 2.26
step : 114 | loss: 4.250819683074951 | lr: 0.0005994 | dt: 2594.69 ms | tokens/sec: 202_061.692536 | norm: 2.34
step : 115 | loss: 4.260648727416992 | lr: 0.0005994 | dt: 2598.05 ms | tokens/sec: 201_800.294296 | norm: 2.37
step : 116 | loss: 4.237851142883301 | lr: 0.0005994 | dt: 2592.14 ms | tokens/sec: 202_260.664934 | norm: 1.66
step : 117 | loss: 4.216651916503906 | lr: 0.0005994 | dt: 2599.22 ms | tokens/sec: 201_709.814794 | norm: 2.33
step : 118 | loss: 4.1960673332214355 | lr: 0.0005994 | dt: 2591.36 ms | tokens/sec: 202_321.255850 | norm: 1.95
step : 119 | loss: 4.1701836585998535 | lr: 0.0005994 | dt: 2601.70 ms | tokens/sec: 201_517.224047 | norm: 2.11
step : 120 | loss: 4.151955604553223 | lr: 0.0005994 | dt: 2594.81 ms | tokens/sec: 202_052.743712 | norm: 1.32
step : 121 | loss: 4.152433395385742 | lr: 0.0005994 | dt: 2596.97 ms | tokens/sec: 201_884.312199 | norm: 2.30
step : 122 | loss: 4.121458053588867 | lr: 0.0005993 | dt: 2598.63 ms | tokens/sec: 201_755.414612 | norm: 2.04
step : 123 | loss: 4.124955177307129 | lr: 0.0005993 | dt: 2596.24 ms | tokens/sec: 201_941.098615 | norm: 3.16
step : 124 | loss: 4.077203750610352 | lr: 0.0005993 | dt: 2592.80 ms | tokens/sec: 202_209.537031 | norm: 1.93
step : 125 | loss: 4.085769176483154 | lr: 0.0005993 | dt: 2607.98 ms | tokens/sec: 201_032.123620 | norm: 3.19
step : 126 | loss: 4.080506801605225 | lr: 0.0005993 | dt: 2597.52 ms | tokens/sec: 201_841.766499 | norm: 2.02
step : 127 | loss: 4.021237373352051 | lr: 0.0005993 | dt: 2598.57 ms | tokens/sec: 201_760.245996 | norm: 2.59
step : 128 | loss: 4.0955915451049805 | lr: 0.0005993 | dt: 2595.48 ms | tokens/sec: 202_000.459071 | norm: 2.94
step : 129 | loss: 4.0181355476379395 | lr: 0.0005993 | dt: 2605.36 ms | tokens/sec: 201_234.099728 | norm: 1.84
step : 130 | loss: 4.095422744750977 | lr: 0.0005992 | dt: 2599.55 ms | tokens/sec: 201_683.951983 | norm: 4.27
step : 131 | loss: 4.038806915283203 | lr: 0.0005992 | dt: 2598.44 ms | tokens/sec: 201_770.242695 | norm: 2.30
step : 132 | loss: 4.023094177246094 | lr: 0.0005992 | dt: 2592.26 ms | tokens/sec: 202_251.605469 | norm: 4.12
step : 133 | loss: 3.9933366775512695 | lr: 0.0005992 | dt: 2601.73 ms | tokens/sec: 201_514.767976 | norm: 2.38
step : 134 | loss: 4.004421234130859 | lr: 0.0005992 | dt: 2597.72 ms | tokens/sec: 201_826.205479 | norm: 4.51
step : 135 | loss: 3.96555495262146 | lr: 0.0005992 | dt: 2601.36 ms | tokens/sec: 201_543.579791 | norm: 2.91
step : 136 | loss: 3.9638609886169434 | lr: 0.0005992 | dt: 2594.32 ms | tokens/sec: 202_090.976697 | norm: 3.42
step : 137 | loss: 3.9419262409210205 | lr: 0.0005992 | dt: 2600.17 ms | tokens/sec: 201_635.832991 | norm: 2.98
step : 138 | loss: 3.904857635498047 | lr: 0.0005991 | dt: 2597.37 ms | tokens/sec: 201_853.550010 | norm: 2.50
step : 139 | loss: 3.8747406005859375 | lr: 0.0005991 | dt: 2599.32 ms | tokens/sec: 201_701.840645 | norm: 2.93
step : 140 | loss: 3.887849807739258 | lr: 0.0005991 | dt: 2596.37 ms | tokens/sec: 201_930.825379 | norm: 3.52
step : 141 | loss: 3.8575401306152344 | lr: 0.0005991 | dt: 2603.93 ms | tokens/sec: 201_344.632400 | norm: 2.72
step : 142 | loss: 3.8107616901397705 | lr: 0.0005991 | dt: 2602.03 ms | tokens/sec: 201_491.816766 | norm: 2.45
step : 143 | loss: 3.799440860748291 | lr: 0.0005991 | dt: 2597.27 ms | tokens/sec: 201_860.850549 | norm: 2.83
step : 144 | loss: 3.795210838317871 | lr: 0.0005991 | dt: 2603.23 ms | tokens/sec: 201_399.215692 | norm: 2.56
step : 145 | loss: 3.752762794494629 | lr: 0.0005990 | dt: 2602.68 ms | tokens/sec: 201_441.741086 | norm: 2.20
step : 146 | loss: 3.7499051094055176 | lr: 0.0005990 | dt: 2596.81 ms | tokens/sec: 201_896.693846 | norm: 3.86
step : 147 | loss: 3.7573399543762207 | lr: 0.0005990 | dt: 2601.04 ms | tokens/sec: 201_568.279552 | norm: 3.02
step : 148 | loss: 3.722216844558716 | lr: 0.0005990 | dt: 2599.48 ms | tokens/sec: 201_689.316399 | norm: 2.85
step : 149 | loss: 3.6992785930633545 | lr: 0.0005990 | dt: 2599.53 ms | tokens/sec: 201_685.820247 | norm: 2.55
step : 150 | loss: 3.7434964179992676 | lr: 0.0005990 | dt: 2593.95 ms | tokens/sec: 202_119.786330 | norm: 5.95
step : 151 | loss: 3.667300224304199 | lr: 0.0005990 | dt: 2602.15 ms | tokens/sec: 201_482.290687 | norm: 2.55
step : 152 | loss: 3.7019152641296387 | lr: 0.0005989 | dt: 2592.26 ms | tokens/sec: 202_251.307841 | norm: 4.99
step : 153 | loss: 3.687793731689453 | lr: 0.0005989 | dt: 2597.95 ms | tokens/sec: 201_808.665159 | norm: 3.98
step : 154 | loss: 3.648043155670166 | lr: 0.0005989 | dt: 2594.85 ms | tokens/sec: 202_049.587677 | norm: 3.94
step : 155 | loss: 3.6660099029541016 | lr: 0.0005989 | dt: 2601.02 ms | tokens/sec: 201_570.182627 | norm: 5.51
step : 156 | loss: 3.646247148513794 | lr: 0.0005989 | dt: 2589.46 ms | tokens/sec: 202_470.039820 | norm: 3.91
step : 157 | loss: 3.6262476444244385 | lr: 0.0005989 | dt: 2590.59 ms | tokens/sec: 202_381.473313 | norm: 4.56
step : 158 | loss: 3.6208643913269043 | lr: 0.0005988 | dt: 2588.25 ms | tokens/sec: 202_564.785323 | norm: 4.30
step : 159 | loss: 3.559377908706665 | lr: 0.0005988 | dt: 2598.72 ms | tokens/sec: 201_748.899090 | norm: 3.86
step : 160 | loss: 3.5687360763549805 | lr: 0.0005988 | dt: 2598.53 ms | tokens/sec: 201_763.670679 | norm: 4.67
step : 161 | loss: 3.5660834312438965 | lr: 0.0005988 | dt: 2600.16 ms | tokens/sec: 201_637.164184 | norm: 4.38
step : 162 | loss: 3.4919066429138184 | lr: 0.0005988 | dt: 2593.37 ms | tokens/sec: 202_164.568083 | norm: 2.36
step : 163 | loss: 3.512247085571289 | lr: 0.0005988 | dt: 2596.54 ms | tokens/sec: 201_918.217059 | norm: 4.67
step : 164 | loss: 3.5150158405303955 | lr: 0.0005987 | dt: 2592.33 ms | tokens/sec: 202_245.615878 | norm: 3.69
step : 165 | loss: 3.45540189743042 | lr: 0.0005987 | dt: 2596.17 ms | tokens/sec: 201_947.051637 | norm: 2.66
step : 166 | loss: 3.5145554542541504 | lr: 0.0005987 | dt: 2593.54 ms | tokens/sec: 202_151.503140 | norm: 6.09
step : 167 | loss: 3.4777450561523438 | lr: 0.0005987 | dt: 2600.45 ms | tokens/sec: 201_614.406903 | norm: 3.97
step : 168 | loss: 3.4846129417419434 | lr: 0.0005987 | dt: 2589.37 ms | tokens/sec: 202_477.142658 | norm: 5.61
step : 169 | loss: 3.4075961112976074 | lr: 0.0005987 | dt: 2593.54 ms | tokens/sec: 202_151.224390 | norm: 3.57
step : 170 | loss: 3.478367805480957 | lr: 0.0005986 | dt: 2593.69 ms | tokens/sec: 202_139.944954 | norm: 5.61
step : 171 | loss: 3.4636940956115723 | lr: 0.0005986 | dt: 2600.96 ms | tokens/sec: 201_574.635593 | norm: 5.02
step : 172 | loss: 3.3518099784851074 | lr: 0.0005986 | dt: 2595.94 ms | tokens/sec: 201_964.374885 | norm: 2.96
step : 173 | loss: 3.3669893741607666 | lr: 0.0005986 | dt: 2600.61 ms | tokens/sec: 201_602.022889 | norm: 3.65
step : 174 | loss: 3.322779655456543 | lr: 0.0005986 | dt: 2594.79 ms | tokens/sec: 202_054.451725 | norm: 3.25
step : 175 | loss: 3.3474574089050293 | lr: 0.0005986 | dt: 2597.96 ms | tokens/sec: 201_807.220580 | norm: 3.62
step : 176 | loss: 3.2936031818389893 | lr: 0.0005985 | dt: 2599.80 ms | tokens/sec: 201_665.123294 | norm: 3.49
step : 177 | loss: 3.318783760070801 | lr: 0.0005985 | dt: 2597.68 ms | tokens/sec: 201_829.336015 | norm: 3.07
step : 178 | loss: 3.2848198413848877 | lr: 0.0005985 | dt: 2588.75 ms | tokens/sec: 202_525.925213 | norm: 3.33
step : 179 | loss: 3.2717514038085938 | lr: 0.0005985 | dt: 2597.22 ms | tokens/sec: 201_865.316367 | norm: 3.05
step : 180 | loss: 3.283262252807617 | lr: 0.0005985 | dt: 2597.38 ms | tokens/sec: 201_852.790340 | norm: 4.74
step : 181 | loss: 3.257594108581543 | lr: 0.0005985 | dt: 2598.41 ms | tokens/sec: 201_772.760539 | norm: 3.08
step : 182 | loss: 3.2585902214050293 | lr: 0.0005984 | dt: 2597.08 ms | tokens/sec: 201_876.046256 | norm: 5.45
step : 183 | loss: 3.2286014556884766 | lr: 0.0005984 | dt: 2593.97 ms | tokens/sec: 202_117.779977 | norm: 3.95
step : 184 | loss: 3.232621192932129 | lr: 0.0005984 | dt: 2599.99 ms | tokens/sec: 201_649.755919 | norm: 4.61
step : 185 | loss: 3.227365255355835 | lr: 0.0005984 | dt: 2602.82 ms | tokens/sec: 201_430.466879 | norm: 4.50
step : 186 | loss: 3.174894332885742 | lr: 0.0005984 | dt: 2595.08 ms | tokens/sec: 202_031.730089 | norm: 4.48
step : 187 | loss: 3.105807065963745 | lr: 0.0005983 | dt: 2596.85 ms | tokens/sec: 201_893.561220 | norm: 4.04
step : 188 | loss: 3.1511592864990234 | lr: 0.0005983 | dt: 2593.65 ms | tokens/sec: 202_142.657850 | norm: 2.58
step : 189 | loss: 3.113844394683838 | lr: 0.0005983 | dt: 2597.31 ms | tokens/sec: 201_858.200800 | norm: 4.26
step : 190 | loss: 3.1057872772216797 | lr: 0.0005983 | dt: 2593.60 ms | tokens/sec: 202_147.191894 | norm: 4.11
step : 191 | loss: 3.0887222290039062 | lr: 0.0005983 | dt: 2597.77 ms | tokens/sec: 201_822.222985 | norm: 5.48
step : 192 | loss: 3.045607566833496 | lr: 0.0005982 | dt: 2594.76 ms | tokens/sec: 202_056.605348 | norm: 2.71
step : 193 | loss: 3.0249814987182617 | lr: 0.0005982 | dt: 2603.89 ms | tokens/sec: 201_348.024553 | norm: 4.60
step : 194 | loss: 3.0242462158203125 | lr: 0.0005982 | dt: 2594.18 ms | tokens/sec: 202_101.897757 | norm: 4.44
step : 195 | loss: 2.9574015140533447 | lr: 0.0005982 | dt: 2598.77 ms | tokens/sec: 201_745.030698 | norm: 2.10
step : 196 | loss: 3.0355851650238037 | lr: 0.0005982 | dt: 2588.51 ms | tokens/sec: 202_544.206077 | norm: 6.14
step : 197 | loss: 3.011706829071045 | lr: 0.0005982 | dt: 2599.43 ms | tokens/sec: 201_693.238152 | norm: 5.90
step : 198 | loss: 2.986801862716675 | lr: 0.0005981 | dt: 2595.17 ms | tokens/sec: 202_024.714146 | norm: 3.09
step : 199 | loss: 2.9731874465942383 | lr: 0.0005981 | dt: 2595.09 ms | tokens/sec: 202_031.024761 | norm: 5.45
step : 200 | loss: 2.937840461730957 | lr: 0.0005981 | dt: 2591.95 ms | tokens/sec: 202_275.827867 | norm: 4.40
step : 201 | loss: 2.9413235187530518 | lr: 0.0005981 | dt: 2601.40 ms | tokens/sec: 201_540.938365 | norm: 5.14
step : 202 | loss: 2.8639659881591797 | lr: 0.0005981 | dt: 2592.67 ms | tokens/sec: 202_218.946046 | norm: 3.01
step : 203 | loss: 2.9178082942962646 | lr: 0.0005980 | dt: 2597.70 ms | tokens/sec: 201_827.983760 | norm: 5.98
step : 204 | loss: 2.8546221256256104 | lr: 0.0005980 | dt: 2595.53 ms | tokens/sec: 201_996.284148 | norm: 3.13
step : 205 | loss: 2.898329257965088 | lr: 0.0005980 | dt: 2600.86 ms | tokens/sec: 201_582.248588 | norm: 6.08
step : 206 | loss: 2.8715434074401855 | lr: 0.0005980 | dt: 2589.38 ms | tokens/sec: 202_475.930852 | norm: 4.42
step : 207 | loss: 2.8890204429626465 | lr: 0.0005979 | dt: 2592.42 ms | tokens/sec: 202_238.678069 | norm: 7.01
step : 208 | loss: 2.858433723449707 | lr: 0.0005979 | dt: 2594.32 ms | tokens/sec: 202_090.958125 | norm: 6.83
step : 209 | loss: 2.8110218048095703 | lr: 0.0005979 | dt: 2590.60 ms | tokens/sec: 202_380.728290 | norm: 4.46
step : 210 | loss: 2.787482738494873 | lr: 0.0005979 | dt: 2592.93 ms | tokens/sec: 202_199.143504 | norm: 3.87
step : 211 | loss: 2.7611587047576904 | lr: 0.0005979 | dt: 2597.22 ms | tokens/sec: 201_864.816037 | norm: 4.03
step : 212 | loss: 2.7247109413146973 | lr: 0.0005978 | dt: 2593.85 ms | tokens/sec: 202_127.106140 | norm: 5.22
step : 213 | loss: 2.6799607276916504 | lr: 0.0005978 | dt: 2597.71 ms | tokens/sec: 201_826.742665 | norm: 3.27
step : 214 | loss: 2.7131662368774414 | lr: 0.0005978 | dt: 2593.90 ms | tokens/sec: 202_123.241809 | norm: 5.62
step : 215 | loss: 2.6915619373321533 | lr: 0.0005978 | dt: 2600.32 ms | tokens/sec: 201_624.537048 | norm: 3.87
step : 216 | loss: 2.6462502479553223 | lr: 0.0005978 | dt: 2597.94 ms | tokens/sec: 201_808.961485 | norm: 5.25
step : 217 | loss: 2.653268337249756 | lr: 0.0005977 | dt: 2592.09 ms | tokens/sec: 202_264.888001 | norm: 5.95
step : 218 | loss: 2.6242945194244385 | lr: 0.0005977 | dt: 2597.69 ms | tokens/sec: 201_828.613575 | norm: 5.52
step : 219 | loss: 2.6041030883789062 | lr: 0.0005977 | dt: 2597.82 ms | tokens/sec: 201_818.351780 | norm: 4.07
step : 220 | loss: 2.5293946266174316 | lr: 0.0005977 | dt: 2595.98 ms | tokens/sec: 201_961.852257 | norm: 3.10
step : 221 | loss: 2.613417148590088 | lr: 0.0005976 | dt: 2601.67 ms | tokens/sec: 201_520.104928 | norm: 4.39
step : 222 | loss: 2.563408613204956 | lr: 0.0005976 | dt: 2595.17 ms | tokens/sec: 202_024.305826 | norm: 5.33
step : 223 | loss: 2.627272129058838 | lr: 0.0005976 | dt: 2601.86 ms | tokens/sec: 201_504.833504 | norm: 6.86
step : 224 | loss: 2.5692086219787598 | lr: 0.0005976 | dt: 2591.06 ms | tokens/sec: 202_344.861889 | norm: 7.16
step : 225 | loss: 2.555515766143799 | lr: 0.0005976 | dt: 2598.01 ms | tokens/sec: 201_803.479587 | norm: 4.37
step : 226 | loss: 2.560220241546631 | lr: 0.0005975 | dt: 2598.66 ms | tokens/sec: 201_752.860181 | norm: 7.48
step : 227 | loss: 2.458521842956543 | lr: 0.0005975 | dt: 2594.29 ms | tokens/sec: 202_093.335397 | norm: 4.13
step : 228 | loss: 2.603529453277588 | lr: 0.0005975 | dt: 2595.97 ms | tokens/sec: 201_962.427263 | norm: 6.77
step : 229 | loss: 2.532775402069092 | lr: 0.0005975 | dt: 2599.04 ms | tokens/sec: 201_723.840465 | norm: 5.03
step : 230 | loss: 2.497056007385254 | lr: 0.0005974 | dt: 2591.85 ms | tokens/sec: 202_283.605566 | norm: 5.85
step : 231 | loss: 2.495297908782959 | lr: 0.0005974 | dt: 2596.51 ms | tokens/sec: 201_920.349238 | norm: 6.70
step : 232 | loss: 2.420912265777588 | lr: 0.0005974 | dt: 2591.05 ms | tokens/sec: 202_345.792839 | norm: 4.75
step : 233 | loss: 2.4091405868530273 | lr: 0.0005974 | dt: 2599.34 ms | tokens/sec: 201_700.342094 | norm: 8.23
step : 234 | loss: 2.428603172302246 | lr: 0.0005973 | dt: 2590.13 ms | tokens/sec: 202_417.259534 | norm: 6.35
step : 235 | loss: 2.363312005996704 | lr: 0.0005973 | dt: 2590.64 ms | tokens/sec: 202_377.506126 | norm: 4.01
step : 236 | loss: 2.396317958831787 | lr: 0.0005973 | dt: 2590.86 ms | tokens/sec: 202_360.651967 | norm: 6.81
step : 237 | loss: 2.376798152923584 | lr: 0.0005973 | dt: 2597.51 ms | tokens/sec: 201_842.174082 | norm: 5.18
step : 238 | loss: 2.419497013092041 | lr: 0.0005972 | dt: 2593.40 ms | tokens/sec: 202_162.337817 | norm: 9.16
step : 239 | loss: 2.3465051651000977 | lr: 0.0005972 | dt: 2595.09 ms | tokens/sec: 202_030.579293 | norm: 4.15
step : 240 | loss: 2.397810220718384 | lr: 0.0005972 | dt: 2592.09 ms | tokens/sec: 202_264.888001 | norm: 10.59
step : 241 | loss: 2.3525514602661133 | lr: 0.0005972 | dt: 2592.19 ms | tokens/sec: 202_256.962919 | norm: 7.25
step : 242 | loss: 2.377352714538574 | lr: 0.0005971 | dt: 2596.51 ms | tokens/sec: 201_920.312156 | norm: 10.00
step : 243 | loss: 2.3878774642944336 | lr: 0.0005971 | dt: 2595.73 ms | tokens/sec: 201_980.940471 | norm: 9.38
step : 244 | loss: 2.2454495429992676 | lr: 0.0005971 | dt: 2590.91 ms | tokens/sec: 202_356.722838 | norm: 4.74
step : 245 | loss: 2.3863110542297363 | lr: 0.0005971 | dt: 2595.43 ms | tokens/sec: 202_003.966139 | norm: 12.90
step : 246 | loss: 2.33443021774292 | lr: 0.0005971 | dt: 2595.82 ms | tokens/sec: 201_973.779649 | norm: 8.77
step : 247 | loss: 2.309612512588501 | lr: 0.0005970 | dt: 2598.32 ms | tokens/sec: 201_779.962659 | norm: 9.84
step : 248 | loss: 2.297441005706787 | lr: 0.0005970 | dt: 2592.30 ms | tokens/sec: 202_248.350213 | norm: 7.97
step : 249 | loss: 2.2600674629211426 | lr: 0.0005970 | dt: 2590.45 ms | tokens/sec: 202_392.574816 | norm: 8.26
step : 250 | loss: 2.218360424041748 | lr: 0.0005969 | dt: 2585.27 ms | tokens/sec: 202_798.446533 | norm: 6.69
step : 251 | loss: 2.240323543548584 | lr: 0.0005969 | dt: 2597.27 ms | tokens/sec: 201_860.961729 | norm: 7.21
step : 252 | loss: 2.151369333267212 | lr: 0.0005969 | dt: 2596.43 ms | tokens/sec: 201_926.189784 | norm: 5.56
step : 253 | loss: 2.221949577331543 | lr: 0.0005969 | dt: 2594.67 ms | tokens/sec: 202_063.437835 | norm: 5.48
step : 254 | loss: 2.1528306007385254 | lr: 0.0005968 | dt: 2591.48 ms | tokens/sec: 202_312.153731 | norm: 8.14
step : 255 | loss: 2.1927356719970703 | lr: 0.0005968 | dt: 2594.34 ms | tokens/sec: 202_089.045203 | norm: 4.63
step : 256 | loss: 2.2153944969177246 | lr: 0.0005968 | dt: 2595.80 ms | tokens/sec: 201_975.226614 | norm: 8.27
step : 257 | loss: 2.1062426567077637 | lr: 0.0005968 | dt: 2595.70 ms | tokens/sec: 201_983.445023 | norm: 5.57
step : 258 | loss: 2.1448609828948975 | lr: 0.0005967 | dt: 2595.34 ms | tokens/sec: 202_011.537369 | norm: 8.64
step : 259 | loss: 2.137080192565918 | lr: 0.0005967 | dt: 2602.85 ms | tokens/sec: 201_428.750948 | norm: 7.18
step : 260 | loss: 2.049758195877075 | lr: 0.0005967 | dt: 2592.18 ms | tokens/sec: 202_257.707032 | norm: 5.25
step : 261 | loss: 2.0576257705688477 | lr: 0.0005967 | dt: 2596.57 ms | tokens/sec: 201_915.936605 | norm: 6.56
step : 262 | loss: 2.0282812118530273 | lr: 0.0005966 | dt: 2594.18 ms | tokens/sec: 202_101.359106 | norm: 6.16
step : 263 | loss: 1.9961652755737305 | lr: 0.0005966 | dt: 2597.76 ms | tokens/sec: 201_823.093563 | norm: 5.82
step : 264 | loss: 1.9039366245269775 | lr: 0.0005966 | dt: 2595.67 ms | tokens/sec: 201_985.393051 | norm: 3.56
step : 265 | loss: 1.9637417793273926 | lr: 0.0005966 | dt: 2599.53 ms | tokens/sec: 201_685.561278 | norm: 5.72
step : 266 | loss: 1.9241188764572144 | lr: 0.0005965 | dt: 2592.04 ms | tokens/sec: 202_268.106580 | norm: 4.75
step : 267 | loss: 2.004513740539551 | lr: 0.0005965 | dt: 2596.83 ms | tokens/sec: 201_895.340688 | norm: 9.57
step : 268 | loss: 1.9391225576400757 | lr: 0.0005965 | dt: 2593.32 ms | tokens/sec: 202_168.917244 | norm: 4.72
step : 269 | loss: 1.9257392883300781 | lr: 0.0005964 | dt: 2597.32 ms | tokens/sec: 201_857.552271 | norm: 6.76
step : 270 | loss: 1.9261457920074463 | lr: 0.0005964 | dt: 2597.40 ms | tokens/sec: 201_850.993094 | norm: 7.85
step : 271 | loss: 1.9038243293762207 | lr: 0.0005964 | dt: 2596.63 ms | tokens/sec: 201_911.190458 | norm: 4.79
step : 272 | loss: 1.8895585536956787 | lr: 0.0005964 | dt: 2587.87 ms | tokens/sec: 202_594.047516 | norm: 7.05
step : 273 | loss: 1.842529296875 | lr: 0.0005963 | dt: 2593.98 ms | tokens/sec: 202_116.944009 | norm: 5.02
step : 274 | loss: 1.8585989475250244 | lr: 0.0005963 | dt: 2590.70 ms | tokens/sec: 202_373.241106 | norm: 7.00
step : 275 | loss: 1.806272268295288 | lr: 0.0005963 | dt: 2591.22 ms | tokens/sec: 202_332.499680 | norm: 4.70
step : 276 | loss: 1.7905713319778442 | lr: 0.0005963 | dt: 2592.38 ms | tokens/sec: 202_241.672615 | norm: 6.13
step : 277 | loss: 1.7765235900878906 | lr: 0.0005962 | dt: 2596.02 ms | tokens/sec: 201_958.142625 | norm: 4.60
step : 278 | loss: 1.7390413284301758 | lr: 0.0005962 | dt: 2593.37 ms | tokens/sec: 202_164.809698 | norm: 7.22
step : 279 | loss: 1.7713475227355957 | lr: 0.0005962 | dt: 2593.36 ms | tokens/sec: 202_165.627477 | norm: 5.61
step : 280 | loss: 1.7289376258850098 | lr: 0.0005961 | dt: 2592.56 ms | tokens/sec: 202_227.909598 | norm: 4.81
step : 281 | loss: 1.6518399715423584 | lr: 0.0005961 | dt: 2598.58 ms | tokens/sec: 201_759.801721 | norm: 5.10
step : 282 | loss: 1.6906774044036865 | lr: 0.0005961 | dt: 2594.81 ms | tokens/sec: 202_052.428104 | norm: 6.06
step : 283 | loss: 1.666508674621582 | lr: 0.0005961 | dt: 2598.26 ms | tokens/sec: 201_784.424899 | norm: 4.46
step : 284 | loss: 1.6389864683151245 | lr: 0.0005960 | dt: 2595.54 ms | tokens/sec: 201_995.801724 | norm: 6.70
step : 285 | loss: 1.6084024906158447 | lr: 0.0005960 | dt: 2601.35 ms | tokens/sec: 201_544.688103 | norm: 4.21
step : 286 | loss: 1.5907628536224365 | lr: 0.0005960 | dt: 2588.80 ms | tokens/sec: 202_521.952360 | norm: 2.94
step : 287 | loss: 1.6211214065551758 | lr: 0.0005959 | dt: 2591.85 ms | tokens/sec: 202_283.047338 | norm: 8.12
step : 288 | loss: 1.6128180027008057 | lr: 0.0005959 | dt: 2587.15 ms | tokens/sec: 202_650.617677 | norm: 4.84
step : 289 | loss: 1.556830883026123 | lr: 0.0005959 | dt: 2595.60 ms | tokens/sec: 201_991.441454 | norm: 4.90
step : 290 | loss: 1.5996840000152588 | lr: 0.0005958 | dt: 2592.16 ms | tokens/sec: 202_259.269686 | norm: 7.06
step : 291 | loss: 1.5686583518981934 | lr: 0.0005958 | dt: 2599.26 ms | tokens/sec: 201_706.521450 | norm: 4.28
step : 292 | loss: 1.52949857711792 | lr: 0.0005958 | dt: 2591.35 ms | tokens/sec: 202_322.540264 | norm: 7.35
step : 293 | loss: 1.5673141479492188 | lr: 0.0005958 | dt: 2595.29 ms | tokens/sec: 202_015.304638 | norm: 5.74
step : 294 | loss: 1.5231785774230957 | lr: 0.0005957 | dt: 2593.51 ms | tokens/sec: 202_153.919005 | norm: 6.15
step : 295 | loss: 1.4839508533477783 | lr: 0.0005957 | dt: 2596.55 ms | tokens/sec: 201_917.049015 | norm: 5.88
step : 296 | loss: 1.4369653463363647 | lr: 0.0005957 | dt: 2599.59 ms | tokens/sec: 201_680.714974 | norm: 5.23
step : 297 | loss: 1.4515775442123413 | lr: 0.0005956 | dt: 2594.32 ms | tokens/sec: 202_090.920980 | norm: 6.25
step : 298 | loss: 1.3930193185806274 | lr: 0.0005956 | dt: 2592.10 ms | tokens/sec: 202_263.846171 | norm: 4.80
step : 299 | loss: 1.3904576301574707 | lr: 0.0005956 | dt: 2596.25 ms | tokens/sec: 201_940.690633 | norm: 5.69
step : 300 | loss: 1.3726383447647095 | lr: 0.0005955 | dt: 2593.81 ms | tokens/sec: 202_130.506130 | norm: 3.94
step : 301 | loss: 1.3191744089126587 | lr: 0.0005955 | dt: 2602.90 ms | tokens/sec: 201_424.249075 | norm: 4.44
step : 302 | loss: 1.3844728469848633 | lr: 0.0005955 | dt: 2593.15 ms | tokens/sec: 202_181.817138 | norm: 6.79
step : 303 | loss: 1.2875075340270996 | lr: 0.0005955 | dt: 2592.94 ms | tokens/sec: 202_197.972208 | norm: 3.01
step : 304 | loss: 1.4276037216186523 | lr: 0.0005954 | dt: 2592.42 ms | tokens/sec: 202_238.752467 | norm: 11.92
step : 305 | loss: 1.3576090335845947 | lr: 0.0005954 | dt: 2600.00 ms | tokens/sec: 201_648.868344 | norm: 5.14
step : 306 | loss: 1.3765833377838135 | lr: 0.0005954 | dt: 2588.33 ms | tokens/sec: 202_558.292054 | norm: 7.66
step : 307 | loss: 1.3062231540679932 | lr: 0.0005953 | dt: 2599.97 ms | tokens/sec: 201_651.438634 | norm: 4.65
step : 308 | loss: 1.2842020988464355 | lr: 0.0005953 | dt: 2596.69 ms | tokens/sec: 201_906.333305 | norm: 6.31
step : 309 | loss: 1.272635579109192 | lr: 0.0005953 | dt: 2600.39 ms | tokens/sec: 201_619.250020 | norm: 5.76
step : 310 | loss: 1.2241888046264648 | lr: 0.0005952 | dt: 2588.54 ms | tokens/sec: 202_541.706254 | norm: 5.47
step : 311 | loss: 1.2242780923843384 | lr: 0.0005952 | dt: 2594.20 ms | tokens/sec: 202_100.021777 | norm: 5.85
step : 312 | loss: 1.1585056781768799 | lr: 0.0005952 | dt: 2595.39 ms | tokens/sec: 202_007.027965 | norm: 6.10
step : 313 | loss: 1.1791703701019287 | lr: 0.0005951 | dt: 2596.15 ms | tokens/sec: 201_948.349850 | norm: 4.77
step : 314 | loss: 1.159404993057251 | lr: 0.0005951 | dt: 2594.39 ms | tokens/sec: 202_085.163756 | norm: 6.55
step : 315 | loss: 1.1394016742706299 | lr: 0.0005951 | dt: 2598.42 ms | tokens/sec: 201_772.168099 | norm: 4.88
step : 316 | loss: 1.1080763339996338 | lr: 0.0005950 | dt: 2595.26 ms | tokens/sec: 202_017.772925 | norm: 5.19
step : 317 | loss: 1.085369348526001 | lr: 0.0005950 | dt: 2599.88 ms | tokens/sec: 201_658.539631 | norm: 7.14
step : 318 | loss: 1.0769007205963135 | lr: 0.0005950 | dt: 2595.32 ms | tokens/sec: 202_012.780738 | norm: 5.69
step : 319 | loss: 1.032299280166626 | lr: 0.0005949 | dt: 2599.58 ms | tokens/sec: 201_681.898783 | norm: 4.65
step : 320 | loss: 1.023451566696167 | lr: 0.0005949 | dt: 2598.48 ms | tokens/sec: 201_767.095479 | norm: 7.37
step : 321 | loss: 1.0307059288024902 | lr: 0.0005949 | dt: 2601.16 ms | tokens/sec: 201_559.633023 | norm: 4.23
step : 322 | loss: 0.9933538436889648 | lr: 0.0005948 | dt: 2597.55 ms | tokens/sec: 201_839.376615 | norm: 6.09
step : 323 | loss: 1.007981538772583 | lr: 0.0005948 | dt: 2592.19 ms | tokens/sec: 202_256.590865 | norm: 3.26
step : 324 | loss: 0.9764080047607422 | lr: 0.0005948 | dt: 2594.00 ms | tokens/sec: 202_115.680780 | norm: 4.63
step : 325 | loss: 0.9924076795578003 | lr: 0.0005947 | dt: 2597.45 ms | tokens/sec: 201_846.916984 | norm: 3.45
step : 326 | loss: 1.0162067413330078 | lr: 0.0005947 | dt: 2596.39 ms | tokens/sec: 201_929.471763 | norm: 8.06
step : 327 | loss: 1.0118275880813599 | lr: 0.0005947 | dt: 2604.13 ms | tokens/sec: 201_329.203234 | norm: 3.34
step : 328 | loss: 1.0898971557617188 | lr: 0.0005946 | dt: 2595.94 ms | tokens/sec: 201_964.523277 | norm: 11.47
step : 329 | loss: 1.0863401889801025 | lr: 0.0005946 | dt: 2594.65 ms | tokens/sec: 202_064.756112 | norm: 7.11
step : 330 | loss: 1.0226712226867676 | lr: 0.0005946 | dt: 2595.34 ms | tokens/sec: 202_011.388908 | norm: 8.46
step : 331 | loss: 0.9587839841842651 | lr: 0.0005945 | dt: 2601.29 ms | tokens/sec: 201_549.324670 | norm: 5.10
step : 332 | loss: 0.997157096862793 | lr: 0.0005945 | dt: 2594.70 ms | tokens/sec: 202_061.488301 | norm: 8.76
step : 333 | loss: 0.9506193399429321 | lr: 0.0005945 | dt: 2601.22 ms | tokens/sec: 201_554.460241 | norm: 6.06
step : 334 | loss: 0.9108353853225708 | lr: 0.0005944 | dt: 2595.46 ms | tokens/sec: 202_001.869306 | norm: 6.56
step : 335 | loss: 0.8826392889022827 | lr: 0.0005944 | dt: 2598.10 ms | tokens/sec: 201_796.442451 | norm: 5.32
step : 336 | loss: 0.8379533886909485 | lr: 0.0005944 | dt: 2598.77 ms | tokens/sec: 201_744.345879 | norm: 6.70
step : 337 | loss: 0.838374674320221 | lr: 0.0005943 | dt: 2594.02 ms | tokens/sec: 202_114.213226 | norm: 4.92
step : 338 | loss: 0.8428434133529663 | lr: 0.0005943 | dt: 2588.17 ms | tokens/sec: 202_570.905797 | norm: 7.32
step : 339 | loss: 0.8038021922111511 | lr: 0.0005943 | dt: 2597.50 ms | tokens/sec: 201_843.100412 | norm: 5.04
step : 340 | loss: 0.8079288005828857 | lr: 0.0005942 | dt: 2586.04 ms | tokens/sec: 202_737.775111 | norm: 4.40
step : 341 | loss: 0.7477624416351318 | lr: 0.0005942 | dt: 2592.88 ms | tokens/sec: 202_203.326817 | norm: 4.66
step : 342 | loss: 0.790377140045166 | lr: 0.0005942 | dt: 2586.12 ms | tokens/sec: 202_731.775381 | norm: 6.40
step : 343 | loss: 0.7134963274002075 | lr: 0.0005941 | dt: 2596.86 ms | tokens/sec: 201_892.708569 | norm: 2.86
step : 344 | loss: 0.7982435822486877 | lr: 0.0005941 | dt: 2591.80 ms | tokens/sec: 202_287.382989 | norm: 6.80
step : 345 | loss: 0.7658934593200684 | lr: 0.0005941 | dt: 2600.27 ms | tokens/sec: 201_628.068050 | norm: 5.30
step : 346 | loss: 0.7077600359916687 | lr: 0.0005940 | dt: 2592.71 ms | tokens/sec: 202_216.063745 | norm: 2.98
step : 347 | loss: 0.7318670153617859 | lr: 0.0005940 | dt: 2596.30 ms | tokens/sec: 201_936.388373 | norm: 5.41
step : 348 | loss: 0.6812385320663452 | lr: 0.0005939 | dt: 2594.73 ms | tokens/sec: 202_058.796150 | norm: 4.24
step : 349 | loss: 0.6680327653884888 | lr: 0.0005939 | dt: 2597.36 ms | tokens/sec: 201_854.031755 | norm: 3.28
step : 350 | loss: 0.6890226602554321 | lr: 0.0005939 | dt: 2590.30 ms | tokens/sec: 202_404.571769 | norm: 5.53
step : 351 | loss: 0.6309205293655396 | lr: 0.0005938 | dt: 2597.05 ms | tokens/sec: 201_878.159011 | norm: 4.69
step : 352 | loss: 0.6485025882720947 | lr: 0.0005938 | dt: 2590.94 ms | tokens/sec: 202_354.730399 | norm: 3.15
step : 353 | loss: 0.6121548414230347 | lr: 0.0005938 | dt: 2595.74 ms | tokens/sec: 201_979.790253 | norm: 4.80
step : 354 | loss: 0.6475843787193298 | lr: 0.0005937 | dt: 2590.97 ms | tokens/sec: 202_351.695264 | norm: 4.16
step : 355 | loss: 0.6463055610656738 | lr: 0.0005937 | dt: 2594.99 ms | tokens/sec: 202_038.338143 | norm: 5.30
step : 356 | loss: 0.6270150542259216 | lr: 0.0005937 | dt: 2595.38 ms | tokens/sec: 202_008.067152 | norm: 3.96
step : 357 | loss: 0.5885210037231445 | lr: 0.0005936 | dt: 2596.36 ms | tokens/sec: 201_931.975039 | norm: 6.44
step : 358 | loss: 0.5737123489379883 | lr: 0.0005936 | dt: 2598.46 ms | tokens/sec: 201_768.650562 | norm: 3.96
step : 359 | loss: 0.5422627925872803 | lr: 0.0005935 | dt: 2601.46 ms | tokens/sec: 201_535.932776 | norm: 4.67
step : 360 | loss: 0.5518917441368103 | lr: 0.0005935 | dt: 2593.22 ms | tokens/sec: 202_176.314964 | norm: 5.27
step : 361 | loss: 0.5397058129310608 | lr: 0.0005935 | dt: 2600.53 ms | tokens/sec: 201_608.048353 | norm: 3.65
step : 362 | loss: 0.49010953307151794 | lr: 0.0005934 | dt: 2592.01 ms | tokens/sec: 202_270.748496 | norm: 2.50
step : 363 | loss: 0.5055921077728271 | lr: 0.0005934 | dt: 2599.44 ms | tokens/sec: 201_692.479688 | norm: 5.37
step : 364 | loss: 0.4764949083328247 | lr: 0.0005934 | dt: 2587.51 ms | tokens/sec: 202_622.571358 | norm: 3.41
step : 365 | loss: 0.45848003029823303 | lr: 0.0005933 | dt: 2600.92 ms | tokens/sec: 201_578.109413 | norm: 4.98
step : 366 | loss: 0.4424855709075928 | lr: 0.0005933 | dt: 2591.22 ms | tokens/sec: 202_332.183197 | norm: 3.07
step : 367 | loss: 0.429345965385437 | lr: 0.0005932 | dt: 2596.26 ms | tokens/sec: 201_939.837584 | norm: 3.32
step : 368 | loss: 0.43690425157546997 | lr: 0.0005932 | dt: 2594.64 ms | tokens/sec: 202_066.167245 | norm: 4.29
step : 369 | loss: 0.4001367390155792 | lr: 0.0005932 | dt: 2597.69 ms | tokens/sec: 201_828.261619 | norm: 3.81
step : 370 | loss: 0.40532365441322327 | lr: 0.0005931 | dt: 2593.04 ms | tokens/sec: 202_190.163911 | norm: 2.97
step : 371 | loss: 0.37212878465652466 | lr: 0.0005931 | dt: 2594.41 ms | tokens/sec: 202_083.436653 | norm: 3.87
step : 372 | loss: 0.3476347327232361 | lr: 0.0005931 | dt: 2595.04 ms | tokens/sec: 202_034.291587 | norm: 1.98
step : 373 | loss: 0.3758545517921448 | lr: 0.0005930 | dt: 2600.44 ms | tokens/sec: 201_615.035386 | norm: 4.45
step : 374 | loss: 0.3528410792350769 | lr: 0.0005930 | dt: 2587.41 ms | tokens/sec: 202_630.506447 | norm: 3.22
step : 375 | loss: 0.32158929109573364 | lr: 0.0005929 | dt: 2595.83 ms | tokens/sec: 201_973.297332 | norm: 2.80
step : 376 | loss: 0.34065985679626465 | lr: 0.0005929 | dt: 2583.85 ms | tokens/sec: 202_909.881058 | norm: 3.04
step : 377 | loss: 0.3291410207748413 | lr: 0.0005929 | dt: 2592.86 ms | tokens/sec: 202_204.609734 | norm: 5.13
step : 378 | loss: 0.3426330089569092 | lr: 0.0005928 | dt: 2594.51 ms | tokens/sec: 202_075.730047 | norm: 2.15
step : 379 | loss: 0.35957467555999756 | lr: 0.0005928 | dt: 2594.31 ms | tokens/sec: 202_091.385287 | norm: 3.78
step : 380 | loss: 0.308927446603775 | lr: 0.0005927 | dt: 2594.16 ms | tokens/sec: 202_103.439431 | norm: 3.15
step : 381 | loss: 0.31005874276161194 | lr: 0.0005927 | dt: 2595.94 ms | tokens/sec: 201_964.653120 | norm: 5.11
step : 382 | loss: 0.29712408781051636 | lr: 0.0005927 | dt: 2591.57 ms | tokens/sec: 202_305.304414 | norm: 2.88
step : 383 | loss: 0.2840920090675354 | lr: 0.0005926 | dt: 2594.04 ms | tokens/sec: 202_112.281289 | norm: 3.23
step : 384 | loss: 0.281818687915802 | lr: 0.0005926 | dt: 2598.28 ms | tokens/sec: 201_783.017698 | norm: 2.80
step : 385 | loss: 0.28309065103530884 | lr: 0.0005925 | dt: 2596.43 ms | tokens/sec: 201_926.875839 | norm: 2.65
step : 386 | loss: 0.3086142838001251 | lr: 0.0005925 | dt: 2603.47 ms | tokens/sec: 201_380.255708 | norm: 2.74
step : 387 | loss: 0.2415660321712494 | lr: 0.0005925 | dt: 2600.28 ms | tokens/sec: 201_627.476460 | norm: 2.72
step : 388 | loss: 0.2680663764476776 | lr: 0.0005924 | dt: 2596.90 ms | tokens/sec: 201_889.576067 | norm: 2.36
step : 389 | loss: 0.24780452251434326 | lr: 0.0005924 | dt: 2599.30 ms | tokens/sec: 201_703.468727 | norm: 2.69
step : 390 | loss: 0.28219616413116455 | lr: 0.0005924 | dt: 2596.15 ms | tokens/sec: 201_948.498218 | norm: 6.29
step : 391 | loss: 0.2328397035598755 | lr: 0.0005923 | dt: 2596.00 ms | tokens/sec: 201_960.108713 | norm: 1.94
step : 392 | loss: 0.30209654569625854 | lr: 0.0005923 | dt: 2591.01 ms | tokens/sec: 202_349.013994 | norm: 6.63
step : 393 | loss: 0.26879823207855225 | lr: 0.0005922 | dt: 2596.05 ms | tokens/sec: 201_956.009648 | norm: 2.85
step : 394 | loss: 0.27214428782463074 | lr: 0.0005922 | dt: 2591.42 ms | tokens/sec: 202_317.123498 | norm: 7.07
step : 395 | loss: 0.26682138442993164 | lr: 0.0005921 | dt: 2598.54 ms | tokens/sec: 201_762.300792 | norm: 3.73
step : 396 | loss: 0.26985108852386475 | lr: 0.0005921 | dt: 2595.73 ms | tokens/sec: 201_980.717847 | norm: 5.72
step : 397 | loss: 0.24581456184387207 | lr: 0.0005921 | dt: 2603.84 ms | tokens/sec: 201_351.582750 | norm: 2.40
step : 398 | loss: 0.2300029695034027 | lr: 0.0005920 | dt: 2596.52 ms | tokens/sec: 201_919.830095 | norm: 4.96
step : 399 | loss: 0.23101985454559326 | lr: 0.0005920 | dt: 2598.93 ms | tokens/sec: 201_732.056935 | norm: 2.97
step : 400 | loss: 0.19606922566890717 | lr: 0.0005919 | dt: 2596.33 ms | tokens/sec: 201_934.441291 | norm: 2.87
step : 401 | loss: 0.19539684057235718 | lr: 0.0005919 | dt: 2602.44 ms | tokens/sec: 201_460.361975 | norm: 2.77
step : 402 | loss: 0.17403893172740936 | lr: 0.0005919 | dt: 2598.28 ms | tokens/sec: 201_782.517776 | norm: 2.87
step : 403 | loss: 0.1999548375606537 | lr: 0.0005918 | dt: 2597.81 ms | tokens/sec: 201_818.944491 | norm: 5.16
step : 404 | loss: 0.1697479784488678 | lr: 0.0005918 | dt: 2599.73 ms | tokens/sec: 201_669.968849 | norm: 2.33
step : 405 | loss: 0.15667660534381866 | lr: 0.0005917 | dt: 2598.33 ms | tokens/sec: 201_778.574035 | norm: 3.37
step : 406 | loss: 0.15544822812080383 | lr: 0.0005917 | dt: 2595.67 ms | tokens/sec: 201_985.355946 | norm: 2.75
step : 407 | loss: 0.14426670968532562 | lr: 0.0005917 | dt: 2593.60 ms | tokens/sec: 202_146.634418 | norm: 2.52
step : 408 | loss: 0.13865068554878235 | lr: 0.0005916 | dt: 2594.23 ms | tokens/sec: 202_097.402892 | norm: 2.80
step : 409 | loss: 0.12682628631591797 | lr: 0.0005916 | dt: 2597.55 ms | tokens/sec: 201_839.321037 | norm: 2.18
step : 410 | loss: 0.13681893050670624 | lr: 0.0005915 | dt: 2594.20 ms | tokens/sec: 202_099.854612 | norm: 1.29
step : 411 | loss: 0.1587476134300232 | lr: 0.0005915 | dt: 2603.70 ms | tokens/sec: 201_362.313409 | norm: 1.56
step : 412 | loss: 0.15183225274085999 | lr: 0.0005914 | dt: 2594.44 ms | tokens/sec: 202_081.523874 | norm: 3.89
step : 413 | loss: 0.1609753668308258 | lr: 0.0005914 | dt: 2597.58 ms | tokens/sec: 201_836.894160 | norm: 1.69
step : 414 | loss: 0.1726556420326233 | lr: 0.0005914 | dt: 2589.41 ms | tokens/sec: 202_473.824210 | norm: 4.22
step : 415 | loss: 0.16379094123840332 | lr: 0.0005913 | dt: 2598.34 ms | tokens/sec: 201_777.981562 | norm: 1.83
step : 416 | loss: 0.17979949712753296 | lr: 0.0005913 | dt: 2592.16 ms | tokens/sec: 202_259.306893 | norm: 3.28
step : 417 | loss: 0.14952588081359863 | lr: 0.0005912 | dt: 2600.73 ms | tokens/sec: 201_592.911444 | norm: 2.27
step : 418 | loss: 0.15135899186134338 | lr: 0.0005912 | dt: 2595.22 ms | tokens/sec: 202_020.426865 | norm: 2.33
step : 419 | loss: 0.19551126658916473 | lr: 0.0005911 | dt: 2594.50 ms | tokens/sec: 202_076.695662 | norm: 2.23
step : 420 | loss: 0.13621072471141815 | lr: 0.0005911 | dt: 2591.81 ms | tokens/sec: 202_286.713091 | norm: 2.14
step : 421 | loss: 0.15207919478416443 | lr: 0.0005911 | dt: 2598.45 ms | tokens/sec: 201_769.724324 | norm: 2.04
step : 422 | loss: 0.14448605477809906 | lr: 0.0005910 | dt: 2593.94 ms | tokens/sec: 202_120.250769 | norm: 2.03
step : 423 | loss: 0.12491337954998016 | lr: 0.0005910 | dt: 2604.34 ms | tokens/sec: 201_313.297262 | norm: 1.28
step : 424 | loss: 0.1548992544412613 | lr: 0.0005909 | dt: 2599.16 ms | tokens/sec: 201_714.384950 | norm: 1.49
step : 425 | loss: 0.1350148469209671 | lr: 0.0005909 | dt: 2600.47 ms | tokens/sec: 201_612.724805 | norm: 3.11
step : 426 | loss: 0.11933467537164688 | lr: 0.0005908 | dt: 2593.32 ms | tokens/sec: 202_168.619860 | norm: 1.51
step : 427 | loss: 0.12042402476072311 | lr: 0.0005908 | dt: 2598.73 ms | tokens/sec: 201_747.436858 | norm: 3.62
step : 428 | loss: 0.13310275971889496 | lr: 0.0005907 | dt: 2595.86 ms | tokens/sec: 201_970.978533 | norm: 4.31
step : 429 | loss: 0.11109401285648346 | lr: 0.0005907 | dt: 2596.56 ms | tokens/sec: 201_916.159086 | norm: 1.23
step : 430 | loss: 0.11986735463142395 | lr: 0.0005907 | dt: 2597.32 ms | tokens/sec: 201_857.366977 | norm: 3.41
step : 431 | loss: 0.10512596368789673 | lr: 0.0005906 | dt: 2599.28 ms | tokens/sec: 201_705.374355 | norm: 1.93
step : 432 | loss: 0.08933287858963013 | lr: 0.0005906 | dt: 2593.55 ms | tokens/sec: 202_150.573977 | norm: 1.97
step : 433 | loss: 0.0928330197930336 | lr: 0.0005905 | dt: 2594.57 ms | tokens/sec: 202_071.347758 | norm: 2.57
step : 434 | loss: 0.08218275010585785 | lr: 0.0005905 | dt: 2587.59 ms | tokens/sec: 202_616.242404 | norm: 1.80
step : 435 | loss: 0.08177435398101807 | lr: 0.0005904 | dt: 2599.19 ms | tokens/sec: 201_712.423643 | norm: 2.04
step : 436 | loss: 0.08061564713716507 | lr: 0.0005904 | dt: 2596.20 ms | tokens/sec: 201_944.288352 | norm: 1.90
step : 437 | loss: 0.12894821166992188 | lr: 0.0005903 | dt: 2594.80 ms | tokens/sec: 202_053.244974 | norm: 4.32
step : 438 | loss: 0.09034420549869537 | lr: 0.0005903 | dt: 2596.24 ms | tokens/sec: 201_941.321152 | norm: 2.05
step : 439 | loss: 0.09028205275535583 | lr: 0.0005903 | dt: 2600.64 ms | tokens/sec: 201_599.712607 | norm: 2.71
step : 440 | loss: 0.09265841543674469 | lr: 0.0005902 | dt: 2594.50 ms | tokens/sec: 202_076.955637 | norm: 2.10
step : 441 | loss: 0.07730439305305481 | lr: 0.0005902 | dt: 2598.44 ms | tokens/sec: 201_770.076076 | norm: 1.62
step : 442 | loss: 0.07675237208604813 | lr: 0.0005901 | dt: 2593.92 ms | tokens/sec: 202_121.551210 | norm: 1.81
step : 443 | loss: 0.08202353119850159 | lr: 0.0005901 | dt: 2595.13 ms | tokens/sec: 202_027.702359 | norm: 0.99
step : 444 | loss: 0.08393818885087967 | lr: 0.0005900 | dt: 2597.60 ms | tokens/sec: 201_835.912310 | norm: 1.41
step : 445 | loss: 0.06693793833255768 | lr: 0.0005900 | dt: 2597.29 ms | tokens/sec: 201_859.609049 | norm: 1.56
step : 446 | loss: 0.07749044895172119 | lr: 0.0005899 | dt: 2598.85 ms | tokens/sec: 201_738.552862 | norm: 1.92
step : 447 | loss: 0.054441679269075394 | lr: 0.0005899 | dt: 2598.77 ms | tokens/sec: 201_745.012190 | norm: 0.53
step : 448 | loss: 0.057876721024513245 | lr: 0.0005898 | dt: 2593.32 ms | tokens/sec: 202_168.452581 | norm: 0.85
step : 449 | loss: 0.055205635726451874 | lr: 0.0005898 | dt: 2599.79 ms | tokens/sec: 201_665.141788 | norm: 0.79
step : 450 | loss: 0.043889328837394714 | lr: 0.0005898 | dt: 2590.33 ms | tokens/sec: 202_401.963614 | norm: 0.57
step : 451 | loss: 0.04680836945772171 | lr: 0.0005897 | dt: 2598.29 ms | tokens/sec: 201_782.054888 | norm: 0.63
step : 452 | loss: 0.06332458555698395 | lr: 0.0005897 | dt: 2593.38 ms | tokens/sec: 202_163.806070 | norm: 0.74
step : 453 | loss: 0.07100360095500946 | lr: 0.0005896 | dt: 2595.38 ms | tokens/sec: 202_008.326950 | norm: 0.99
step : 454 | loss: 0.07269195467233658 | lr: 0.0005896 | dt: 2594.86 ms | tokens/sec: 202_048.789402 | norm: 3.02
step : 455 | loss: 0.06880068778991699 | lr: 0.0005895 | dt: 2602.79 ms | tokens/sec: 201_432.828638 | norm: 2.21
step : 456 | loss: 0.0678732842206955 | lr: 0.0005895 | dt: 2594.38 ms | tokens/sec: 202_086.240889 | norm: 1.94
step : 457 | loss: 0.06371663510799408 | lr: 0.0005894 | dt: 2594.66 ms | tokens/sec: 202_064.217659 | norm: 1.58
step : 458 | loss: 0.05514632165431976 | lr: 0.0005894 | dt: 2597.16 ms | tokens/sec: 201_869.504409 | norm: 1.29
step : 459 | loss: 0.051972683519124985 | lr: 0.0005893 | dt: 2595.25 ms | tokens/sec: 202_018.645191 | norm: 1.60
step : 460 | loss: 0.040620483458042145 | lr: 0.0005893 | dt: 2588.13 ms | tokens/sec: 202_573.854206 | norm: 1.38
step : 461 | loss: 0.04122786968946457 | lr: 0.0005892 | dt: 2596.55 ms | tokens/sec: 201_917.475442 | norm: 1.22
step : 462 | loss: 0.036698512732982635 | lr: 0.0005892 | dt: 2595.45 ms | tokens/sec: 202_002.370315 | norm: 1.17
step : 463 | loss: 0.03868125379085541 | lr: 0.0005891 | dt: 2595.37 ms | tokens/sec: 202_008.716648 | norm: 1.24
step : 464 | loss: 0.03542671352624893 | lr: 0.0005891 | dt: 2586.09 ms | tokens/sec: 202_733.999538 | norm: 0.99
step : 465 | loss: 0.05892445147037506 | lr: 0.0005890 | dt: 2590.52 ms | tokens/sec: 202_387.210180 | norm: 3.40
step : 466 | loss: 0.045317213982343674 | lr: 0.0005890 | dt: 2584.93 ms | tokens/sec: 202_824.745644 | norm: 0.78
step : 467 | loss: 0.043520838022232056 | lr: 0.0005889 | dt: 2597.59 ms | tokens/sec: 201_836.468073 | norm: 1.56
step : 468 | loss: 0.0415109321475029 | lr: 0.0005889 | dt: 2589.77 ms | tokens/sec: 202_445.603152 | norm: 1.74
step : 469 | loss: 0.03121921420097351 | lr: 0.0005889 | dt: 2597.23 ms | tokens/sec: 201_864.426893 | norm: 0.83
step : 470 | loss: 0.0402548685669899 | lr: 0.0005888 | dt: 2596.49 ms | tokens/sec: 201_922.055013 | norm: 0.91
step : 471 | loss: 0.04374852031469345 | lr: 0.0005888 | dt: 2594.37 ms | tokens/sec: 202_086.723746 | norm: 1.45
step : 472 | loss: 0.04570966958999634 | lr: 0.0005887 | dt: 2591.17 ms | tokens/sec: 202_336.241695 | norm: 1.94
step : 473 | loss: 0.040244393050670624 | lr: 0.0005887 | dt: 2598.93 ms | tokens/sec: 201_732.519594 | norm: 1.21
step : 474 | loss: 0.03462972491979599 | lr: 0.0005886 | dt: 2599.91 ms | tokens/sec: 201_655.913683 | norm: 1.12
step : 475 | loss: 0.044749628752470016 | lr: 0.0005886 | dt: 2598.39 ms | tokens/sec: 201_774.075026 | norm: 2.16
step : 476 | loss: 0.0442204587161541 | lr: 0.0005885 | dt: 2599.86 ms | tokens/sec: 201_660.296465 | norm: 1.61
step : 477 | loss: 0.04064483195543289 | lr: 0.0005885 | dt: 2600.09 ms | tokens/sec: 201_642.137823 | norm: 0.77
step : 478 | loss: 0.03554167598485947 | lr: 0.0005884 | dt: 2597.61 ms | tokens/sec: 201_835.004571 | norm: 1.00
step : 479 | loss: 0.04068676382303238 | lr: 0.0005884 | dt: 2594.78 ms | tokens/sec: 202_054.563119 | norm: 2.30
step : 480 | loss: 0.0519314780831337 | lr: 0.0005883 | dt: 2593.06 ms | tokens/sec: 202_189.048490 | norm: 2.91
step : 481 | loss: 0.03323544189333916 | lr: 0.0005883 | dt: 2596.82 ms | tokens/sec: 201_895.878242 | norm: 0.75
step : 482 | loss: 0.031232329085469246 | lr: 0.0005882 | dt: 2591.15 ms | tokens/sec: 202_337.973122 | norm: 1.11
step : 483 | loss: 0.0348978191614151 | lr: 0.0005882 | dt: 2602.96 ms | tokens/sec: 201_419.728955 | norm: 1.98
step : 484 | loss: 0.028079573065042496 | lr: 0.0005881 | dt: 2594.33 ms | tokens/sec: 202_089.936657 | norm: 1.04
step : 485 | loss: 0.032448649406433105 | lr: 0.0005881 | dt: 2601.30 ms | tokens/sec: 201_548.216308 | norm: 1.64
step : 486 | loss: 0.02625589445233345 | lr: 0.0005880 | dt: 2593.92 ms | tokens/sec: 202_121.829878 | norm: 1.18
step : 487 | loss: 0.02505846507847309 | lr: 0.0005880 | dt: 2600.68 ms | tokens/sec: 201_596.515264 | norm: 1.14
step : 488 | loss: 0.02385137416422367 | lr: 0.0005879 | dt: 2595.04 ms | tokens/sec: 202_034.699947 | norm: 0.81
step : 489 | loss: 0.01913849636912346 | lr: 0.0005879 | dt: 2601.43 ms | tokens/sec: 201_538.038418 | norm: 0.82
step : 490 | loss: 0.026632115244865417 | lr: 0.0005878 | dt: 2593.01 ms | tokens/sec: 202_192.487746 | norm: 1.03
step : 491 | loss: 0.028201108798384666 | lr: 0.0005878 | dt: 2598.89 ms | tokens/sec: 201_735.314100 | norm: 1.39
step : 492 | loss: 0.027125686407089233 | lr: 0.0005877 | dt: 2593.84 ms | tokens/sec: 202_127.960771 | norm: 1.92
step : 493 | loss: 0.02517850697040558 | lr: 0.0005877 | dt: 2598.96 ms | tokens/sec: 201_730.002755 | norm: 0.98
step : 494 | loss: 0.02493099495768547 | lr: 0.0005876 | dt: 2591.52 ms | tokens/sec: 202_308.933750 | norm: 1.32
step : 495 | loss: 0.0482296422123909 | lr: 0.0005876 | dt: 2592.75 ms | tokens/sec: 202_212.716659 | norm: 2.19
step : 496 | loss: 0.03802892193198204 | lr: 0.0005875 | dt: 2588.66 ms | tokens/sec: 202_532.845438 | norm: 3.08
step : 497 | loss: 0.03338159993290901 | lr: 0.0005875 | dt: 2594.70 ms | tokens/sec: 202_060.949865 | norm: 1.27
step : 498 | loss: 0.10629738867282867 | lr: 0.0005874 | dt: 2587.85 ms | tokens/sec: 202_595.876683 | norm: 6.81
step : 499 | loss: 0.1275542825460434 | lr: 0.0005874 | dt: 2600.96 ms | tokens/sec: 201_574.838845 | norm: 4.30
step : 500 | loss: 0.09500702470541 | lr: 0.0005873 | dt: 2592.32 ms | tokens/sec: 202_246.676122 | norm: 4.97
step : 501 | loss: 0.13337558507919312 | lr: 0.0005873 | dt: 2597.97 ms | tokens/sec: 201_807.016859 | norm: 3.47
step : 502 | loss: 0.3196198642253876 | lr: 0.0005872 | dt: 2593.53 ms | tokens/sec: 202_152.339395 | norm: 1.53
step : 503 | loss: 0.2168707400560379 | lr: 0.0005872 | dt: 2601.15 ms | tokens/sec: 201_560.094892 | norm: 2.37
step : 504 | loss: 0.2988125681877136 | lr: 0.0005871 | dt: 2595.47 ms | tokens/sec: 202_001.071407 | norm: 1.11
step : 505 | loss: 0.23951131105422974 | lr: 0.0005870 | dt: 2595.66 ms | tokens/sec: 201_986.413462 | norm: 1.18
step : 506 | loss: 0.1779007911682129 | lr: 0.0005870 | dt: 2591.81 ms | tokens/sec: 202_286.247887 | norm: 0.73
step : 507 | loss: 0.14323629438877106 | lr: 0.0005869 | dt: 2598.08 ms | tokens/sec: 201_798.146134 | norm: 0.63
step : 508 | loss: 0.1016584038734436 | lr: 0.0005869 | dt: 2592.51 ms | tokens/sec: 202_232.001110 | norm: 0.54
step : 509 | loss: 0.07855097204446793 | lr: 0.0005868 | dt: 2597.19 ms | tokens/sec: 201_867.299179 | norm: 0.43
step : 510 | loss: 0.09675797820091248 | lr: 0.0005868 | dt: 2591.46 ms | tokens/sec: 202_313.493869 | norm: 0.42
step : 511 | loss: 0.07764433324337006 | lr: 0.0005867 | dt: 2596.15 ms | tokens/sec: 201_948.145844 | norm: 0.25
step : 512 | loss: 0.06630370765924454 | lr: 0.0005867 | dt: 2596.83 ms | tokens/sec: 201_895.285079 | norm: 0.28
step : 513 | loss: 0.07336105406284332 | lr: 0.0005866 | dt: 2594.22 ms | tokens/sec: 202_098.238699 | norm: 0.21
step : 514 | loss: 0.051763586699962616 | lr: 0.0005866 | dt: 2597.29 ms | tokens/sec: 201_859.627579 | norm: 0.18
step : 515 | loss: 0.05261640250682831 | lr: 0.0005865 | dt: 2593.18 ms | tokens/sec: 202_179.177544 | norm: 0.17
step : 516 | loss: 0.039415787905454636 | lr: 0.0005865 | dt: 2590.20 ms | tokens/sec: 202_412.433897 | norm: 0.16
step : 517 | loss: 0.03485848009586334 | lr: 0.0005864 | dt: 2595.40 ms | tokens/sec: 202_006.582603 | norm: 0.12
step : 518 | loss: 0.026870960369706154 | lr: 0.0005864 | dt: 2599.14 ms | tokens/sec: 201_715.717180 | norm: 0.11
step : 519 | loss: 0.0236201249063015 | lr: 0.0005863 | dt: 2596.91 ms | tokens/sec: 201_889.483391 | norm: 0.08
step : 520 | loss: 0.018498027697205544 | lr: 0.0005863 | dt: 2587.56 ms | tokens/sec: 202_618.874753 | norm: 0.07
step : 521 | loss: 0.017501626163721085 | lr: 0.0005862 | dt: 2592.32 ms | tokens/sec: 202_246.583118 | norm: 0.06
step : 522 | loss: 0.014117268845438957 | lr: 0.0005861 | dt: 2587.41 ms | tokens/sec: 202_630.730505 | norm: 0.05
step : 523 | loss: 0.013225752860307693 | lr: 0.0005861 | dt: 2593.47 ms | tokens/sec: 202_157.059716 | norm: 0.04
step : 524 | loss: 0.011624007485806942 | lr: 0.0005860 | dt: 2586.15 ms | tokens/sec: 202_728.915821 | norm: 0.04
step : 525 | loss: 0.010548499412834644 | lr: 0.0005860 | dt: 2592.57 ms | tokens/sec: 202_226.923940 | norm: 0.03
step : 526 | loss: 0.009474247694015503 | lr: 0.0005859 | dt: 2593.72 ms | tokens/sec: 202_137.789554 | norm: 0.03
step : 527 | loss: 0.008470897562801838 | lr: 0.0005859 | dt: 2597.35 ms | tokens/sec: 201_854.643205 | norm: 0.03
step : 528 | loss: 0.00779859721660614 | lr: 0.0005858 | dt: 2594.11 ms | tokens/sec: 202_107.395881 | norm: 0.02
step : 529 | loss: 0.007066312711685896 | lr: 0.0005858 | dt: 2592.38 ms | tokens/sec: 202_242.267815 | norm: 0.02
step : 530 | loss: 0.00652817077934742 | lr: 0.0005857 | dt: 2592.96 ms | tokens/sec: 202_196.745150 | norm: 0.02
step : 531 | loss: 0.005966201424598694 | lr: 0.0005857 | dt: 2598.47 ms | tokens/sec: 201_768.298815 | norm: 0.02
step : 532 | loss: 0.005441849119961262 | lr: 0.0005856 | dt: 2595.15 ms | tokens/sec: 202_025.846316 | norm: 0.01
step : 533 | loss: 0.005069911479949951 | lr: 0.0005856 | dt: 2592.79 ms | tokens/sec: 202_209.760159 | norm: 0.01
step : 534 | loss: 0.004757179878652096 | lr: 0.0005855 | dt: 2591.47 ms | tokens/sec: 202_313.326350 | norm: 0.01
step : 535 | loss: 0.004449281841516495 | lr: 0.0005854 | dt: 2594.10 ms | tokens/sec: 202_107.823112 | norm: 0.01
step : 536 | loss: 0.0041360268369317055 | lr: 0.0005854 | dt: 2591.89 ms | tokens/sec: 202_280.144602 | norm: 0.01
step : 537 | loss: 0.003865534672513604 | lr: 0.0005853 | dt: 2595.25 ms | tokens/sec: 202_018.236896 | norm: 0.01
step : 538 | loss: 0.0036187204532325268 | lr: 0.0005853 | dt: 2592.29 ms | tokens/sec: 202_248.740838 | norm: 0.01
step : 539 | loss: 0.0034139056224375963 | lr: 0.0005852 | dt: 2591.71 ms | tokens/sec: 202_294.156654 | norm: 0.01
step : 540 | loss: 0.0032144428696483374 | lr: 0.0005852 | dt: 2590.80 ms | tokens/sec: 202_365.009569 | norm: 0.01
step : 541 | loss: 0.0030814800411462784 | lr: 0.0005851 | dt: 2592.02 ms | tokens/sec: 202_269.836841 | norm: 0.01
step : 542 | loss: 0.0028996411710977554 | lr: 0.0005851 | dt: 2586.63 ms | tokens/sec: 202_691.281819 | norm: 0.01
step : 543 | loss: 0.0027598277665674686 | lr: 0.0005850 | dt: 2595.62 ms | tokens/sec: 201_989.604631 | norm: 0.01
step : 544 | loss: 0.00262649729847908 | lr: 0.0005849 | dt: 2586.50 ms | tokens/sec: 202_701.613894 | norm: 0.01
step : 545 | loss: 0.0025116230826824903 | lr: 0.0005849 | dt: 2588.68 ms | tokens/sec: 202_530.756264 | norm: 0.01
step : 546 | loss: 0.0024549425579607487 | lr: 0.0005848 | dt: 2586.31 ms | tokens/sec: 202_716.786953 | norm: 0.01
step : 547 | loss: 0.0023001288063824177 | lr: 0.0005848 | dt: 2591.53 ms | tokens/sec: 202_308.338157 | norm: 0.00
step : 548 | loss: 0.0022519889753311872 | lr: 0.0005847 | dt: 2584.87 ms | tokens/sec: 202_829.460004 | norm: 0.01
step : 549 | loss: 0.0021597312297672033 | lr: 0.0005847 | dt: 2594.78 ms | tokens/sec: 202_054.581684 | norm: 0.01
step : 550 | loss: 0.0021029114723205566 | lr: 0.0005846 | dt: 2592.32 ms | tokens/sec: 202_246.490113 | norm: 0.01
step : 551 | loss: 0.002040090039372444 | lr: 0.0005845 | dt: 2595.21 ms | tokens/sec: 202_021.113560 | norm: 0.00
step : 552 | loss: 0.0019462128402665257 | lr: 0.0005845 | dt: 2592.79 ms | tokens/sec: 202_210.206418 | norm: 0.00
step : 553 | loss: 0.0019375868141651154 | lr: 0.0005844 | dt: 2607.92 ms | tokens/sec: 201_037.030698 | norm: 0.01
step : 554 | loss: 0.0018642314244061708 | lr: 0.0005844 | dt: 2605.23 ms | tokens/sec: 201_244.744200 | norm: 0.01
step : 555 | loss: 0.001828114385716617 | lr: 0.0005843 | dt: 2603.64 ms | tokens/sec: 201_367.402575 | norm: 0.01
step : 556 | loss: 0.0017719638999551535 | lr: 0.0005843 | dt: 2594.48 ms | tokens/sec: 202_078.478360 | norm: 0.00
step : 557 | loss: 0.0017205376643687487 | lr: 0.0005842 | dt: 2597.05 ms | tokens/sec: 201_878.196077 | norm: 0.00
step : 558 | loss: 0.001715025631710887 | lr: 0.0005841 | dt: 2595.44 ms | tokens/sec: 202_003.557903 | norm: 0.01
step : 559 | loss: 0.0016746128676459193 | lr: 0.0005841 | dt: 2595.76 ms | tokens/sec: 201_978.844116 | norm: 0.00
step : 560 | loss: 0.001623907475732267 | lr: 0.0005840 | dt: 2591.11 ms | tokens/sec: 202_341.063700 | norm: 0.01
step : 561 | loss: 0.0016056033782660961 | lr: 0.0005840 | dt: 2594.30 ms | tokens/sec: 202_092.611066 | norm: 0.00
step : 562 | loss: 0.0015743528492748737 | lr: 0.0005839 | dt: 2585.90 ms | tokens/sec: 202_748.579258 | norm: 0.00
step : 563 | loss: 0.0015654705930501223 | lr: 0.0005839 | dt: 2594.19 ms | tokens/sec: 202_100.839031 | norm: 0.01
step : 564 | loss: 0.001539346994832158 | lr: 0.0005838 | dt: 2590.87 ms | tokens/sec: 202_360.167801 | norm: 0.00
step : 565 | loss: 0.0014703243505209684 | lr: 0.0005837 | dt: 2594.04 ms | tokens/sec: 202_112.857151 | norm: 0.01
step : 566 | loss: 0.0014842760283499956 | lr: 0.0005837 | dt: 2595.01 ms | tokens/sec: 202_037.280083 | norm: 0.01
step : 567 | loss: 0.001441017142497003 | lr: 0.0005836 | dt: 2596.29 ms | tokens/sec: 201_937.111585 | norm: 0.00
step : 568 | loss: 0.0014753900468349457 | lr: 0.0005836 | dt: 2591.23 ms | tokens/sec: 202_331.941182 | norm: 0.01
step : 569 | loss: 0.001417702529579401 | lr: 0.0005835 | dt: 2592.64 ms | tokens/sec: 202_221.530889 | norm: 0.01
step : 570 | loss: 0.0013709962368011475 | lr: 0.0005835 | dt: 2590.70 ms | tokens/sec: 202_372.943120 | norm: 0.00
step : 571 | loss: 0.0014216495910659432 | lr: 0.0005834 | dt: 2587.59 ms | tokens/sec: 202_616.055715 | norm: 0.01
step : 572 | loss: 0.0013575560878962278 | lr: 0.0005833 | dt: 2591.34 ms | tokens/sec: 202_323.135940 | norm: 0.00
step : 573 | loss: 0.0013973452150821686 | lr: 0.0005833 | dt: 2590.45 ms | tokens/sec: 202_392.444422 | norm: 0.00
step : 574 | loss: 0.0013472947757691145 | lr: 0.0005832 | dt: 2588.57 ms | tokens/sec: 202_539.915374 | norm: 0.01
step : 575 | loss: 0.0013097987975925207 | lr: 0.0005832 | dt: 2601.73 ms | tokens/sec: 201_515.008041 | norm: 0.00
step : 576 | loss: 0.0013319618301466107 | lr: 0.0005831 | dt: 2591.06 ms | tokens/sec: 202_345.290125 | norm: 0.00
step : 577 | loss: 0.0013172063045203686 | lr: 0.0005830 | dt: 2597.93 ms | tokens/sec: 201_809.757867 | norm: 0.00
step : 578 | loss: 0.0012993209529668093 | lr: 0.0005830 | dt: 2594.96 ms | tokens/sec: 202_040.732741 | norm: 0.00
step : 579 | loss: 0.0012720380909740925 | lr: 0.0005829 | dt: 2596.87 ms | tokens/sec: 201_892.597354 | norm: 0.00
step : 580 | loss: 0.0012692541349679232 | lr: 0.0005829 | dt: 2592.85 ms | tokens/sec: 202_204.981597 | norm: 0.00
step : 581 | loss: 0.0012720073573291302 | lr: 0.0005828 | dt: 2595.27 ms | tokens/sec: 202_016.492378 | norm: 0.00
step : 582 | loss: 0.0012681165244430304 | lr: 0.0005827 | dt: 2590.42 ms | tokens/sec: 202_394.679769 | norm: 0.00
step : 583 | loss: 0.0012441750150173903 | lr: 0.0005827 | dt: 2597.29 ms | tokens/sec: 201_859.405223 | norm: 0.01
step : 584 | loss: 0.0012176837772130966 | lr: 0.0005826 | dt: 2592.71 ms | tokens/sec: 202_216.249697 | norm: 0.00
step : 585 | loss: 0.0012128750095143914 | lr: 0.0005826 | dt: 2598.18 ms | tokens/sec: 201_790.646442 | norm: 0.00
step : 586 | loss: 0.0012390718329697847 | lr: 0.0005825 | dt: 2587.17 ms | tokens/sec: 202_648.918245 | norm: 0.00
step : 587 | loss: 0.001198566285893321 | lr: 0.0005824 | dt: 2594.29 ms | tokens/sec: 202_092.741074 | norm: 0.00
step : 588 | loss: 0.0011921045370399952 | lr: 0.0005824 | dt: 2587.10 ms | tokens/sec: 202_654.913072 | norm: 0.00
step : 589 | loss: 0.001173824304714799 | lr: 0.0005823 | dt: 2590.91 ms | tokens/sec: 202_356.350416 | norm: 0.00
step : 590 | loss: 0.0011694973800331354 | lr: 0.0005823 | dt: 2584.48 ms | tokens/sec: 202_860.426819 | norm: 0.00
step : 591 | loss: 0.0012083936017006636 | lr: 0.0005822 | dt: 2592.23 ms | tokens/sec: 202_253.986523 | norm: 0.00
step : 592 | loss: 0.001133807934820652 | lr: 0.0005821 | dt: 2600.26 ms | tokens/sec: 201_629.417627 | norm: 0.00
step : 593 | loss: 0.0011642298195511103 | lr: 0.0005821 | dt: 2597.51 ms | tokens/sec: 201_842.581666 | norm: 0.00
step : 594 | loss: 0.0011395732872188091 | lr: 0.0005820 | dt: 2590.94 ms | tokens/sec: 202_354.451088 | norm: 0.00
step : 595 | loss: 0.0011362242512404919 | lr: 0.0005820 | dt: 2596.49 ms | tokens/sec: 201_922.147719 | norm: 0.00
step : 596 | loss: 0.0011596959084272385 | lr: 0.0005819 | dt: 2584.97 ms | tokens/sec: 202_821.846048 | norm: 0.00
step : 597 | loss: 0.0010997874196618795 | lr: 0.0005818 | dt: 2593.46 ms | tokens/sec: 202_157.673002 | norm: 0.00
step : 598 | loss: 0.0011478294618427753 | lr: 0.0005818 | dt: 2589.30 ms | tokens/sec: 202_482.512063 | norm: 0.00