Skip to content

Commit 4925790

Browse files
authored
typo & comment
- safe -> save - commenting code: batch_size, seq_len = in_idx.shape
1 parent e95c898 commit 4925790

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

ch05/07_gpt_to_llama/converting-gpt-to-llama2.ipynb

+2-2
Original file line numberDiff line numberDiff line change
@@ -648,7 +648,7 @@
648648
"\n",
649649
"mha(example_batch)\n",
650650
"\n",
651-
"del mha # delete to safe memory"
651+
"del mha # delete to save memory"
652652
]
653653
},
654654
{
@@ -781,7 +781,7 @@
781781
" self.out_head = nn.Linear(cfg[\"emb_dim\"], cfg[\"vocab_size\"], bias=False, dtype=cfg[\"dtype\"])\n",
782782
"\n",
783783
" def forward(self, in_idx):\n",
784-
" batch_size, seq_len = in_idx.shape\n",
784+
" # batch_size, seq_len = in_idx.shape\n",
785785
" tok_embeds = self.tok_emb(in_idx)\n",
786786
" # pos_embeds = self.pos_emb(torch.arange(seq_len, device=in_idx.device))\n",
787787
" x = tok_embeds # + pos_embeds # Shape [batch_size, num_tokens, emb_size]\n",

0 commit comments

Comments
 (0)