Search results

suggestions for more examples

Status: Open.

#60 In LambdaLabsML/distributed-training-guide;

· daire-byrne opened on Nov 19, 2025

MPI instructions missing local rank?

Status: Open.

#59 In LambdaLabsML/distributed-training-guide;

· daire-byrne opened on Nov 18, 2025

FSDP: train_llm.py not outputting LOGGER.info messages?

Status: Open.

#58 In LambdaLabsML/distributed-training-guide;

· daire-byrne opened on Nov 18, 2025

FSDP: GPT2LMHeadModel object has no attribute model

Status: Open.

#57 In LambdaLabsML/distributed-training-guide;

· daire-byrne opened on Nov 16, 2025

Chapter 7 link in readme is broken

Status: Open.

#55 In LambdaLabsML/distributed-training-guide;

· fmokadem opened on Nov 5, 2025

Add guidance on DDP bucket_cap_mb for larger models & torch.compile

Status: Open.

#53 In LambdaLabsML/distributed-training-guide;

· chelsea0x3b opened on Oct 22, 2025

Optimizer Checkpointing with ZeRO

Status: Open.

#51 In LambdaLabsML/distributed-training-guide;

· kennethSty opened on Jul 31, 2025