| LLM architecture | 6% | Encoder-decoder structures, transformer self-attention, embeddings, sampling. |
| Prompt engineering | 13% | Chain-of-thought, zero/one/few-shot, constrained decoding, prompt templates. |
| Data preparation | 9% | Cleaning, tokenization (BPE, WordPiece), dataset organization, vocabulary management. |
| Model optimization | 17% | Pruning, sparsity, quantization (PTQ, QAT, INT8, FP16), knowledge distillation, TensorRT, KV caching. |
| Fine-tuning | 13% | SFT, RLHF, DPO, GRPO, LoRA, adapters, P-tuning, contrastive learning, hallucination mitigation. |
| Evaluation | 7% | BLEU, ROUGE, perplexity, LLM-as-a-judge, error analysis, benchmarking. |
| GPU acceleration and optimization | 14% | DDP, FSDP, data/model/tensor/pipeline/expert parallelism, mixed precision, CUDA profiling, gradient accumulation. |
| Model deployment | 9% | Containerized pipelines, dynamic batching, NVIDIA Dynamo-Triton, NIM. |
| Production monitoring and reliability | 7% | Dashboards, logging, anomaly tracking, A/B benchmarking, automated retraining, versioning. |
| Safety, ethics and compliance | 5% | Bias auditing, guardrails, ethical compliance monitoring, responsible AI practices. |