Razan El Mais
@razan-el-mais · 1 works
Recent posts by Razan El Mais
- Is Weight Tying Still Beneficial for Decoder-Only LLMs in Private Settings Under DP-SGD? - Differentially Private Stochastic Gradient Descent (DP-SGD) is a leading approach for privacy-preserving fine-tuning of large language models (LLMs). Many decoder-only LLMs employ weight tying… · Paper · arxiv.org