Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training
Paper
• 2502.03460 • Published
Reading List
I add and I forget to read
-
-
Pruning as a Domain-specific LLM Extractor
Paper • 2405.06275 • Published • 1 -
LLM-Pruner: On the Structural Pruning of Large Language Models
Paper • 2305.11627 • Published • 3 -
KnowTuning: Knowledge-aware Fine-tuning for Large Language Models
Paper • 2402.11176 • Published • 2
LIMA: Less Is More for Alignment
Paper • 2305.11206 • Published • 27Note Read : Paper reference for dataset
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
Paper • 2402.12842 • PublishedNote Prompting and giving instructions for distillation
-
From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning
Paper • 2308.12032 • Published • 2
A Survey on Data Selection for LLM Instruction Tuning
Paper • 2402.05123 • Published • 3Note Done : read reference
-
Unpacking SDXL Turbo: Interpreting Text-to-Image Models with Sparse Autoencoders
Paper • 2410.22366 • Published • 84 -
Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2
Paper • 2408.05147 • Published • 41 -
Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
Paper • 2504.02821 • Published • 10 -
Scaling and evaluating sparse autoencoders
Paper • 2406.04093 • Published • 3 -
Decomposing The Dark Matter of Sparse Autoencoders
Paper • 2410.14670 • Published • 1 -
Test-Time Training on Video Streams
Paper • 2307.05014 • Published • 7 -
DisCO: Reinforcing Large Reasoning Models with Discriminative Constrained Optimization
Paper • 2505.12366 • Published -
Domain Randomization via Entropy Maximization
Paper • 2311.01885 • Published -
Efficient Estimation of Word Representations in Vector Space
Paper • 1301.3781 • Published • 8 -
TransCoder: Towards Unified Transferable Code Representation Learning Inspired by Human Skills
Paper • 2306.07285 • Published • 2 -
TWICE: What Advantages Can Low-Resource Domain-Specific Embedding Model Bring? - A Case Study on Korea Financial Texts
Paper • 2502.07131 • Published -
Knowledge Distillation of Large Language Models
Paper • 2306.08543 • Published • 22 -
Mentor-KD: Making Small Language Models Better Multi-step Reasoners
Paper • 2410.09037 • Published • 4 -
Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation
Paper • 2505.19529 • Published • 5 -
Domain2Vec: Vectorizing Datasets to Find the Optimal Data Mixture without Training
Paper • 2506.10952 • Published • 22 -
Resa: Transparent Reasoning Models via SAEs
Paper • 2506.09967 • Published • 21 -
LLM Unlearning Should Be Form-Independent
Paper • 2506.07795 • Published • 4 -
SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
Paper • 2402.09025 • Published • 10