DSIR large-scale data selection framework for language model training
-
Updated
Apr 7, 2024 - Python
#
data-selection
Here are 23 public repositories matching this topic...
🐂 🔥Official repository for the paper "LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning".
-
Updated
Jun 3, 2025 - Python
InstructionGPT-4
-
Updated
Dec 29, 2023 - Python
[ACL 2023] The code for our ACL'23 paper Cold-Start Data Selection for Few-shot Language Model Fine-tuning: A Prompt-Based Uncertainty Propagation Approach
nlp natural-language-processing cold-start language-model active-learning data-selection fine-tuning few-shot-learning prompt-learning acl2023
-
Updated
Jun 1, 2024 - Python
Code for ACL 2025 Main paper "Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning".
-
Updated
Jun 4, 2025 - Python
[ACL2025 Findings] Official code for MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Space
-
Updated
May 17, 2025 - Python
[ACL 2025 main] SCAR: Data Selection via Style Consistency-Aware Response Ranking for Efficient Instruction-Tuning of Large Language Models
-
Updated
Jun 24, 2025 - Python
This is an official repository for "Performance Scaling via Optimal Transport: Enabling Data Selection from Partially Revealed Sources" (NeurIPS 2023).
-
Updated
Oct 26, 2023 - Python
Enhancing Efficiency in Multidevice Federated Learning through Data Selection
machine-learning flower wearable-devices edge-computing data-selection wearable-computing federated-learning split-learning data-centric-ai data-centric-machine-learning
-
Updated
Apr 15, 2024 - Python
Keras sentence classification
theano deep-learning neural-network keras cnn recurrent-neural-networks lstm convolutional-neural-networks statistical-machine-translation data-selection
-
Updated
Apr 27, 2018 - Python
Dynamic Transfer Learning for Low-Resource Neural Machine Translation
multilingual transfer-learning nmt adaptation data-selection low-resource-languages zero-shot-translation pretraining dynamic-transfer-learning
-
Updated
Aug 4, 2020 - Python
A Python package for studying neural learning
-
Updated
Dec 18, 2024 - Python
Code for NeurIPS 2023 Paper (Imitation Learning from Imperfection: Theoretical Justifications and Algorithms)
-
Updated
Sep 22, 2023 - Python
An Approach to Enhancing the Efficacy of Post-Training Using Synthetic Data by Iterative Data Selection
-
Updated
Dec 24, 2024 - Python
CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay (CogSci 2024 Oral)
-
Updated
May 24, 2024 - Python
Code for Generative Deduplication For Socia Media Data Selection (Findings of EMNLP 2024)
-
Updated
Oct 8, 2024 - Python
This repository contains the data and code for the paper "Self-training with Two-phase Self-augmentation for Few-shot Dialogue Generation" (EMNLP2022-Findings).
transformers self-training uncertainty-estimation dialogue-generation data-selection few-shot-learning text-augmentation few-shot-generation
-
Updated
Dec 5, 2022 - Python
Official Repository for the Paper: Chasing Random: Instruction Selection Strategies Fail to Generalize
-
Updated
Jan 29, 2025 - Python
Quilt: Robust Data Segment Selection against Concept Drifts (AAAI 2024)
machine-learning artificial-intelligence concept-drift robustness data-selection responsible-ai model-robustness data-centric-ai distribution-shift robustness-ml robustness-ai
-
Updated
Dec 23, 2023 - Python
Improve this page
Add a description, image, and links to the data-selection topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-selection topic, visit your repo's landing page and select "manage topics."