Datasets processed from MOSS for Fine-Tuning
Matthew Khoriaty
AMindToThink
AI & ML interests
None yet
Organizations
None yet
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 23 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 10 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 23 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 16 •
Datasets processed from MOSS for Fine-Tuning
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 23 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 10 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 23 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 16 •
models 124
AMindToThink/folder_structure_test
Updated
AMindToThink/ppo_with_value15
Updated
AMindToThink/ppo_with_value14
Updated
AMindToThink/ppo_push_main_13
Text Generation • 0.2B • Updated • 5
AMindToThink/ppo_push_main_12
0.2B • Updated • 3
AMindToThink/ppo_on_value_no_value11
0.2B • Updated • 2
AMindToThink/pushed_value_model
Text Classification • 0.1B • Updated • 7
AMindToThink/value_model_0
Text Classification • 0.1B • Updated • 5
AMindToThink/ppo
Text Generation • 0.2B • Updated • 14
AMindToThink/ppo9
0.2B • Updated • 2
datasets 8
AMindToThink/olmo-2-1124-7b-four-stage-samples-rlhf-diversity
Preview • Updated • 74
AMindToThink/moss-002-sft-data-instruction-output-ascii-only
Viewer • Updated • 1.75M • 10
AMindToThink/openthoughts-as-assistant-for-sft
Viewer • Updated • 114k • 26
AMindToThink/common_bugs
Viewer • Updated • 45 • 19
AMindToThink/moss-002-sft-data-instruction-output
Viewer • Updated • 3.53M • 27 • 1
AMindToThink/mmlu_wmdp_combined
Viewer • Updated • 4.74k • 8
AMindToThink/mmlu_wmdp_bio_combined
Viewer • Updated • 1.43k • 26
AMindToThink/wmdp-cyber-corpus_unpaired-preference
Viewer • Updated • 5.47k • 10