Skip to content

Commit

Permalink
Change the name of the Infinity-Instruct-7M-0729-Models to Infinity-I…
Browse files Browse the repository at this point in the history
…nstruct-7M-Gen-Models (#387)

* Change the name of the Infinity-Instruct-7M-0729-Models to Infinity-Instruct-7M-Gen-Models

* Delete Infinity-Instruct-7M-0729-Models

---------

Co-authored-by: Yuhui Zheng <cs.yuhuizheng@my.cityu.edu.hk>
  • Loading branch information
cszhengyh and Yuhui Zheng authored Aug 13, 2024
1 parent 1f8ac0f commit 5021996
Show file tree
Hide file tree
Showing 14 changed files with 4,856 additions and 4,856 deletions.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ yi-large-preview,57.46724251946292,1.4305696667082746,463,338,4,805,57.763975155
gpt4_1106_preview_verbose,64.30360147101865,1.3348590089025316,525,268,12,805,65.96273291925466,dev,2402,51.57500797967598,
Storm-7B,50.26886905528583,1.4728176780737183,397,408,0,805,49.31677018633541,community,2045,50.45110959343775,
gpt4_1106_preview,50.0,0.0,0,0,805,805,50.0,minimal,2049,50.0,
Infinity-Instruct-7M-0729-Llama3_1-70B,37.46327383827497,1.4734130373862548,299,501,5,805,37.453416149068325,community,1654,46.10043331712677,0.822439983375277
Infinity-Instruct-7M-Gen-Llama3_1-70B,37.46327383827497,1.4734130373862548,299,501,5,805,37.453416149068325,community,1654,46.10043331712677,0.822439983375277
Llama-3-Instruct-8B-SimPO-ExPO,40.63285400856655,1.4439449942168028,325,479,1,805,40.43478260869565,community,1765,45.78021783946177,
Llama-3-Instruct-8B-SimPO,40.52977498461182,1.422574464675002,319,485,1,805,39.68944099378882,community,1825,44.65131348921881,0.8800655791760451
Nanbeige-Plus-Chat-v0.1,56.70300973017392,1.482841874951873,456,347,2,805,56.77018633540373,community,2587,44.45966240337981,
Expand All @@ -26,7 +26,7 @@ gpt4_1106_preview_concise,22.92019444047205,1.232517714329424,172,622,11,805,22.
aligner-2b_claude-3-opus-20240229,34.46337362321739,1.314666526302454,225,475,105,805,34.47204968944099,community,1669,41.823071715247664,
Nanbeige2-16B-Chat,37.03608605005168,1.4340261272580377,288,514,3,805,35.962732919254655,community,1867,40.591286349562864,0.8504106275373426
claude-3-opus-20240229,29.10526953334248,1.3941539442369442,223,579,3,805,27.888198757763977,minimal,1388,40.5095080124761,
Infinity-Instruct-7M-0729-mistral-7B,34.347412485016434,1.412595625747994,263,541,1,805,32.732919254658384,community,1742,39.669499648314385,0.8048310993594987
Infinity-Instruct-7M-Gen-mistral-7B,34.347412485016434,1.412595625747994,263,541,1,805,32.732919254658384,community,1742,39.669499648314385,0.8048310993594987
Meta-Llama-3.1-405B-Instruct-Turbo,39.10666895419877,1.4335939943941904,305,497,3,805,38.07453416149068,minimal,1988,39.257327499617425,0.9064666759144326
SPPO-Llama-3-Instruct-8B-PairRM,39.67286090605648,1.424722356202499,310,494,1,805,38.57142857142858,community,2066,38.56280663670214,0.8694594533275739
gpt4,23.576789314782605,1.275704201206918,179,618,8,805,22.732919254658384,verified,1365,38.12808974440021,
Expand All @@ -39,7 +39,7 @@ Ein-70B-v0.1,24.84472049689441,1.521406431103307,199,604,2,805,24.84472049689441
claude-3-sonnet-20240229,25.556325292273296,1.3419811051815638,193,608,4,805,24.22360248447205,minimal,1420,34.87247436243302,
FsfairX-Zephyr-Chat-v0.1,35.94648644102434,1.4410058098036145,285,517,3,805,35.59006211180124,community,2275,34.78744762311656,
Meta-Llama-3-70B-Instruct,33.17785695886864,1.3886514096065603,266,537,2,805,33.16770186335404,minimal,1919,34.42459717459881,
Infinity-Instruct-7M-0729-Llama3_1-8B,28.525177213928405,1.3639196711615973,224,578,3,805,28.012422360248447,community,1640,33.918371039899895,0.8516395645308003
Infinity-Instruct-7M-Gen-Llama3_1-8B,28.525177213928405,1.3639196711615973,224,578,3,805,28.012422360248447,community,1640,33.918371039899895,0.8516395645308003
gpt4_0613_verbose,23.237360043453418,1.283539505582624,171,630,4,805,21.490683229813666,dev,1473,33.82126688658535,
mistral-large-2402,21.43877598137888,1.2485232545097724,166,638,1,805,20.6832298136646,verified,1362,32.65207998531868,
SPPO-Mistral7B-PairRM-ExPO,35.4431306716895,1.398130896602677,274,531,0,805,34.037267080745345,community,2288,31.822321960655582,
Expand Down

This file was deleted.

Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
Infinity-Instruct-7M-0729-Llama3_1-8B: # this should be the same as the name as the current directory
prompt_template: "Infinity-Instruct-7M-0729-Llama3_1-8B/prompt.txt" # what prompt should be used for this model
Infinity-Instruct-7M-Gen-Llama3_1-70B: # this should be the same as the name as the current directory
prompt_template: "Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt" # what prompt should be used for this model
fn_completions: "openai_completions" # what function should be used to generate completions. See `src/alpaca_eval/decoders` for options
completions_kwargs: # parameters to the completion function
model_name: "baai/Infinity-Instruct-7M-0729-Llama3_1-8B"
model_name: "baai/Infinity-Instruct-7M-Gen-Llama3_1-70B"
model_kwargs:
torch_dtype: 'bfloat16'
trust_remote_code: True
max_new_tokens: 2048
temperature: 0.7
do_sample: True
pretty_name: "Infinity-Instruct-7M-0729-Llama3_1-8B" # name in the leaderboard
link: "https://huggingface.co/BAAI/Infinity-Instruct-7M-0729-Llama3_1-8B" # link to the model's repo/information in the leaderboard
pretty_name: "Infinity-Instruct-7M-Gen-Llama3_1-70B" # name in the leaderboard
link: "https://huggingface.co/BAAI/Infinity-Instruct-7M-Gen-Llama3_1-70B" # link to the model's repo/information in the leaderboard
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
Infinity-Instruct-7M-0729-mistral-7B: # this should be the same as the name as the current directory
prompt_template: "Infinity-Instruct-7M-0729-mistral-7B/prompt.txt" # what prompt should be used for this model
Infinity-Instruct-7M-Gen-Llama3_1-8B: # this should be the same as the name as the current directory
prompt_template: "Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt" # what prompt should be used for this model
fn_completions: "openai_completions" # what function should be used to generate completions. See `src/alpaca_eval/decoders` for options
completions_kwargs: # parameters to the completion function
model_name: "baai/Infinity-Instruct-7M-0729-mistral-7B"
model_name: "baai/Infinity-Instruct-7M-Gen-Llama3_1-8B"
model_kwargs:
torch_dtype: 'bfloat16'
trust_remote_code: True
max_new_tokens: 2048
temperature: 0.7
do_sample: True
pretty_name: "Infinity-Instruct-7M-0729-mistral-7B" # name in the leaderboard
link: "https://huggingface.co/BAAI/Infinity-Instruct-7M-0729-mistral-7B" # link to the model's repo/information in the leaderboard
pretty_name: "Infinity-Instruct-7M-Gen-Llama3_1-8B" # name in the leaderboard
link: "https://huggingface.co/BAAI/Infinity-Instruct-7M-Gen-Llama3_1-8B" # link to the model's repo/information in the leaderboard
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
Infinity-Instruct-7M-Gen-mistral-7B: # this should be the same as the name as the current directory
prompt_template: "Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt" # what prompt should be used for this model
fn_completions: "openai_completions" # what function should be used to generate completions. See `src/alpaca_eval/decoders` for options
completions_kwargs: # parameters to the completion function
model_name: "baai/Infinity-Instruct-7M-Gen-mistral-7B"
model_kwargs:
torch_dtype: 'bfloat16'
trust_remote_code: True
max_new_tokens: 2048
temperature: 0.7
do_sample: True
pretty_name: "Infinity-Instruct-7M-Gen-mistral-7B" # name in the leaderboard
link: "https://huggingface.co/BAAI/Infinity-Instruct-7M-Gen-mistral-7B" # link to the model's repo/information in the leaderboard

0 comments on commit 5021996

Please sign in to comment.