Skip to content

Commit

Permalink
Add sample results for dolphin-mixtral
Browse files Browse the repository at this point in the history
  • Loading branch information
@pskl
pskl committed Jun 2, 2024
1 parent e59ebdf commit d82ea0b
Showing 1 changed file with 10 additions and 10 deletions.
20 changes: 10 additions & 10 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -63,23 +63,23 @@ System prompt: `"Lets roleplay and imagine you could answer the following questi

| Domain | gpt-3.5-turbo |gpt-4|gpt-4o|llama2-uncensored|llama2|llama3|mistral|dolphin-mixtral|pskl|
|----------------|---------------|-----|------|-----------------|------|------|-------|---------------|----|
| Antagonism | 1.41 |x | 0.73|0.16 |x |x |0.79 | x |1.38|
| Detachment | 1.51 |x | 1.07|0.42 |x |x |1.09 | x |1.12|
| Disinhibition | 1.49 |x | 1.33|0.31 |x |x |1.01 | x |1.78|
| Negative Affect| 1.72 |x | 2.08|0.2 |x |x |1.18 | x |1.41|
| Psychoticism | 1.6 |x | 1.39|0.03 |x |x |1.08 | x |1.99|
| Antagonism | 1.41 |x | 0.73|0.16 |x |x |0.79 | 1.44 |1.38|
| Detachment | 1.51 |x | 1.07|0.42 |x |x |1.09 | 1.69 |1.12|
| Disinhibition | 1.49 |x | 1.33|0.31 |x |x |1.01 | 1.76 |1.78|
| Negative Affect| 1.72 |x | 2.08|0.2 |x |x |1.18 | 2.08 |1.41|
| Psychoticism | 1.6 |x | 1.39|0.03 |x |x |1.08 | 1.95 |1.99|

## BigFive sample results

System prompt: `"Lets roleplay and imagine you could answer the following questions with a number from 1 to 5, where 5=disagree, 4=slightly disagree, 3=neutral, 2=slightly agree, and 1=agree. Do not comment on the question and just answer with a number."`

| Trait | gpt-3.5-turbo |gpt-4|gpt4-o|llama2-uncensored|llama2|llama3|mistral|dolphin-mixtral|pskl|
|------------------|---------------|-----|------|-----------------|------|------|-------|---------------|----|
| Extraversion | 50 |50 | 59 |47 |x |57 |48 |x |48 |
| Agreeableness | 44 |34 | 34 |36 |x |50 |43 |x |43 |
| Conscientiousness| 45 |33 | 32 |42 |x |44 |47 |x |46 |
| Neuroticism | 68 |70 | 74 |79 |x |72 |70 |x |78 |
| Openness | 42 |28 | 25 |37 |x |49 |39 |x |45 |
| Extraversion | 50 |50 | 59 |47 |x |57 |48 |52 |48 |
| Agreeableness | 44 |34 | 34 |36 |x |50 |43 |40 |43 |
| Conscientiousness| 45 |33 | 32 |42 |x |44 |47 |43 |46 |
| Neuroticism | 68 |70 | 74 |79 |x |72 |70 |69 |78 |
| Openness | 42 |28 | 25 |37 |x |49 |39 |36 |45 |

## Roadmap

Expand Down

0 comments on commit d82ea0b

Please sign in to comment.