lfm-3-1.7b:free vs lfm-2.5-2.6b:free
Scores
| Suite | lfm-3-1.7b:free | lfm-2.5-2.6b:free | Delta |
|---|---|---|---|
| IFEval-50 prompt | 83.7% | 87.8% | -4.1 pts |
| GSM8K-50 | 84.0% | 74.0% | 10.0 pts |
| SVG total | 10/50 | 68/200 | -58 |
beach
Sun low over water with a reflection path; distant objects smaller and hazier than near ones.
liquid/lfm-3-1.7b:free
unjudged
no svg
liquid/lfm-2.5-2.6b:free
15/50
clock
A clock is checkable to the minute: 10:10 means the hour hand just past 10, the minute hand on 2.
liquid/lfm-3-1.7b:free
unjudged
no svg
liquid/lfm-2.5-2.6b:free
unjudged
no svg
duo
Two characters mid-action, not posed: a dog driving a jet ski, a raccoon holding on.
liquid/lfm-3-1.7b:free
unjudged
no svg
liquid/lfm-2.5-2.6b:free
26/50
monalisa
Leonardo's portrait: three-quarter bust, folded hands, winding river landscape behind.
liquid/lfm-3-1.7b:free
unjudged
no svg
liquid/lfm-2.5-2.6b:free
11/50
pelican 10 vs 16
Everyone knows what a pelican looks like: large beak with throat pouch, long neck, webbed feet.
liquid/lfm-3-1.7b:free
10/50
liquid/lfm-2.5-2.6b:free
16/50