1
Class I - Open Science
2024-06-17
Class I - Open Science
Class I - Open Science
Pass
Pass
Class II - Open Tooling
Class II - Open Tooling
Pass
Pass
Class III - Open Model
Class III - Open Model
Pass
Pass
RWKV
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (50%)
In progress (50%)
Class II - Open Tooling
Class II - Open Tooling
In progress (50%)
In progress (50%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
RWKV
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (50%)
In progress (50%)
Class II - Open Tooling
Class II - Open Tooling
In progress (50%)
In progress (50%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
RWKV
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (50%)
In progress (50%)
Class II - Open Tooling
Class II - Open Tooling
In progress (50%)
In progress (50%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
LLM360
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (29%)
In progress (29%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Mistral
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Mistral
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Mistral
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Mistral
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Mistral
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
AI21 Labs
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Snowflake
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Snowflake
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
MyShell
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Mistral
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Mistral
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
EleutherAI
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (20%)
In progress (20%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Rinna
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Salesforce
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Salesforce
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Cerebras
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Google
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Cerebras
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Zyphra
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
Allen Institute
Class III - Open Model
2024-06-13
Class I - Open Science
Class I - Open Science
Fail
Fail
Class II - Open Tooling
Class II - Open Tooling
Fail
Fail
Class III - Open Model
Class III - Open Model
Conditional Pass
Conditional Pass
UC Berkeley
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (21%)
In progress (21%)
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
In progress (17%)
In progress (17%)
BAAI
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
Fail
Fail
Class II - Open Tooling
Class II - Open Tooling
In progress (10%)
In progress (10%)
Class III - Open Model
Class III - Open Model
In progress (17%)
In progress (17%)
Technology Innovation Institute, LightOn
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
Shanghai AI Lab
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
TogetherAI
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
Google
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
Technology Innovation Institute, LightOn
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
Google
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
EleutherAI
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
Inspur AI Research
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
EleutherAI
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
EleutherAI
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
BigCode Project
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
Bloomberg
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
Microsoft
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)
EleutherAI
Unclassified
2024-06-13
Class I - Open Science
Class I - Open Science
In progress (14%)
In progress (14%)
Class II - Open Tooling
Class II - Open Tooling
In progress (0%)
In progress (0%)
Class III - Open Model
Class III - Open Model
In progress (0%)
In progress (0%)