FLOR 6.3B by projecte-aina

 »  All LLMs  »  projecte-aina  »  FLOR 6.3B   URL Share it on

FLOR 6.3B is an open-source language model by projecte-aina. Features: 6.3b LLM, VRAM: 12.5GB.

  Autotrain compatible   Bloom   Ca   Catalan   Dataset:projecte-aina/catalog   En   Endpoints compatible   English   Es   Flor   Region:us   Safetensors   Sharded   Spanish   Tensorflow

FLOR 6.3B Parameters and Internals

Model Type 
text generation, causal language modeling
Use Cases 
Areas:
research, commercial applications
Primary Use Cases:
text generation, question answering, machine translation, natural language inference
Limitations:
potential biases, no measures estimated for embedded bias
Considerations:
Future research on bias and toxicity intended
Supported Languages 
en (high), es (high), ca (high)
Training Details 
Data Sources:
CATalog 1.0, web crawlings, public domain data
Data Volume:
140B tokens
Methodology:
Language adaptation technique from BLOOM-7.1B
Hardware Used:
Cerebras CS-2 systems
Model Architecture:
Transformer-based causal language model
Input Output 
Input Format:
text
Accepted Modalities:
text
Output Format:
generated text
LLM NameFLOR 6.3B
Repository 🤗https://huggingface.co/projecte-aina/FLOR-6.3B 
Model Size6.3b
Required VRAM12.5 GB
Updated2024-07-04
Maintainerprojecte-aina
Model Typebloom
Model Files  5.0 GB: 1-of-3   5.0 GB: 2-of-3   2.5 GB: 3-of-3
Supported Languagesen es ca
Model ArchitectureBloomForCausalLM
Transformers Version4.35.2
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50257
Torch Data Typefloat16
Errorsreplace

Best Alternatives to FLOR 6.3B

Best Alternatives
Context / RAM
Downloads
Likes
OpenHermes 2.5 FLOR 6.3B0K / 13 GB8111
FLOR 6.3B Xat0K / 12.5 GB100
FLOR RAG EADOP0K / 12.4 GB210
FLOR 6.3B Instructed0K / 12.4 GB00
FlorRAG0K / 12.4 GB00
Note: green Score (e.g. "73.2") means that the model is better than projecte-aina/FLOR-6.3B.

Rank the FLOR 6.3B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 53999 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a