Cognitivecomputations Samantha Mistral 7B Bnb 4bit Smashed is an open-source language model by PrunaAI. Features: 7b LLM, VRAM: 4.5GB, Context: 32K, Quantized, LLM Explorer Score: 0.14.
Cognitivecomputations Samantha Mistral 7B Bnb 4bit Smashed Parameters and Internals
Model Type
text generation
Use Cases
Areas:
research, commercial applications
Additional Notes
The model is compressed with llm-int8 and uses safetensors format. Calibration data used: WikiText. Naming convention adds 'turbo', 'tiny', or 'green' for models achieving <90% of the original's inference metrics.
Input Output
Input Format:
text
Accepted Modalities:
text
Output Format:
text
Performance Tips:
Test efficiency gains directly in your use-cases; the first run might take more memory due to CUDA overheads.
Note: green Score (e.g. "73.2") means that the model is better than PrunaAI/cognitivecomputations-samantha-mistral-7b-bnb-4bit-smashed.
Rank the Cognitivecomputations Samantha Mistral 7B Bnb 4bit Smashed Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52721 in total.