Astral 7B 1.0Epoch Instruct V0.05 AWQ by jin05102518

 ยป  All LLMs  ยป  jin05102518  ยป  Astral 7B 1.0Epoch Instruct V0.05 AWQ   URL Share it on

  Autotrain compatible   Awq   Endpoints compatible   Instruct   Ko   Mistral   Pytorch   Quantized   Region:us

Astral 7B 1.0Epoch Instruct V0.05 AWQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Astral 7B 1.0Epoch Instruct V0.05 AWQ (jin05102518/Astral-7B-1.0Epoch-Instruct-v0.05-awq)
๐ŸŒŸ Advertise your project ๐Ÿš€

Astral 7B 1.0Epoch Instruct V0.05 AWQ Parameters and Internals

Model Type 
text-generation
Additional Notes 
์ฝ”๋“œ ์˜ˆ์‹œ์—์„œ ์ œ๊ณต๋œ ํ”„๋กฌํ”„ํŠธ ํ˜•์‹์€ '<|system|> ... <|user|> ... <|assistant|>'์ž…๋‹ˆ๋‹ค.
Supported Languages 
Korean (fluent), English (fluent)
Training Details 
Data Sources:
์˜/ํ•œ Instruct ๋ฐ์ดํ„ฐ์…‹
Methodology:
Full-Finetune
Input Output 
Input Format:
<|system|> ... <|user|> prompt <|assistant|>
Accepted Modalities:
text
Output Format:
<|assistant|> response
LLM NameAstral 7B 1.0Epoch Instruct V0.05 AWQ
Repository ๐Ÿค—https://huggingface.co/jin05102518/Astral-7B-1.0Epoch-Instruct-v0.05-awq 
Model Size7b
Required VRAM4.2 GB
Updated2025-09-18
Maintainerjin05102518
Model Typemistral
Instruction-BasedYes
Model Files  4.2 GB
Supported Languagesko
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMistralForCausalLM
Licensecc-by-nc-4.0
Context Length4096
Model Max Length4096
Transformers Version4.35.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Astral 7B 1.0Epoch Instruct V0.05 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Mistral 7B Instruct V0.2 AWQ32K / 4.2 GB60
Mistral 7B Instruct V0.3 AWQ32K / 4.2 GB206575
Mistral 7B Instruct V0.2 AWQ32K / 4.2 GB2816849
...reeze 7B 32K Instruct V1.0 AWQ32K / 4.7 GB90
Breeze 7B Instruct V1.0 AWQ32K / 4.6 GB60
Mistral 7B Instruct V0.3 AWQ32K / 4.2 GB60
...Instruct V0.2 AWQ 4bit Smashed32K / 4.2 GB81
Breeze 7B Instruct V1.0 AWQ32K / 4.6 GB51
Mistral 7B Instruct 32K AWQ32K / 4.2 GB41
...tral 7B Instruct V0.3 AWQ 4Bit32K / 4.2 GB81
Note: green Score (e.g. "73.2") means that the model is better than jin05102518/Astral-7B-1.0Epoch-Instruct-v0.05-awq.

Rank the Astral 7B 1.0Epoch Instruct V0.05 AWQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51435 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124