 Himanshu Shukla
|
54269639de
added inference instructions in README for easy inferencing
|
8 mesiacov pred |
|
Himanshu Shukla
|
95f42eeed3
Fixed spelling mistake
|
9 mesiacov pred |
|
Himanshu Shukla
|
0e2703c5bd
Added complete inferencing functionality of 1. terminal inferencing, 2. gradio inferencing, 3. checkpoint inferencing in UI/CLI
|
9 mesiacov pred |
|
Himanshu Shukla
|
5250a20684
Move details of loading lora checkpoints from finetuning/LLM_finetuning_overview.md to local_inference/README.md
|
9 mesiacov pred |
|
himanshushukla12
|
e0e882561c
Fixed readme with renaming file name
|
9 mesiacov pred |
 Himanshu Shukla
|
77f929f764
Merge branch 'meta-llama:main' into main
|
9 mesiacov pred |
 Kai Wu
|
0ef6b8d035
add readme
|
9 mesiacov pred |
|
Himanshu Shukla
|
597e44eace
Update README.md
|
10 mesiacov pred |
|
Himanshu Shukla
|
a261aea41f
Update README.md
|
10 mesiacov pred |
|
himanshushukla12
|
3170c2785d
Changed readme for usage of multimodal inferencing of gradio UI by passsing hugigng-face token from the arguments
|
10 mesiacov pred |
|
himanshushukla12
|
c609a442b0
Change Gradio -> gradio
|
10 mesiacov pred |
|
himanshushukla12
|
19938dded9
Added instructions in README.md for using the Gradio UI
|
10 mesiacov pred |
 Suraj Subramanian
|
d290678c84
Improve discoverability of 3.2 recipes
|
10 mesiacov pred |
 Sanyam Bhutani
|
e45b4c6be5
final fixes
|
10 mesiacov pred |
|
Sanyam Bhutani
|
c587a7f8a7
Path
|
10 mesiacov pred |
|
Sanyam Bhutani
|
989f8b5e40
Fixed paths
|
10 mesiacov pred |
|
Sanyam Bhutani
|
b52a022337
added changes suggested by Beto
|
10 mesiacov pred |
 Matthias Reso
|
00e0b0be6c
Apply suggestions from code review
|
1 rok pred |
|
Matthias Reso
|
190d543b53
Add fp8 references
|
1 rok pred |
|
Matthias Reso
|
b319a9fb8c
Fix lint issue
|
1 rok pred |
|
Matthias Reso
|
a3fd369127
Ref from infernce recipes to vllm for 405B
|
1 rok pred |
|
Matthias Reso
|
0920b1a415
Fix quantization for inference
|
1 rok pred |
 Hamid Shojanazeri
|
808a3f7a0c
Adding support for FSDP+Qlora. (#572)
|
1 rok pred |
|
Kai Wu
|
f6617fb86a
changed --pure_bf16 to --fsdp_config.pure_bf16 and corrected "examples/" path (#587)
|
1 rok pred |
|
Suraj Subramanian
|
2f1cbfbbbf
Merge remote-tracking branch 'upstream/main' into suraj-changes
|
1 rok pred |
 Pia Papanna
|
8dc0578702
Fixing broken file paths
|
1 rok pred |
|
Pia Papanna
|
4344a420f2
recipes/quickstart folder updated
|
1 rok pred |
