Run 70Bn Llama 3 Inference on a Single 4GB GPU
Code : https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/layered_inference_with_airllm_70B_LLM_Inference_on_a_Single_4GB_GPU.ipynb
🐦 TWITTER: https://twitter.com/rohanpaul_ai
Airllm Github - https://github.com/lyogavin/Anima/tree/main/air_llm
Checkout the MASSIVELY UPGRADED 2nd Edition of my Book (with 1300+ pages of Dense Python Knowledge) 🐍🔥
Covering 350+ Python 🐍 Core concepts ( 1300+ pages ) 🚀
🟠 Book Link - https://rohanpaul.gumroad.com/l/python-core-with-under-the-hood-explanations
-----------------
Hi, I am a Machine Learning Engineer | Kaggle Master. Connect with me on 🐦 TWITTER: https://twitter.com/rohanpaul_ai - for daily in-depth coverage of Large Language Model bits
----------------
You can find me here:
**********************************************
🐦 TWITTER: https://twitter.com/rohanpaul_ai
👨🏻💼 LINKEDIN: https://www.linkedin.com/in/rohan-paul-ai/
👨🔧 Kaggle: https://www.kaggle.com/paulrohan2020
👨💻 GITHUB: https://github.com/rohan-paul
🧑🦰 Facebook : https://www.facebook.com/rohan.paul.562/
📸 Instagram: https://www.instagram.com/rohan_paul_2020/
**********************************************
Other Playlist you might like 👇
🟠 MachineLearning & DeepLearning Concepts & interview Question Playlist - https://bit.ly/380eYDj
🟠 ComputerVision / DeepLearning Algorithms Implementation Playlist - https://bit.ly/36jEvpI
🟠 DataScience | MachineLearning Projects Implementation Playlist - https://bit.ly/39MEigt
🟠 Natural Language Processing Playlist : https://bit.ly/3P6r2CL
----------------------
#LLM #Largelanguagemodels #Llama2 #LLMfinetuning #opensource #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #genai
Posted May 7, 2024
click to rate
Share this page with your family and friends.