Pre-requisites
Goal
- Be able to use some level of code completion without leaking code (coz that what I stand for baby. Privacy!).
- Learn how to use LLMs for coding purposes.
I installed 3 models, recommended by the Continue team themselves:
- Llama 3.1 8B (Chat),
- Qwen 2.5 Coder 1.5-base (Autocomplete),
- and Nomic Embed Text (Text Embeddings)
My experiments today were unfortunately halted because Quantiphi bloody blocks the ollama site (so I can’t read documentation) and even google AI studio ka site (so I can’t generate API keys for Gemini or something). My Macbook doesn’t support Llama 3.1 8B model coz the system ram requirements aren’t being met. Hence I wanna see if I can use the Gemini model from our company ka GCP Org. Would be a good thing to try out too.