Gen AI
Introduction to AI and LLMs (4h)
- Introduction to AI (from Multi layer perceptrons (MLP) to self-attention)
- Introduction to Transformers and LLMs
- How do LLMs deal with external information (Retrieval Augmented Generation)
- What is RAG
- Managing Data for RAG
- Rag with an LLM
- Fine tuning
- Common Tools and Technologies around AI
Operations of AI (4h)
- Hardware/resource requirements for running LLM (i.e. how much vRAM is needed)
- Options to host your open source LLM model on premise or on the cloud
- Cloud
- On-Premise
- Free Model - Risks and Advantages:
- Ollama: https://ollama.com/blog/llama3.2-vision
- Mistral, huggingface: https://huggingface.co/mistralai/Mistral-7B-v0.1
- Alternatives - Risks and Advantages:
- OpenAI ChatGPT
- LLM failure modes, vulnerabilities introduced by LLMs
- Some legal context for AI (EU AI act)