Getting Started With Large Language Models
IntermediateLevel
1 Hr 20 MinsDuration
About this Course
- Here, you will learn how to train LLMs for Code from Scratch, covering Training Data Curation, Data Preparation, Model Architecture, Training, and Evaluation Frameworks.
- Explore each step in-depth, delving into the algorithms and techniques used to create StarCoder, a 15B code generation model trained on 80+ programming languages.
- Understand and learn the best practices to train your own StarCoder on the data.
Learning Outcomes
LLM Training
Master training Large Language Models for code from the ground up.
StarCoder Insight
Gain a deep dive into the StarCoder development process.
Techniques Mastery
Learn techniques used in StarCoder through our Hands-On.
Essential Frameworks
Explore code LLM architecture and evaluation frameworks.
Who Should Enroll
- Developers interested in training custom code Lsrge Language Modelss from scratch and doing a Hands-On practice.
- Machine learning engineers and practitioners looking to gain expertise in code generation using large language models.
- Researchers exploring Large Language Models applications and their usage in software development.
Course Curriculum
Learn the complete process of building Large Language Models for code, covering data curation, model training, fine-tuning, evaluation, and deployment strategies.
1. The Evolution of NLP: Symbolic NLP
2. The Evolution of NLP: Statistical NLP
3. The Evolution of NLP: Deep Learning
4. The Evolution of NLP: Deep Learning Era II
5. The Evolution of NLP: Transfomers and Evolution
1. Introduction to Large Language Model
2. Understanding Foundational Models
3. Different types of LLMs: Based on Response
4. Different types of LLMs: Based on Model Architecture
1. The Current State of the Art in LLMs
Get this Course Now
With this course you’ll get
- 1 Hour 20 Mins
Duration
- Kunal Jain
Instructor
- Intermediate
Level
Certificate of completion
Earn a professional certificate upon course completion
- Globally recognized certificate
- Verifiable online credential
- Enhances professional credibility
Frequently Asked Questions
Looking for answers to other questions?
Foundational machine learning and deep learning knowledge is essential. Proficiency in Python and software development practices are also crucial.
t's an intermediate-level course, so beginners should establish foundational knowledge beforehand. It requires prior experience with ML and coding.
Yes, you'll learn practical insights and best practices for training similar models. The training pipeline, from data curation through model evaluation, will be thoroughly covered.
The training process encompasses data curation, preprocessing, model architecture, and evaluation. Specific techniques and frameworks used in StarCoder's development are explored in detail.
The core instructional content spans 38 minutes, yet additional time for practice and exploration is recommended. Learning is self-paced, allowing you to delve into topics as needed.
Yes, you will receive a certificate of completion after successfully finishing the course and assessments.
Related courses
Expand your knowledge with these related courses and expand way beyond
1 Hour 20 Minutes 6 Lessons 4.6
Getting Started with Large Language Models
30 Minutes 1 Lesson4.8
Navigating LLM Tradeoffs: Techniques for Speed, Cost, Scale & Accuracy
1 Hour6 Lessons 4.5
Framework to Choose the Right LLM for Your Business
Popular free courses
Discover our most popular courses to boost your skills
Contact Us Today
Take the first step towards a future of innovation & excellence with Analytics Vidhya
Unlock Your AI & ML Potential
Get Expert Guidance
Need Support? We’ve Got Your Back Anytime!
+91-8068342847 | +91-8046107668
10AM - 7PM (IST) Mon-Sun[email protected]
You'll hear back in 24 hours