A comprehensive roadmap for mastering Generative AI, including free courses, videos, articles, and books. Curated from resources shared by experts across LinkedIn, Twitter, and major AI platforms like Microsoft, Google, OpenAI, IBM, and more. This guide is designed to support learners from beginner to advanced levels. Contributions are welcome! β
Curated with contributions from LinkedIn, Twitter, and other social media sources.
Welcome to the Generative AI Learning Roadmap! π This guide is a comprehensive resource, covering free courses, videos, articles, and books that will take you from the fundamentals of Machine Learning and NLP to the advanced world of Generative AI. Whether you're a beginner or an experienced AI enthusiast, this roadmap provides a structured path for deep learning.
This guide is curated from a collection of resources shared on LinkedIn, Twitter, and other social media channels, as well as suggestions from renowned educational institutions and leading AI organizations including Microsoft, OpenAI, Google, IBM, AWS, Stanford, Harvard, and more.
- Beginner Level
- Intermediate Level
- Advanced Level
- Specialized Generative AI Courses
- LangChain and Prompt Engineering
- Advanced Reading & Research
- Additional Resources
- Contributing to this Guide
- Closing Notes
-
Python for Data Science, AI & Development β IBM
π Course Link
Description: Learn Python basics, data types, and functions for Data Science. -
Machine Learning Fundamentals β Stanford University
π Course Link
Description: Covers ML basics like linear regression, decision trees, and model evaluation. -
AI for Everyone β DeepLearning.AI
π Course Link
Description: An introduction to AI concepts, ethics, and applications, perfect for non-technical learners. -
Introduction to AI with Python β Harvard University
π Course Link
Description: A 7-week course covering AI technologies and machine learning basics.
-
Mathematics for ML
π¬ Watch Video
Topics Covered: Linear algebra, calculus, and foundational math for ML. -
Data Science Basics
π¬ Watch Video
Topics Covered: Core concepts in data science and ML fundamentals.
- "Python Crash Course" by Eric Matthes
Description: A beginner-friendly introduction to Python, suitable for data science and AI applications.
-
Neural Networks & Deep Learning β DeepLearning.AI
π Course Link
Description: Understand core architectures of neural networks and deep learning models. -
Data Science & ML β Harvard University
π Course Link
Description: Covers intermediate machine learning concepts, probability, and statistics. -
Generative AI with Large Language Models β AWS
π Course Link
Description: Build and deploy large language models (LLMs) with AWS resources.
-
Training Embeddings for Recommendation Systems
π¬ Watch Video
Topics Covered: Key concepts in embeddings and their use in recommendation engines. -
Data Science: Visualization
π¬ Watch Video
Topics Covered: Visualizing data with Python libraries.
- "Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow" by AurΓ©lien GΓ©ron
Description: A practical guide for machine learning and deep learning with Python libraries.
-
Advanced Machine Learning on Google Cloud Specialization β Google
π Course Link
Description: Covers advanced ML techniques, including model optimization and hyperparameter tuning. -
AI Workflow: Feature Engineering and Bias Detection β IBM
π Course Link
Description: Focuses on data preparation, bias detection, and model validation techniques. -
Supervised Machine Learning: Regression and Classification
π Course Link
Description: An in-depth course on supervised ML techniques with applications in regression and classification.
-
Deep Residual Learning for Image Recognition
π¬ Watch Video
Topics Covered: Understanding deep residual networks for image recognition tasks. -
Attention Mechanisms and Transformers
π¬ Watch Video
Topics Covered: Deep dive into attention mechanisms and transformer models.
- "Deep Learning" by Ian Goodfellow, Yoshua Bengio, and Aaron Courville
Description: A comprehensive resource for deep learning concepts, covering theory and applications.
- LLMOps β Google Cloud & DeepLearning.AI
π Course Link
Description: Learn LLM operations, from pre-processing to model deployment.
- Generative AI for Data Analysis Professional Certificate
π Course Link
Description: Covering data analysis and generative AI with real-world applications.
- ChatGPT Prompt Engineering for Devs
π Course Link
Description: OpenAI's specialized course on prompt engineering for conversational AI models.
- Understanding Responsible AI β Gemini AI Lab
π Course Link
Description: Focuses on responsible and ethical AI practices.
- Awesome Generative AI Guide β Aishwarya Reganti
π Course Link
Description: A curated list of resources, tools, papers, and tutorials on generative AI. This guide covers topics like large language models (LLMs), prompt engineering, diffusion models, and more. Perfect for learners at all levels seeking structured and high-quality AI content.
- LLM Mastery In 30 Days β Vasanth51430
π Course Link
Description: A comprehensive 30-day roadmap to master Large Language Models (LLMs). This resource guides learners through NLP fundamentals, transformer models, fine-tuning, and deploying LLMs in real-world applications. Perfect for those looking for structured learning on LLMs and prompt engineering.
-
LangChain Prompt Templates
π Course Link
Description: Building and applying prompt templates in LangChain. -
LangChain ChatBots Memory
π Course Link
Description: Techniques for memory-aware chatbots using LangChain.
This section includes influential research papers and readings recommended by Ilya Sutskever, a pioneer in the AI and machine learning field. These papers are foundational for understanding neural networks, LSTMs, and other advanced AI concepts.
- The First Law of Complexodynamics
- The Unreasonable Effectiveness of Recurrent Neural Networks
- Understanding LSTM Networks
- Recurrent Neural Network Regularization
- Keeping Neural Networks Simple by Minimizing the Description Length of the Weights
- Pointer Networks
- ImageNet Classification with Deep Convolutional Neural Networks
- Order Matters: Sequence to Sequence for Sets
- GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism
- Deep Residual Learning for Image Recognition
- Multi-Scale Context Aggregation by Dilated Convolutions
- Neural Message Passing for Quantum Chemistry
- Attention is All You Need
- Neural Machine Translation by Jointly Learning to Align and Translate
- Identity Mappings in Deep Residual Networks
- A Simple Neural Network Module for Relational Reasoning
- Variational Lossy Autoencoder
- Relational Recurrent Neural Networks
- Quantifying the Rise and Fall of Complexity in Closed Systems: the Coffee Automaton
- Neural Turing Machines
- Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
- Scaling Laws for Neural Language Models
- A Tutorial Introduction to the Minimum Description Length Principle
- Machine Super Intelligence
- Kolmogorov Complexity and Algorithmic Randomness
- Stanfordβs CS231n Convolutional Neural Networks for Visual Recognition
- Dense Passage Retriever (DPR)
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Zephyr: Direct Distillation of LM Alignment
- Lost in the Middle: How Language Models Use Long Contexts
- π― Mathematics for ML
- π― Linear Regression
- π― Logistic Regression
- π― Data Science Basics, Alternative Link
- π― Isotonic Regression
- π― ML Metrics for Classification
- π― Categorical Variable Encoding Strategies
- π― Naive Bayes Classifier
- π― Dimensionality Reduction (PCA, AutoEncoders)
- π― Entropy, Cross-Entropy, KL-Divergence
- π― Probability, Model Calibration
- π― Data Drift Detection, Model Monitoring
- π― Dynamic Pricing in Ecommerce
- π― Training Embeddings for Recommendation Systems
- π― ANN in Recsys (Annoy)
- π― ANN in Recsys (Product Quantizer)
- π― Model-Based Recommendations @ Twitter
- π― PID Controller for Diversity in Recommender Systems
- π― Instagramβs Recommendation System
- π― Train Neural Networks to Approximate Any Function
- π― BERT for Embeddings
- π― Twitter's Recommendation Algorithm
- π― Model Compression with Knowledge Distillation
- π― Conversational AI (Chat-GPT)
- π― Dual Nature of Conversational LLMs
- π― Enhancing LLMs
- π― Falcon & LLAMA-2, Second Video
- π― Supercharging LLama-2 & Falcon, Alternate Link
- π― SRKGPT AI with Shahrukh Khan's Style
- π― LinkedInβs CTR Modeling
- π― Meituanβs Two-Tower Recsys Model
- π― Twitter & Instagram Recommender Systems
- π― Scalable Query-Item Two-Tower Model
- π― Overcoming Biases in Recsys
- π― Evolution of Recsys
- π― Multi-Armed Bandit Strategies
- π― Uplift Modeling to Detect Causal Effect
- π― Netflixβs Unified Recommendation ML Model
- π― Netflixβs Calibrated Recommendations
- π― Intro to GANs & Stable Diffusion
- π― PySpark Essentials
- π― LinkedIn's Budget Pacing for Targeted Ads
- π― Detecting Buyer-side Returns Fraud
- π― ML System to Combat Counterfeit Fraud in E-Commerce
- π― Transparent Machine Learning with GenAI
- π― Pinterest Ranking: GBDT to Deep Learning
- AI for Everyone
- Generative AI with Large Language Models
- Neural Networks and Deep Learning
- Structuring Machine Learning Projects
- Improving Deep Neural Networks
- AI for Medicine
- Natural Language Processing Specialization
- Generative Adversarial Networks
- AI Ethics
- π Stanford CS229: Building Large Language Models
- π Learn Generative AI in 21 Hours
- π₯ NVIDIA Online Courses
- π§ LLM Evaluation
- π Awesome Generative AI Guide
-
"Generative Deep Learning: Teaching Machines to Paint, Write, Compose, and Play" by David Foster
Description: A guide to generative models and their applications in creative fields. -
"Natural Language Processing with Transformers" by Lewis Tunstall, Leandro von Werra, and Thomas Wolf
Description: Practical guide to working with transformer-based NLP models. -
"The Hundred-Page Machine Learning Book" by Andriy Burkov
Description: A concise yet comprehensive overview of machine learning concepts. -
"Machine Learning Yearning" by Andrew Ng
Description: Free book offering insights into how to structure ML projects effectively.
-
"Attention is All You Need"
π Read Article
Description: Foundational paper on the Transformer model, revolutionizing NLP. -
"Understanding LSTMs" by Christopher Olah
π Read Article
Description: An illustrated guide to Long Short-Term Memory (LSTM) networks. -
"Scaling Laws for Neural Language Models"
π Read Article
Description: Research on scaling language models and their impacts on performance.
| Category | Topic | Resource Type | Link |
|---|---|---|---|
| Machine Learning | Mathematics for ML | Video | Watch |
| Machine Learning | Linear Regression | Course | Link |
| Machine Learning | Logistic Regression | Course | Link |
| Machine Learning | Naive Bayes Classifier | Video | Watch |
| Machine Learning | Dimensionality Reduction (PCA, AutoEncoders) | Course | Link |
| Machine Learning | Data Science: Machine Learning (Harvard) | Course | Link |
| Machine Learning | Machine Learning Crash Course | Course (Google) | Link |
| Machine Learning | Data Science: Linear Regression (Harvard) | Course | Link |
| Category | Topic | Resource Type | Link |
|---|---|---|---|
| Statistics | Statistics Fundamentals | Playlist | Link |
| Statistics | Data Science: Probability (Harvard) | Course | Link |
| Statistics | Probability | Course | Link |
| Statistics | Data Science: Probability (Great Learning) | Course | Link |
| Statistics | Statistics and R (Harvard) | Course | Link |
| Statistics | Data Science: Probability (Harvard) | Course | Link |
| Category | Topic | Resource Type | Link |
|---|---|---|---|
| Generative AI | ChatGPT Prompt Engineering for Devs | Course (OpenAI) | Link |
| Generative AI | LLMOps (Google Cloud & DeepLearning.AI) | Course | Link |
| Generative AI | Generative AI for Data Analysis (Microsoft) | Professional Certificate | Link |
| Generative AI | AI for Everyone (DeepLearning.AI) | Course | Link |
| Generative AI | Generative AI with Large Language Models (AWS) | Course | Link |
| Generative AI | Generative Deep Learning by David Foster | Book | - |
| Category | Topic | Resource Type | Link |
|---|---|---|---|
| Programming | Python for Data Science, AI & Development (IBM) | Course | Link |
| Programming | R Programming Fundamentals | Course (Stanford) | Link |
| Programming | SQL for Data Science | Course | Link |
| Programming | MongoDB Basics | Course | Link |
| Programming | Python for Data Science (Playlist) | Playlist | Link |
| Category | Topic | Resource Type | Link |
|---|---|---|---|
| LangChain and Prompt Engineering | LangChain Prompt Templates | Course | Link |
| LangChain and Prompt Engineering | Building LLM Agents Using LangChain | Course | Link |
| LangChain and Prompt Engineering | LangChain Output Parsing | Course | Link |
| LangChain and Prompt Engineering | Understanding LangChain Chains | Course | Link |
| Category | Topic | Resource Type | Link |
|---|---|---|---|
| Other Specialized Topics | Dynamic Pricing in Ecommerce | Video | Watch |
| Other Specialized Topics | Transparent Machine Learning with GenAI | Video | Watch |
| Other Specialized Topics | RAG from Scratch | Course | Link |
| Other Specialized Topics | Detecting Buyer-side Returns Fraud | Video | Watch |
| Other Specialized Topics | LinkedInβs CTR Modeling | Video | Watch |
| Other Specialized Topics | Building Large Language Models (Stanford CS229) | Course | Link |
This roadmap is designed to be a living document. We invite you to contribute by adding new resources, suggesting improvements, or sharing additional insights! Please submit a pull request on GitHub or reach out with your suggestions. Letβs build a comprehensive learning path for everyone interested in Generative AI. π
This roadmap is designed to help learners advance through different levels of understanding in Generative AI. Be consistent in your learning, practice regularly, and make the most of the amazing free resources available. Enjoy your journey toward becoming a Generative AI expert! π