EAGE Short Course 2 Language Models for Geoscience Applications
Room
Sunday
7 June 2025
Time
8:30 - 17:00
CPD Points
5
Instructor
Dr. Thomas Grant
Cegal, Norway
Overview
This course will explore the potential of Generative AI (Gen-AI) for geoscience. By examining the key concepts of large language models, and real-world applications of them, participants will gain insights into how these cutting-edge technologies are being used to solve complex geoscience challenges. The course material is aimed at geoscientists that are looking to use AI applications and want a better understanding of how they work, how to get the best out of them and how to critically evaluate their performance.
The course will begin by covering the basic concepts for understanding generative AI and Large Language Models (LLMs), including data embedding, benchmarking, and the mechanics of transformer architectures. The second section of the course will take a deeper look into advanced techniques and methodologies, including retrieval augmented generation (RAG), agents, and improving model results through prompting and grounding.
Finally, the participants will apply the course content to examine critical discussions for the ethical use of generative AI, cybersecurity concerns, and the necessary regulatory frameworks governing AI deployment in geoscience.
Two group discussion sessions during the day include problem-solving tasks that apply the course material to real-world problems.
Course Outline
Session 1
Introduction to Generative AI
- Definition and Overview of Generative AI
- Key Use Cases and Applications in Geoscience
Fundamental Concepts in AI
- Understanding Transformers and Attention
- Overview of Language Models and the Evolution of LLMs (Large Language Models)
- Benchmarks and training data
- Embeddings, Vector Stores and similarity measures
Innovative Architectures and Structural Limitations
- Retrieval-Augmented Generation (RAG): Architecture, Benefits, and Limitations
- Agents and Agentic Structures: An Overview of Autonomous Systems
- Reasoning Frameworks: Chain of Thought, ReAct, and Tree of Thought Approaches
- Function calling and structured output
Group exercises
Session 2
Technical Parameters and Challenges
- Exploring Key Parameters in LLMs
- Understanding Hallucinations in AI and the Importance of Grounding
Advanced Techniques for Model Optimization
- Neuroscience and LLM Functioning: An Introduction to ICL (In Context Learning)
- Prompt Engineering: Strategies for Effective LLM Interactions
- Fine-Tuning Models: Foundation Models and Their Applications
Ethical Considerations and Cybersecurity
- Cybersecurity Implications of Generative AI in Geoscience
- Ethical Challenges and Considerations in AI Deployment
Future Directions and Trends
- Emerging Trends in Generative AI and Their Potential Impact on Geoscience
- Speculative Applications and Research Directions for Future Generative AI in Geoscience
Group exercises
Course objectives
- Understand the main use cases of generative AI for geoscience data
- Cover the main concepts of how language models work and common architectures for building chat-bots and agents.
- Critical evaluation of model outputs and techniques for improving results.
- Highlight considerations for safe and ethical use of generative AI
Participant Profile
Participants should have a basic understanding of artificial intelligence and experience of using AI tools but do not need to have experience of building AI technologies. The course includes some simple code examples in Python which are illustrative only. Participants do not need to have prior experience of using Python.
Prerequisites
Participants should have a basic understanding of artificial intelligence and experience of using AI tools but do not need to have experience of building AI technologies. The course includes some simple code examples in Python which are illustrative only. Participants do not need to have prior experience of using Python
| Time | Activity |
|---|---|
| 08:00 | Departure from conference center Messe Wien |
| 09:00 – 09:20 | Safety introduction ITC |
| 09:20 – 10:50 | ITC / TECH Center & Lab |
| 10:50 – 11:00 | Group exchange |
| 11:00 – 12:30 | ITC / TECH Center & Lab |
| 12:30 – 13:30 | Lunch at the ITC event area |
| 14:30 | Arrival back at conference center Messe Wien |
