- Definition of agents, rational behavior, goals, utilities, environment types
- Adversarial agent cooperation:
Agents with complete access to the state(s) of the environment, games, Minimax algorithm, alpha-beta pruning, elements of chance - Uncertainty:
Motivation: agents with no direct access to the state(s) of the environment, probabilities, conditional probabilities, product rule, Bayes rule, full joint probability distribution, marginalization, summing out, answering queries, complexity, independence assumptions, naive Bayes, conditional independence assumptions - Bayesian networks:
Syntax and semantics of Bayesian networks, answering queries revised (inference by enumeration), typical-case complexity, pragmatics: reasoning from effect (that can be perceived by an agent) to cause (that cannot be directly perceived). - Probabilistic reasoning over time:
Environmental state may change even without the agent performing actions, dynamic Bayesian networks, Markov assumption, transition model, sensor model, inference problems: filtering, prediction, smoothing, most-likely explanation, special cases: hidden Markov models, Kalman filters, Exact inferences and approximations - Decision making under uncertainty:
Simple decisions: utility theory, multivariate utility functions, dominance, decision networks, value of informatio
Complex decisions: sequential decision problems, value iteration, policy iteration, MDPs
Decision-theoretic agents: POMDPs, reduction to multidimensional continuous MDPs, dynamic decision networks
- Simultaneous Localization and Mapping
- Planning
- Game theory (Golden Balls: Split or Share)
Decisions with multiple agents, Nash equilibrium, Bayes-Nash equilibrium - Social Choice
Voting protocols, preferences, paradoxes, Arrow's Theorem, - Mechanism Design
Fundamentals, dominant strategy implementation, Revelation Principle, Gibbard-Satterthwaite Impossibility Theorem, Direct mechanisms, incentive compatibility, strategy-proofness, Vickrey-Groves-Clarke mechanisms, expected externality mechanisms, participation constraints, individual rationality, budget balancedness, bilateral trade, Myerson-Satterthwaite Theorem
|
