In our own work, we pursue an experimental approach in two highly uncertain, dynamic, and high-dimensional domains: multi-robot learning, and learning by imitation. Both force us to deal with perceptual and action uncertainty, non-stationarity, and real-t