The Future Lab AI4EO aims not only to be at the cutting edge of Earth observation but also intends to make key contributions for the interpretability of AI, the involved ethical implications, and the corresponding technology transfer. We encourage scientific community and general public interested on these topics to join our virtual seminars. If you are interested on attending a particular seminar please send an email to ai4eo@tum.de with the title of the talk as subject. Furthermore, if you want to receive notifications about all our events we invite you to subscribe to our distribution list ai4eo-seminars-subscribe@lists.lrz.de

Looking forward to meeting you soon!

YouTube

By loading the video, you agree to YouTube's privacy policy.
Learn more

Load video

Due to the success of deep learning approaches for many applications in computer science, these ideas are now getting more and more important also in other research fields including life science, medicine, or remote sensing. Even though the applications are rather different, in all of these application areas, we have to deal with the same problems: the limited amount of (labeled) data and heterogeneous or ambiguous data. In this talk, we will discuss both problems and demonstrate how these can be analyzed and avoided in practice. To this end, both the theoretical foundations as well as the practical aspects to circumvent these problems for different application areas will be tackled.

YouTube

By loading the video, you agree to YouTube's privacy policy.
Learn more

Load video

From Compressed Sensing to Neurally Augmented Algorithms

Speaker: Dr. Peter Jung. Senior scientist at the Technical University of Berlin and Visiting Professor at AI4EO Lab.
22th January 2021. 9am (CET)

Recovering data from indirect and incoherent observations is a core task in fields like computational imaging, communications and information processing, group testing and others.  Such inverse problems are ill-posed and therefore prior structural assumptions are necessary to restrict solutions.

As prototypical examples, compressed sensing and low-rank recovery deal with the problem of recovering a sparse vector or a low-rank matrix from very few compressive observations, far less than its ambient dimension. Fundamental works show that in many cases this can be provably achieved in a robust and stable manner with computationally tractable algorithms.

However, sparsity and low-rankness are simple priors and recovery algorithms often require tuning.  It is difficult and often impossible to treat detailed structure and optimal tuning in real-world problems analytically. Recovery approaches, well-understood in theory, perform often sub-optimal in practice. Algorithms converge slowly and increased acquisition time and sampling rates are necessary to achieve a given target resolution.

On the other hand, in many cases neural networks can be trained to empirically achieve high expressivity and the question is how make these ideas accessible to the inverse problem setting.

In this talk I will discuss potential links between the compressed sensing methodology, data-driven approaches for inverse problems and tuning of algorithms. I will first present some recent tuning-free compressed sensing results with applications in communication and group testing showing that strict guarantees are can be obtained in non-standard settings.  Then I will focus on how structure and tuning can be incorporated data-driven into recovery algorithms. I will discuss here some ideas and recent results for compressed sensing and phase retrieval which show that substantial improvements in terms of recovery quality and run-time are possible.

YouTube

By loading the video, you agree to YouTube's privacy policy.
Learn more

Load video

Unsupervised deep learning for multi-temporal analysis

Speaker: Dr. Sudipan Saha, Postdoctoral researcher AI4EO Lab.
10th December 2020. 9am (CET)

Deep learning based methods depend on the availability of labeled training data. Such labeled data is often unavailable in remote sensing, especially in the context of high-resolution (HR) multi-temporal image analysis. In addition to the lack of labeled data, HR multi-temporal image analysis needs to deal with spatio-temporal complexity and differences related to the acquisition conditions, e.g., those induced by the use of different sensors. This talk will provide an overview of the methods devised to address the aforementioned challenges, especially using transfer learning, self-supervised learning, and and domain adaptation. Considering the remote sensing data is evolving fast in terms of spatial, spectral, and temporal resolution, the talk will also provide an overview of possible future developments that can take advantage of the next-generation remote sensing data.

YouTube

By loading the video, you agree to YouTube's privacy policy.
Learn more

Load video

Artificial Neural Networks and AI in high Assurance Applications: Gaps and Techniques

Speaker: Dr. Johann Schumann, Researcher at KBR/NASA Ames Research Center
18th November 2020. 9am (CET)

In recent years, capabilities of Deep Neural Networks (DNN) and Artificial Intelligence (AI) systems have grown tremendously. They are now applied in many areas ranging from game playing, social media, science, to robotics, automotive, and aerospace applications. Based upon requirements for safety of DNN and AI in high assurance automotive and aerospace applications, I will discuss the necessity to ensure that AI techniques for the analysis of Earth observation data and reasoning are working correctly and reliably. In this talk I will present modern techniques for the verification and validation (V&V) of DNN and other AI components as well as approaches for interpretable AI. I will discuss how these techniques can help to ensure quality of the AI results, improve confidence in their application, and facilitate human-AI interaction and collaboration.

Literature Review of Ethical issues in AI4EO: Current Understanding and Scope for Improvement

Speaker: Prof. Dr. Mrinalini Kochupillai, Guest Professor at AI4EO Future Lab
13th November 2020. 9am (CET)

This talk provides an overview of findings from an extensive literature review conducted in the field of ethical issues and opportunities at the interface of Artificial Intelligence and Earth Observations. It will highlight: (i) the ethical issues and opportunities already well know/identified in the literature, (ii) the strengths and shortcomings linked with the present approach and understanding of these issues and (iii) outline a roadmap for tackling the shortcomings and creating a more comprehensive, user-friendly set of guidelines and approaches for researchers engaged in the field of AI4EO. The talk will feature some live surveys and will offer ample time for Qs and As and discussion.

YouTube

By loading the video, you agree to YouTube's privacy policy.
Learn more

Load video

Towards Geographically-Aware Machine Learning

Speaker: Konstantin Klemmer, PhD student at University of Warwick & New York University and Beyond Fellow at AI4EO Future Lab
4th November 2020. 9am (CET)

Machine learning methods have shown great promise for modelling complex, high-dimensional data environments. However, they still struggle with inherently non-iid data such as geographical data. On the other hand, the academic fields of geographic information science and spatial statistics have long known this issue and developed approaches to identify and embed spatial dependencies. This opens up the opportunity to combine approaches from both areas to enable geographically-aware machine learning with high-dimensional, non-linear data. This talk will highlight why these methods are needed, looking at real-world examples. Further, we will explore some useful spatial metrics and how they can be applied in generative and predictive machine learning models.

YouTube

By loading the video, you agree to YouTube's privacy policy.
Learn more

Load video

Beyond Perception Towards Reasoning: Visual Reasoning in Remote Sensing

Speaker: Prof. Dr Lichao Mou, researcher at EO Data Science department and guest Professor of AI4EO Future Lab
29th October 2020. 9am (CET)

Over the past years deep learning has brought a real revolution in artificial intelligence for Earth observation (AI4EO), producing stunning results in a variety of different applications. For instance, deep learning-based remote sensing image classification and object detection systems can now be trained to recognize hundreds of different land cover, land use, and object categories, which sometimes are difficult to distinguish even for humans. Albeit these are indeed impressive advancements, there is no doubt that many problems that are really at the core of AI4EO are far from being solved. This is particularly true for those tasks that involve reasoning, such as induction, deduction, and spatial and temporal reasoning. In this seminar, I will present several exploratory works on visual reasoning in remote sensing done by my colleagues and me.

Shallow learners are dead – Long live shallow learners! Random Forests in the age of Deep Learning

Speaker: Dr. Ronny Hänsch. Researcher DLR- SAR-Technology Department.
15th October 2020. 10am (CET)

The rise of deep neural networks has caused essential changes well beyond the machine learning (ML) and computer vision (CV) communities. One of the consequences is that the previous zoo of used ML methods (e.g. Naive Bayes, MLPs, SVMs, Random Forests, etc.) is now replaced by a monoculture of (deep) neural networks. Deep Learning (DL) approaches have also been successfully used (and sometimes abused) in Remote Sensing (RS) and Earth Observation (EO). Nevertheless, in contrast to other CV applications, shallow learners seem to prevail in RS/EO and coexist with DL (although somewhat in the shadow). This talk aims to shed some light on possible reasons, discusses modern RFs variations, and positions them into the context of Deep Learning.

Village Data Analytics (VIDA): Use of machine learning and Earth Observation to identify remote villages for electrification

Speaker: Mr. Nabin Raj Gaihre. Researcher at TFE Energy.
26th August 2020. 10am (CET)

More than a billion people do not have access to electricity. Most of them live in pretty remote regions. There is very little known about these villages. This data void in remote villages is “one of the”, if not “the” most important barrier. And, we are developing a solution for it! Our solution is “Village Data Analytics”, or VIDA. VIDA is a machine-learning-based software that analyses satellite imagery and ground data to provide insights into remote villages. It identifies and extract insights about rural villages, anywhere in the world, and to assess their suitability for off-grid electrification, using mini-grids or individual solar home systems. VIDA points governments and donors, electrification companies, and investors to villages that require immediate electrification. VIDA has already been used by governments and large donors in sub-Saharan Africa.

Artificial Intelligence for Earth Observation