This project is planned to have four main parts. The first part addresses theoretical foundations. The second part is about the framework of Neural Markov Logic Networks that we introduced recently. The third part is the framework of relational variational autoencoders. The fourth part of the project is further development of Lifted Relational Neural Networks and their applications for generative modelling applications. The project runs from 2020 to 2022.